-- Logs begin at Thu 2022-05-26 15:44:16 UTC, end at Thu 2022-05-26 17:24:15 UTC. -- May 26 16:32:02.313410 dv-cinder-836072-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 26 16:32:02.323091 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 16:32:02.325098 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 16:32:02 2022] *** May 26 16:32:02.325098 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 16:32:02.325098 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 16:32:02.325098 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: nodename: dv-cinder-836072-5-iscsi May 26 16:32:02.325098 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: machine: x86_64 May 26 16:32:02.325098 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: clock source: unix May 26 16:32:02.325098 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: pcre jit disabled May 26 16:32:02.325098 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: detected number of CPU cores: 4 May 26 16:32:02.325559 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: current working directory: / May 26 16:32:02.325559 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: detected binary path: /usr/bin/uwsgi-core May 26 16:32:02.325559 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: your processes number limit is 47680 May 26 16:32:02.325559 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: your memory page size is 4096 bytes May 26 16:32:02.325559 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: detected max file descriptor number: 2048 May 26 16:32:02.325559 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: lock engine: pthread robust mutexes May 26 16:32:02.325559 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: thunder lock: enabled May 26 16:32:02.325559 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 16:32:02.325559 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 16:32:02.372710 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: Python main interpreter initialized at 0x55c518f9f9c0 May 26 16:32:02.372710 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: python threads support enabled May 26 16:32:02.372710 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: your server socket listen backlog is limited to 100 connections May 26 16:32:02.372710 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: your mercy for graceful operations on workers is 90 seconds May 26 16:32:02.380584 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: mapped 403077 bytes (393 KB) for 2 cores May 26 16:32:02.380584 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: *** Operational MODE: preforking *** May 26 16:32:02.380584 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: *** uWSGI is running in multiple interpreter mode *** May 26 16:32:02.380584 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: spawned uWSGI master process (pid: 87020) May 26 16:32:02.380584 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: spawned uWSGI worker 1 (pid: 87033, cores: 1) May 26 16:32:02.380584 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: spawned uWSGI worker 2 (pid: 87034, cores: 1) May 26 16:32:02.380584 dv-cinder-836072-5-iscsi devstack@keystone.service[87020]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 16:32:02.373836 dv-cinder-836072-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 26 16:32:08.334207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:32:08.334207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: from cryptography.utils import int_from_bytes May 26 16:32:08.335542 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:32:08.335542 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: from cryptography.utils import int_from_bytes May 26 16:32:08.387165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:32:08.387428 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:32:08.387543 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] command line args: [] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:32:08.387802 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:32:08.387996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ================================================================================ {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:32:08.388255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] admin_token = **** {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.388507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] config_dir = [] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.388701 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.388902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] config_source = [] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.389090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] debug = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.389303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.390555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.390555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.390555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.390555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.390809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] list_limit = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.390809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] log_config_append = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.390967 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.391135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] log_dir = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.391318 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] log_file = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.391561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.391818 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.392069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.392320 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.392504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.392687 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.392935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.393194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.393433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.393672 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.393913 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.394146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.394427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.394681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.394989 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.395495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.112/identity {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.395851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] publish_errors = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.396111 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.396353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.396539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.396796 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.397049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.397287 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] standard_threads = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.397508 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.397754 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.397935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.398123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] use_journal = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.398303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] use_json = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.398524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] use_stderr = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.398786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] use_syslog = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.399026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.399325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.399538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.399807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.400051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.400302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.400547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.400802 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.401045 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.401294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.401547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.401801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.402039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.402290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.402863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.402863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.403977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.403977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.403977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.403977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.403977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.405213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.405213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.405213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.405213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.405213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.405809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.405809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.406139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.406139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.406426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.406606 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.406844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.407082 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.407337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.407593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.407843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.408295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.408726 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.409170 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.409616 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.410056 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.410749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.411070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.411513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.411972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.412436 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.412847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.413289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.413735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.414175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.414649 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.415121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.415566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.416024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.416481 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.416935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.417386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.417846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.418293 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.418801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.419262 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.419716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.420166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.420670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.421126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.421575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.422047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.422534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.422906 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:32:08.422906 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: from cryptography.utils import int_from_bytes May 26 16:32:08.423764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.423902 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:32:08.423902 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: from cryptography.utils import int_from_bytes May 26 16:32:08.424128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.424128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.424128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.424486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.424884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.425303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.425745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.426711 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.427125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.427600 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.428072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.428544 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.428999 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.429453 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.429898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.430426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.430879 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.431220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.431479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.431741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.432008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.432264 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.432735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.432735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.432994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.433227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.433470 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.433714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.433967 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.434206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.434492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.434746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.435005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.435275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.435527 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.435759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] auth.external = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.436022 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.436308 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.436532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.436771 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] auth.password = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.437009 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] auth.token = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.437256 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.437499 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.437753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.437995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.438248 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.438551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.438775 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.439053 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] credential.caching = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.439317 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.439509 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.439752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.439994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.440307 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.440545 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.440825 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.441090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.441336 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.441593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.442485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.442753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.443027 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.443275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.443540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.443783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] federation.caching = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.444031 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.444280 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.444536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.444769 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.445024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.445263 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.445521 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.445767 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.446024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.446346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.446596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.446887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity.caching = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.447144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.447399 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.447638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.447902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.448140 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.448631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.448875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.449185 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.449389 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.449628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.449866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.450098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.450378 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.450640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.450901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.451159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.451415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.451700 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.451942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.452186 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.452423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.452667 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.452902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.453143 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.453388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.453633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.453884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.454119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.454462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.454716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.454957 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.455208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.455457 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.455699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.455934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.456167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.456408 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.456649 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.456897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.457139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.457378 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.457679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.457992 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.458447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.458447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.459061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.459061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.459061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.465888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.465888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.465888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.465888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.465888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.465888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.465888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.465888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.465888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.466907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.466907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.466907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.466907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.466907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.466907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.466907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.466907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.466907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.467855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.467855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.467855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.467855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.467855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.467855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.467855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.467855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.467855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.468479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.468479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.468479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.468479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.468479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.468479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.468479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.468479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.468479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.469029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.469029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.469029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.469029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] resource.caching = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.469029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.469469 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.469469 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.469619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.469772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.470015 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.470269 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.470542 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.470791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.471032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] role.caching = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.471288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] role.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.471527 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.471782 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.472035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.472290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.472542 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.472796 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.473224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.473321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.473563 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.473853 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.474050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.474299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.474577 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.474669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:32:08.474803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:32:08.474883 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.474998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] command line args: [] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:32:08.475248 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.475337 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:32:08.475454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ================================================================================ {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:32:08.475547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.475713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] admin_token = **** {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.475843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.475953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] config_dir = [] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.476073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.476198 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.476445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] config_source = [] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.476574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.476705 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] debug = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.476831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.476958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.477135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.477264 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.477264 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.477502 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.477629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.477766 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.477893 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.478022 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.478148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] list_limit = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.478273 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.478443 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] log_config_append = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.478590 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.478722 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.478722 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] log_dir = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.478937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.479062 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] log_file = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.479184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.479321 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.479445 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.479572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.479699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.479824 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.479948 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.480083 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.480210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.480325 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.480460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.480592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.480714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] token.caching = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.480847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.480972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.481099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.481229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.481358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.481496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.481619 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.481739 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.481861 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.481861 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.482078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.482209 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.482355 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.482479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.482598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.482598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.482760 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.482835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.482835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.483035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.112/identity {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.483035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] publish_errors = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.483233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.483353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.483471 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.483566 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.483688 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.483811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.483937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.484082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.484210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.484285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.484346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.484446 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] standard_threads = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.484554 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.484666 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.484786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.connection = **** {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.484891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.484891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.485072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.485176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] use_journal = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.485259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.485365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] use_json = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.485476 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.485587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] use_stderr = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.485587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] use_syslog = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.485739 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.485835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:32:08.485908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.485984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.486057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.486170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.486290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.486520 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.486628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.486822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.486914 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.487023 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.487158 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.487282 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.487402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.487524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.487630 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.487749 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.487861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.487960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.488094 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.488205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.488313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.488436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.488550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.489779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.489896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.490015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.490101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.490165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.490235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:32:08.490391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.490391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.490391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.490391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.490391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.490726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.490726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.490975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.491240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.491492 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.491740 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.491969 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.492198 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.492434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.492664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.492914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.493159 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.493387 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.493642 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.493854 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.494103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.494392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.494620 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.494852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.513534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.513534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.513534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.513534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.513534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.513534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.513534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.513534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.513534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.514589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.514589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.514589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.514589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.514589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.514589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.514589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.514589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.514589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.515602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.515602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.515602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.515602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.515602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.515602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.515602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.515602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.515602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.516611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.516611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.516611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.516611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.516611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.516611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.516611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.516611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.516611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.517676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.517676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.517676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.517676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.517676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.517676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.517676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.517676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.517676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.518723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.518723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.518723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.518723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.518723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.518723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.518723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.518723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.518723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.519728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.519728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.519728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.519728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.519728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.519728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.519728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.519728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.519728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.520712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.520712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.520712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.520712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] auth.external = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.520712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.520712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.520712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.520712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] auth.password = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.520712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] auth.token = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.521717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.521717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.521717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.521717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.521717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.521717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.521717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.521717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] credential.caching = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.521717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.522734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.522734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.522734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.522734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.522734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.522734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.522734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.522734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.522734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.523725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.523725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.523725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.523725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.523725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.523725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] federation.caching = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.523725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.523725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.523725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.524707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.524707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.524707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.524707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.524707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.524707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.524707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.524707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.524707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity.caching = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.525610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.525730 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.525856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.525976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.526080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.526209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.526369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.526369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.526369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.526369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.526369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.526369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.526369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.526369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.526369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.527333 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.527333 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.527333 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.527333 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.527333 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.527333 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.527333 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.527333 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.527333 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.528210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.528210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.528210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.528210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.528210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.528462 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.528578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.528849 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.529121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.529360 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.529610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.529859 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.530090 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.530473 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.530784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.531136 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.531233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.531634 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.532078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.532524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.532962 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.533401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.533861 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.534294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.534754 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.535218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.535726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.536161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.536609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.537048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.537483 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.537929 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.538502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.538938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.539405 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.539960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.540538 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.541096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.541666 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.541907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.542181 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.542472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.542743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.543003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.543258 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.543513 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.543765 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.544015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.544249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.544501 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.544743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.544982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.545221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.545465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.545714 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.545963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.546202 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.546494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.546730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.546979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.547216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.547452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.547688 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.547934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.548174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.548403 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.548638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.548877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] resource.caching = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.549127 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.549374 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.549607 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.549853 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.550103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.550353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.550605 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.550840 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.551080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.551882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] role.caching = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.552236 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] role.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.552509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.552782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.553090 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.553550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.553828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.554084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.554630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.554630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.554832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.555048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.555319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.555544 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.555956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.556215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.556642 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.556878 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.557126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.557379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.557680 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.557929 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.558161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.558440 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.558745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.558988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.559224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.559454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.559684 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.559938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.560192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.560439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.560674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.560909 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.561049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.561179 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.561307 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.561448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] token.caching = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.561576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.561818 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.562054 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.562311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.562590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.562833 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.563078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.563321 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.563565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.563799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.564038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.564271 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.564516 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.564761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.564986 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.565227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.565527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.565785 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.connection = **** {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.566028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.566274 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.566536 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.567478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.567628 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.567868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.568102 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.568336 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.568576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.568809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.569050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.569285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.569540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.569777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.570017 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.570346 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.570621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.570858 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:32:08.571027 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:32:08.607527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.607750 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.607977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.617268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.627420 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.636492 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.636713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.682582 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.690654 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.690892 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.719684 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.719839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.796285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.796517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.796751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.797006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.797250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.797472 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.800574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.800826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.801129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.801922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.802142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.802376 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.822187 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.822458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.822655 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.822879 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.823098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.823572 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.823799 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.824563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.824800 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.825030 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.825252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.825465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.825686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.825875 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.835533 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.836707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.848594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.848851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.849001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.849140 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.849293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.849425 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.849552 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.849696 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.849826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.850005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.850137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.850267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87034) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.850416 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.850416 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:32:08.867986 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.868218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:32:08.868446 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.868610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.868777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:32:08.868931 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:32:08.869100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.869251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.869251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:32:08.869452 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.869557 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.869724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.869831 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.869940 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.870043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.870212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.880856 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.881111 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.881384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.881590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.881791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.881994 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.881994 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.882416 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.889784 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.890443 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.893073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.893353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.893637 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.893778 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.893907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.894033 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.894165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.894300 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.894455 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.894535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.894715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.894809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.895123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.895218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.895401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.895636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.895788 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.895991 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.896100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.896226 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.896508 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.896774 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.923878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.924170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.925682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.925824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.925940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.927172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.931902 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.932178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.932454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.932592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.932718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.933008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.940777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.941055 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.941726 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.942260 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.945551 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.945951 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.946234 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.946541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.946769 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.946864 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.947059 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.947155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.947350 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.947440 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.947650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.947819 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.948102 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.948652 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.948929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.949203 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.967805 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.968090 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.968269 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.968412 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.972843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.973733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.977123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.977412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.977569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.977833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.982370 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.982905 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.986101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.986553 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:08.990604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.990908 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.991132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.991316 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.991498 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.991677 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.991876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.992058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.992236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.992415 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.992593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:08.992593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.011547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.011797 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.011901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.011983 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.012083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.012354 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.012441 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.012868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.020484 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.021185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.022175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.022488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.022931 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.023205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.025575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.025875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.026221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.026469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.026647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.026839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.027006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.027156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.027156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.027397 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.040960 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.041330 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.041632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.041847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.042057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.042264 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.042526 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.042751 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.042956 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.043159 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.043362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.043577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.043577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.043577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.061381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.063490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.068385 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.068503 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.068577 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.069909 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.070103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.071566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.071739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.071831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.072122 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.073706 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.073985 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.074265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.079818 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.081446 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.081786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.083656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.084754 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.085051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.085343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.085622 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.086930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.087216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.087484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.087753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.094738 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.095034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.095319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.097147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.097439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.097836 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.104124 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87034) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.104419 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.104706 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.104979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.105252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.105524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.105817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.106098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.106411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.106610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:32:09.106757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.106881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.107005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.107150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.107279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.107432 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.107560 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.107682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.107822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87034) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.107972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.108210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.108479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.108756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.109104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.109376 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.109640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.109898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.110168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:32:09.147747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c518f9f9c0 pid: 87034 (default app) May 26 16:32:09.150442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c518f9f9c0 pid: 87033 (default app) May 26 16:32:09.151182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d559f-ad09-4659-a352-dd7baba072fb None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:09.151486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d559f-ad09-4659-a352-dd7baba072fb None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:09.151768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d559f-ad09-4659-a352-dd7baba072fb None None] PATH_INFO: `/v3` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:09.156099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1/1] 10.222.0.112 () {50 vars in 796 bytes} [Thu May 26 16:32:09 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:20.566708 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c40027-7055-49e7-ba49-ae3799c0d5c3 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:20.567268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c40027-7055-49e7-ba49-ae3799c0d5c3 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:20.567268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c40027-7055-49e7-ba49-ae3799c0d5c3 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:20.571644 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1/2] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:20 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:32:20.578163 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75da92-5e7d-4907-be69-daec3f14cbea None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:20.578882 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75da92-5e7d-4907-be69-daec3f14cbea None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:20.578882 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75da92-5e7d-4907-be69-daec3f14cbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:20.671796 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: INFO dbcounter [None req-5b75da92-5e7d-4907-be69-daec3f14cbea None None] Registered counter for database keystone May 26 16:32:20.696344 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG oslo_db.sqlalchemy.engines [None req-5b75da92-5e7d-4907-be69-daec3f14cbea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87034) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:32:20.704049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writer thread running {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:32:20.912796 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG passlib.handlers.bcrypt [None req-5b75da92-5e7d-4907-be69-daec3f14cbea None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87034) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 16:32:20.913436 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG passlib.handlers.bcrypt [None req-5b75da92-5e7d-4907-be69-daec3f14cbea None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87034) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 16:32:20.975020 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-5b75da92-5e7d-4907-be69-daec3f14cbea None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:20.976820 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5b75da92-5e7d-4907-be69-daec3f14cbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:21.120512 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 2/3] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:20 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 543 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 16:32:21.366565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c40027-7055-49e7-ba49-ae3799c0d5c3 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:21.450608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: INFO dbcounter [None req-08c40027-7055-49e7-ba49-ae3799c0d5c3 None None] Registered counter for database keystone May 26 16:32:21.476522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG oslo_db.sqlalchemy.engines [None req-08c40027-7055-49e7-ba49-ae3799c0d5c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:32:21.484079 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writer thread running {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:32:21.614154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c40027-7055-49e7-ba49-ae3799c0d5c3 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:21.619003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30ddd7-11c8-462d-b1a5-bec519b42bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:21.619696 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30ddd7-11c8-462d-b1a5-bec519b42bfe admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:21.619981 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30ddd7-11c8-462d-b1a5-bec519b42bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:21.620270 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30ddd7-11c8-462d-b1a5-bec519b42bfe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:21.632168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30ddd7-11c8-462d-b1a5-bec519b42bfe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:21.685166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5c30ddd7-11c8-462d-b1a5-bec519b42bfe admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 16:32:21.685519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30ddd7-11c8-462d-b1a5-bec519b42bfe admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:21.697819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 2/4] 10.222.0.112 () {58 vars in 1329 bytes} [Thu May 26 16:32:21 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 16:32:21.704201 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75da92-5e7d-4907-be69-daec3f14cbea None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:21.728556 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75da92-5e7d-4907-be69-daec3f14cbea None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:21.733379 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722237f-4467-4751-b371-cf5d23ddd2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:21.734612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722237f-4467-4751-b371-cf5d23ddd2eb admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:21.734892 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722237f-4467-4751-b371-cf5d23ddd2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:21.735180 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722237f-4467-4751-b371-cf5d23ddd2eb admin admin] PATH_INFO: `/v3/projects/9dda95f8437548158ad5e83593c71483` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:21.737190 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722237f-4467-4751-b371-cf5d23ddd2eb admin admin] RBAC: Authorizing `identity:get_project(project_id=9dda95f8437548158ad5e83593c71483)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:21.918018 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5722237f-4467-4751-b371-cf5d23ddd2eb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 16:32:21.918390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722237f-4467-4751-b371-cf5d23ddd2eb admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:21.923548 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 3/5] 10.222.0.112 () {56 vars in 1212 bytes} [Thu May 26 16:32:21 2022] GET /identity/v3/projects/9dda95f8437548158ad5e83593c71483 => generated 345 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:24.432539 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dee2f-e0e3-4955-906f-b185672bdcce None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:24.433076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dee2f-e0e3-4955-906f-b185672bdcce None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:24.433076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dee2f-e0e3-4955-906f-b185672bdcce None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:24.437319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 3/6] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:24 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:32:24.445928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208dbd-89a8-452a-b650-35928eeb087c None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:24.446543 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208dbd-89a8-452a-b650-35928eeb087c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:24.446543 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208dbd-89a8-452a-b650-35928eeb087c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:24.468827 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-0f208dbd-89a8-452a-b650-35928eeb087c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:24.470284 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0f208dbd-89a8-452a-b650-35928eeb087c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:24.479327 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 4/7] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:24 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 16:32:24.502602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dee2f-e0e3-4955-906f-b185672bdcce None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:24.516252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dee2f-e0e3-4955-906f-b185672bdcce None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:24.521181 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd02fc-2496-49e9-8b05-5bea577fa542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:24.521825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd02fc-2496-49e9-8b05-5bea577fa542 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:24.522130 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd02fc-2496-49e9-8b05-5bea577fa542 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:24.522452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd02fc-2496-49e9-8b05-5bea577fa542 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:24.531278 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd02fc-2496-49e9-8b05-5bea577fa542 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:24.533169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd02fc-2496-49e9-8b05-5bea577fa542 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:24.543343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 4/8] 10.222.0.112 () {58 vars in 1329 bytes} [Thu May 26 16:32:24 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 16:32:24.549588 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208dbd-89a8-452a-b650-35928eeb087c None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:24.561227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208dbd-89a8-452a-b650-35928eeb087c None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:24.566942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034c2dc-7b3d-4ee6-96db-8a45eaf5284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:24.567833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034c2dc-7b3d-4ee6-96db-8a45eaf5284f admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:24.568118 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034c2dc-7b3d-4ee6-96db-8a45eaf5284f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:24.568396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034c2dc-7b3d-4ee6-96db-8a45eaf5284f admin admin] PATH_INFO: `/v3/users/d22ba20f962d4757847ba75ce1eef95a` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:24.569818 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034c2dc-7b3d-4ee6-96db-8a45eaf5284f admin admin] RBAC: Authorizing `identity:get_user(user_id=d22ba20f962d4757847ba75ce1eef95a)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:24.571703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034c2dc-7b3d-4ee6-96db-8a45eaf5284f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:24.573580 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 5/9] 10.222.0.112 () {56 vars in 1203 bytes} [Thu May 26 16:32:24 2022] GET /identity/v3/users/d22ba20f962d4757847ba75ce1eef95a => generated 248 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:27.053502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cda6c-8e97-455e-bc27-68f796c1789d None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:27.054118 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cda6c-8e97-455e-bc27-68f796c1789d None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:27.054118 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cda6c-8e97-455e-bc27-68f796c1789d None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:27.055498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 5/10] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:27.062051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118cc55-4c5f-4eb3-ae23-32a04939038b None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:27.062698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118cc55-4c5f-4eb3-ae23-32a04939038b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:27.062857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118cc55-4c5f-4eb3-ae23-32a04939038b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:27.090509 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-5118cc55-4c5f-4eb3-ae23-32a04939038b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:27.092585 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5118cc55-4c5f-4eb3-ae23-32a04939038b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:27.220997 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 6/11] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:27.259172 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cda6c-8e97-455e-bc27-68f796c1789d None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:27.273743 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f867c-938d-4c86-a45b-9d4c84ae9282 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:27.274051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f867c-938d-4c86-a45b-9d4c84ae9282 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:27.274313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f867c-938d-4c86-a45b-9d4c84ae9282 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:27.276625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 7/12] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:27 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:32:27.283353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c6ce4-0195-4a4e-b2b0-4de669269b2c None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:27.283651 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c6ce4-0195-4a4e-b2b0-4de669269b2c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:27.284070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c6ce4-0195-4a4e-b2b0-4de669269b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:27.303957 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-8c2c6ce4-0195-4a4e-b2b0-4de669269b2c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:27.305109 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8c2c6ce4-0195-4a4e-b2b0-4de669269b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:27.326279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:27.406180 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 8/13] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:27.432244 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c6ce4-0195-4a4e-b2b0-4de669269b2c None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:27.449872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cda6c-8e97-455e-bc27-68f796c1789d None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:27.502427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b476b1-78e8-4996-b836-dbdd19154251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:27.503824 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b476b1-78e8-4996-b836-dbdd19154251 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:27.504345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b476b1-78e8-4996-b836-dbdd19154251 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:27.504870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b476b1-78e8-4996-b836-dbdd19154251 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:27.525228 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b476b1-78e8-4996-b836-dbdd19154251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-89b476b1-78e8-4996-b836-dbdd19154251 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:27.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:27.545914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:27.547423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:27.547423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:27.547423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:27.547423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:27.547423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:27.547423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:27.547423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:27.547423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:27.547423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:27.547423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:27.547423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:27.547423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:32:27.551056 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 6/14] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:32:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:27.554148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b476b1-78e8-4996-b836-dbdd19154251 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:27.601094 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:27.601332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c6ce4-0195-4a4e-b2b0-4de669269b2c None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:27.648752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2bf5-302d-4c9f-ad69-cb3807c2061a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:27.649464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2bf5-302d-4c9f-ad69-cb3807c2061a None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:27.650104 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2bf5-302d-4c9f-ad69-cb3807c2061a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:27.650104 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2bf5-302d-4c9f-ad69-cb3807c2061a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:27.676953 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:27.696545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b476b1-78e8-4996-b836-dbdd19154251 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:27.744138 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd2bf5-302d-4c9f-ad69-cb3807c2061a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:27.745663 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd2bf5-302d-4c9f-ad69-cb3807c2061a None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:27.751160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81885c-38f0-4275-877a-e978f7b6c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:27.751849 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81885c-38f0-4275-877a-e978f7b6c903 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:27.752137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81885c-38f0-4275-877a-e978f7b6c903 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:27.757937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81885c-38f0-4275-877a-e978f7b6c903 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:27.758868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81885c-38f0-4275-877a-e978f7b6c903 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:27.759191 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81885c-38f0-4275-877a-e978f7b6c903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:27.760712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81885c-38f0-4275-877a-e978f7b6c903 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:27.776234 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 7/15] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:32:27 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:32:27.782122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81885c-38f0-4275-877a-e978f7b6c903 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:27.885085 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 9/16] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:32:27 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:32:27.892001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2bf5-302d-4c9f-ad69-cb3807c2061a None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:27.912873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:27.926357 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81885c-38f0-4275-877a-e978f7b6c903 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:27.967526 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:27.986434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcf12b-101e-45c8-9b4e-8324aaa3fecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:27.988358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcf12b-101e-45c8-9b4e-8324aaa3fecb None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:27.988657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcf12b-101e-45c8-9b4e-8324aaa3fecb None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:27.988943 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcf12b-101e-45c8-9b4e-8324aaa3fecb None admin] PATH_INFO: `/v3/users/d22ba20f962d4757847ba75ce1eef95a` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:27.991776 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcf12b-101e-45c8-9b4e-8324aaa3fecb None admin] RBAC: Authorizing `identity:get_user(user_id=d22ba20f962d4757847ba75ce1eef95a)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:27.994041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcf12b-101e-45c8-9b4e-8324aaa3fecb None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:27.996797 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 8/17] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:27 2022] GET /identity/v3/users/d22ba20f962d4757847ba75ce1eef95a => generated 248 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:32:28.002898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcf12b-101e-45c8-9b4e-8324aaa3fecb None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:28.033487 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2bf5-302d-4c9f-ad69-cb3807c2061a None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:28.082235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72e858-9286-44ff-8bcd-0c864313a946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:28.083073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72e858-9286-44ff-8bcd-0c864313a946 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:28.083363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72e858-9286-44ff-8bcd-0c864313a946 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:28.083647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72e858-9286-44ff-8bcd-0c864313a946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:28.098271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72e858-9286-44ff-8bcd-0c864313a946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:28.099827 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72e858-9286-44ff-8bcd-0c864313a946 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:28.122369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-ea72e858-9286-44ff-8bcd-0c864313a946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:28.122369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:28.122369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:28.122369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:28.122369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:28.122369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:28.122369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:28.122369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:28.122369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:28.122369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:28.122369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:28.122369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:28.122369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:32:28.122369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:32:28.122369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:28.124088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:28.125712 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:32:28.125712 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:32:28.125712 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:28.125712 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:32:28.125712 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 10/18] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:32:28.130127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72e858-9286-44ff-8bcd-0c864313a946 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:28.138276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcf12b-101e-45c8-9b4e-8324aaa3fecb None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:28.179164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102469a4-bc96-4f03-9e29-c033aa2ab33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:28.179981 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102469a4-bc96-4f03-9e29-c033aa2ab33f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:28.180362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102469a4-bc96-4f03-9e29-c033aa2ab33f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:28.180585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102469a4-bc96-4f03-9e29-c033aa2ab33f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:28.182140 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102469a4-bc96-4f03-9e29-c033aa2ab33f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:28.183661 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102469a4-bc96-4f03-9e29-c033aa2ab33f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:28.185350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 9/19] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:32:28 2022] GET /identity/v3/domains/default => generated 200 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:32:28.194385 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102469a4-bc96-4f03-9e29-c033aa2ab33f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:28.239524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:28.265602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72e858-9286-44ff-8bcd-0c864313a946 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:28.268622 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:28.312935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9f408-9805-4cc1-84d9-e925c4c463bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:28.314024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9f408-9805-4cc1-84d9-e925c4c463bb None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:28.314364 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9f408-9805-4cc1-84d9-e925c4c463bb None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:28.314685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9f408-9805-4cc1-84d9-e925c4c463bb None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:28.315566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9f408-9805-4cc1-84d9-e925c4c463bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:28.315887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9f408-9805-4cc1-84d9-e925c4c463bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:28.317351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9f408-9805-4cc1-84d9-e925c4c463bb None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:28.332229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102469a4-bc96-4f03-9e29-c033aa2ab33f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:28.339770 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 11/20] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:32:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:32:28.379667 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504c9fb-aff6-46d4-a1b1-04d8b9c3b840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:28.380357 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504c9fb-aff6-46d4-a1b1-04d8b9c3b840 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:28.380645 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504c9fb-aff6-46d4-a1b1-04d8b9c3b840 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:28.380925 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504c9fb-aff6-46d4-a1b1-04d8b9c3b840 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:28.381793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504c9fb-aff6-46d4-a1b1-04d8b9c3b840 None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.domain.id=default, user.id=d22ba20f962d4757847ba75ce1eef95a) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:28.382110 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504c9fb-aff6-46d4-a1b1-04d8b9c3b840 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:28.383861 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504c9fb-aff6-46d4-a1b1-04d8b9c3b840 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:28.393675 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 10/21] 10.222.0.112 () {56 vars in 1327 bytes} [Thu May 26 16:32:28 2022] GET /identity/v3/role_assignments?user.id=d22ba20f962d4757847ba75ce1eef95a&scope.domain.id=default&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 234 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:32:31.870750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645198d7-8e5a-4bc5-9a9a-124d05c9cb72 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:31.871927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645198d7-8e5a-4bc5-9a9a-124d05c9cb72 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:31.872447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645198d7-8e5a-4bc5-9a9a-124d05c9cb72 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:31.874167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 12/22] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:31 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:32:31.881403 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41438ce-3b24-4750-aebb-8dac33847017 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:31.882455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41438ce-3b24-4750-aebb-8dac33847017 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:31.882959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41438ce-3b24-4750-aebb-8dac33847017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:31.903444 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG passlib.handlers.bcrypt [None req-c41438ce-3b24-4750-aebb-8dac33847017 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87033) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 16:32:31.904221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG passlib.handlers.bcrypt [None req-c41438ce-3b24-4750-aebb-8dac33847017 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87033) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 16:32:31.967392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-c41438ce-3b24-4750-aebb-8dac33847017 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:31.969554 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c41438ce-3b24-4750-aebb-8dac33847017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:32.016604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37700-4b91-4a13-a3d1-c4a7637302f3 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:32.017456 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37700-4b91-4a13-a3d1-c4a7637302f3 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:32.018003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37700-4b91-4a13-a3d1-c4a7637302f3 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:32.020364 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 13/23] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:32 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:32.028840 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467a4af-538b-40b4-ab0f-8f637b8c08c4 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:32.029741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467a4af-538b-40b4-ab0f-8f637b8c08c4 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:32.030609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467a4af-538b-40b4-ab0f-8f637b8c08c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:32.081793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-6467a4af-538b-40b4-ab0f-8f637b8c08c4 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:32.084518 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-6467a4af-538b-40b4-ab0f-8f637b8c08c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:32.188258 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 11/24] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:32:32.190727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57450ac-a22d-45c2-ab6b-c5b9c226848e None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:32.191435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57450ac-a22d-45c2-ab6b-c5b9c226848e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:32.192077 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57450ac-a22d-45c2-ab6b-c5b9c226848e None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:32.204316 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 12/25] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:32 2022] GET /identity => generated 271 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:32.213923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948ce2e-a055-4e87-8944-344ed0a072c0 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:32.214700 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948ce2e-a055-4e87-8944-344ed0a072c0 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:32.215195 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948ce2e-a055-4e87-8944-344ed0a072c0 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:32.218364 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 13/26] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:32 2022] GET /identity => generated 271 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:32.221496 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263d473-4653-4927-9912-fadb48fe8c6d None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:32.222381 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263d473-4653-4927-9912-fadb48fe8c6d None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:32.223200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263d473-4653-4927-9912-fadb48fe8c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:32.250181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 14/27] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:32.258721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1476f-1778-4534-af21-d0f989288dd3 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:32.258721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1476f-1778-4534-af21-d0f989288dd3 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:32.258721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1476f-1778-4534-af21-d0f989288dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:32.259662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-9263d473-4653-4927-9912-fadb48fe8c6d None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:32.260952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-9263d473-4653-4927-9912-fadb48fe8c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:32.307695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:32.313126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-51a1476f-1778-4534-af21-d0f989288dd3 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:32.315271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-51a1476f-1778-4534-af21-d0f989288dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:32.372464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 14/28] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:32.373552 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263d473-4653-4927-9912-fadb48fe8c6d None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:32.435357 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 15/29] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:32.437283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1476f-1778-4534-af21-d0f989288dd3 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:32.477357 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:32.513519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263d473-4653-4927-9912-fadb48fe8c6d None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:32.588650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b6d53-031c-44e6-85ec-8bcb4a9b56db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:32.590695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b6d53-031c-44e6-85ec-8bcb4a9b56db None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:32.591411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b6d53-031c-44e6-85ec-8bcb4a9b56db None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:32.592637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b6d53-031c-44e6-85ec-8bcb4a9b56db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:32.622433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1476f-1778-4534-af21-d0f989288dd3 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:32.636662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b6d53-031c-44e6-85ec-8bcb4a9b56db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:32.640211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b6d53-031c-44e6-85ec-8bcb4a9b56db None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:32.679710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-961b6d53-031c-44e6-85ec-8bcb4a9b56db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:32.679710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:32.679710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:32.679710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:32.679710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:32.679710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:32.679710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:32.679710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:32.679710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:32.679710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:32.679710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:32.679710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:32.679710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:32:32.679710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:32:32.679710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:32.681266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:32.682896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:32:32.682896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:32:32.682896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:32:32.682896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:32:32.682896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 15/30] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:32.683531 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b6d53-031c-44e6-85ec-8bcb4a9b56db None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:32.722872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:32.723105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308eb40-4bb9-4323-a385-164032d69471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:32.724016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308eb40-4bb9-4323-a385-164032d69471 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:32.724799 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308eb40-4bb9-4323-a385-164032d69471 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:32.724799 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308eb40-4bb9-4323-a385-164032d69471 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:32.725552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308eb40-4bb9-4323-a385-164032d69471 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:32.727765 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308eb40-4bb9-4323-a385-164032d69471 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:32.891335 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b6d53-031c-44e6-85ec-8bcb4a9b56db None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:33.094641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35fcc-2682-4970-92d3-de5676941934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:33.096348 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35fcc-2682-4970-92d3-de5676941934 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:33.097152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35fcc-2682-4970-92d3-de5676941934 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:33.097887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35fcc-2682-4970-92d3-de5676941934 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:33.098954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c35fcc-2682-4970-92d3-de5676941934 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:33.100869 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c35fcc-2682-4970-92d3-de5676941934 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:33.109588 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 16/31] 10.222.0.112 () {60 vars in 1136 bytes} [Thu May 26 16:32:32 2022] POST /identity/v3/roles => generated 226 bytes in 673 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:32:33.112319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308eb40-4bb9-4323-a385-164032d69471 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:33.266265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:33.295541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308eb40-4bb9-4323-a385-164032d69471 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:33.362740 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034c427-2438-4a03-96ba-f1bfa368925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:33.364334 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034c427-2438-4a03-96ba-f1bfa368925a None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:33.365068 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034c427-2438-4a03-96ba-f1bfa368925a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:33.365588 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034c427-2438-4a03-96ba-f1bfa368925a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:33.386654 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034c427-2438-4a03-96ba-f1bfa368925a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-5034c427-2438-4a03-96ba-f1bfa368925a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:33.399716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:33.400824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:33.401772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:33.401772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:33.401772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:33.401772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:33.401772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:33.401772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:33.401772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:33.401772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:33.401772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:33.401772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:33.401772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:33.401772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:32:33.401772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 17/32] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:32:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:33.402528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034c427-2438-4a03-96ba-f1bfa368925a None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:33.475689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 16/33] 10.222.0.112 () {60 vars in 1136 bytes} [Thu May 26 16:32:32 2022] POST /identity/v3/roles => generated 220 bytes in 793 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:32:33.477746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e695-7fba-4c37-b5ef-05741091b3cc None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:33.478115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e695-7fba-4c37-b5ef-05741091b3cc None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:33.478515 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e695-7fba-4c37-b5ef-05741091b3cc None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:33.480199 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 17/34] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:33.481171 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42e695-7fba-4c37-b5ef-05741091b3cc None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:33.577245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034c427-2438-4a03-96ba-f1bfa368925a None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:33.622566 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:33.634090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d986c92-1fdd-4bd3-ae20-c73da40acbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:33.634828 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d986c92-1fdd-4bd3-ae20-c73da40acbb3 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:33.635116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d986c92-1fdd-4bd3-ae20-c73da40acbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:33.635409 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d986c92-1fdd-4bd3-ae20-c73da40acbb3 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:33.636180 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d986c92-1fdd-4bd3-ae20-c73da40acbb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:33.636495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d986c92-1fdd-4bd3-ae20-c73da40acbb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:33.638452 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d986c92-1fdd-4bd3-ae20-c73da40acbb3 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:33.662277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 18/35] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:32:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:33.662277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382be53-4aeb-4190-b54d-e2b5712d2345 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:33.662277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382be53-4aeb-4190-b54d-e2b5712d2345 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:33.662277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382be53-4aeb-4190-b54d-e2b5712d2345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:33.677473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:33.693935 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42e695-7fba-4c37-b5ef-05741091b3cc None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:33.694758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-2382be53-4aeb-4190-b54d-e2b5712d2345 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:33.696431 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2382be53-4aeb-4190-b54d-e2b5712d2345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:33.750654 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0815940-2aca-437f-8591-bcbddfece1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:33.751374 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0815940-2aca-437f-8591-bcbddfece1ff None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:33.751662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0815940-2aca-437f-8591-bcbddfece1ff None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:33.752484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0815940-2aca-437f-8591-bcbddfece1ff None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:33.754898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0815940-2aca-437f-8591-bcbddfece1ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:33.754898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0815940-2aca-437f-8591-bcbddfece1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:33.755963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0815940-2aca-437f-8591-bcbddfece1ff None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:33.772177 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 18/36] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:32:33 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:33.774659 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38847eb3-5f09-4f96-92ae-2a9f4b1ff950 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:33.775140 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38847eb3-5f09-4f96-92ae-2a9f4b1ff950 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:33.775626 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38847eb3-5f09-4f96-92ae-2a9f4b1ff950 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:33.778727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 19/37] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:33 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:33.779909 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38847eb3-5f09-4f96-92ae-2a9f4b1ff950 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:33.809146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 19/38] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:33.810208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382be53-4aeb-4190-b54d-e2b5712d2345 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:33.911608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38847eb3-5f09-4f96-92ae-2a9f4b1ff950 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:33.943387 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:33.945126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382be53-4aeb-4190-b54d-e2b5712d2345 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:33.949899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f5c7a-8285-459f-881e-931a04c94558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:33.950601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f5c7a-8285-459f-881e-931a04c94558 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:33.950887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f5c7a-8285-459f-881e-931a04c94558 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:33.951167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f5c7a-8285-459f-881e-931a04c94558 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:33.952201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f5c7a-8285-459f-881e-931a04c94558 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:33.958609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f5c7a-8285-459f-881e-931a04c94558 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:33.980658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac62aab-59ea-4c13-a282-3de90f6b4337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:33.981558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac62aab-59ea-4c13-a282-3de90f6b4337 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:33.981847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac62aab-59ea-4c13-a282-3de90f6b4337 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:33.982132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac62aab-59ea-4c13-a282-3de90f6b4337 None admin] PATH_INFO: `/v3/users/d22ba20f962d4757847ba75ce1eef95a` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:33.987338 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac62aab-59ea-4c13-a282-3de90f6b4337 None admin] RBAC: Authorizing `identity:get_user(user_id=d22ba20f962d4757847ba75ce1eef95a)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:33.987338 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac62aab-59ea-4c13-a282-3de90f6b4337 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:33.987338 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 20/39] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:33 2022] GET /identity/v3/users/d22ba20f962d4757847ba75ce1eef95a => generated 248 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:33.988266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927e112-d5b4-42e5-b8a6-9bd1ff41cd92 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:33.988552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927e112-d5b4-42e5-b8a6-9bd1ff41cd92 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:33.988831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927e112-d5b4-42e5-b8a6-9bd1ff41cd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:33.994008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:34.007162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-8927e112-d5b4-42e5-b8a6-9bd1ff41cd92 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:34.008446 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8927e112-d5b4-42e5-b8a6-9bd1ff41cd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:34.081703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 21/40] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:34.082638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927e112-d5b4-42e5-b8a6-9bd1ff41cd92 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:34.108094 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 20/41] 10.222.0.112 () {60 vars in 1146 bytes} [Thu May 26 16:32:33 2022] POST /identity/v3/projects => generated 302 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:32:34.109128 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f5c7a-8285-459f-881e-931a04c94558 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:34.228127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927e112-d5b4-42e5-b8a6-9bd1ff41cd92 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:34.252417 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f5c7a-8285-459f-881e-931a04c94558 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:34.268414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:34.274537 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52794a-6a68-4332-8522-9bdeb8ec5711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:34.275369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52794a-6a68-4332-8522-9bdeb8ec5711 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:34.275661 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52794a-6a68-4332-8522-9bdeb8ec5711 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:34.276018 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52794a-6a68-4332-8522-9bdeb8ec5711 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:34.277287 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52794a-6a68-4332-8522-9bdeb8ec5711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:34.278946 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52794a-6a68-4332-8522-9bdeb8ec5711 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:34.286257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 22/42] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:32:34 2022] GET /identity/v3/domains/default => generated 200 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:34.287178 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52794a-6a68-4332-8522-9bdeb8ec5711 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:34.298349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22a8b5-17d7-4b65-81b6-694e92f6c382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:34.299951 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22a8b5-17d7-4b65-81b6-694e92f6c382 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:34.300285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22a8b5-17d7-4b65-81b6-694e92f6c382 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:34.300565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22a8b5-17d7-4b65-81b6-694e92f6c382 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:34.301924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22a8b5-17d7-4b65-81b6-694e92f6c382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:34.303548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22a8b5-17d7-4b65-81b6-694e92f6c382 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:34.305536 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 21/43] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:32:34 2022] GET /identity/v3/domains/default => generated 200 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:34.306557 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22a8b5-17d7-4b65-81b6-694e92f6c382 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:34.389143 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:34.432843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52794a-6a68-4332-8522-9bdeb8ec5711 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:34.461834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22a8b5-17d7-4b65-81b6-694e92f6c382 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:34.472998 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86aea6-a3bf-44f3-8eea-d0378ec37de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:34.477942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86aea6-a3bf-44f3-8eea-d0378ec37de9 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:34.477942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86aea6-a3bf-44f3-8eea-d0378ec37de9 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:34.477942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86aea6-a3bf-44f3-8eea-d0378ec37de9 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:34.477942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86aea6-a3bf-44f3-8eea-d0378ec37de9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:34.477942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86aea6-a3bf-44f3-8eea-d0378ec37de9 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:34.497475 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa9586-dce1-48a4-8e79-dcb78fc03f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:34.498156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa9586-dce1-48a4-8e79-dcb78fc03f55 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:34.498522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa9586-dce1-48a4-8e79-dcb78fc03f55 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:34.498809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa9586-dce1-48a4-8e79-dcb78fc03f55 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:34.500062 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa9586-dce1-48a4-8e79-dcb78fc03f55 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:34.501232 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa9586-dce1-48a4-8e79-dcb78fc03f55 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:34.747197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 23/44] 10.222.0.112 () {60 vars in 1136 bytes} [Thu May 26 16:32:34 2022] POST /identity/v3/roles => generated 224 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:32:34.747901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86aea6-a3bf-44f3-8eea-d0378ec37de9 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:34.767836 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 22/45] 10.222.0.112 () {60 vars in 1146 bytes} [Thu May 26 16:32:34 2022] POST /identity/v3/projects => generated 313 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:32:34.856834 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:34.916094 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86aea6-a3bf-44f3-8eea-d0378ec37de9 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:34.981441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53164adf-4506-4137-93a3-9c8d4c6d9918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:34.982404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53164adf-4506-4137-93a3-9c8d4c6d9918 None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:34.983098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53164adf-4506-4137-93a3-9c8d4c6d9918 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:34.983230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53164adf-4506-4137-93a3-9c8d4c6d9918 None admin] PATH_INFO: `/v3/domains/default/users/d22ba20f962d4757847ba75ce1eef95a/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:34.985780 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53164adf-4506-4137-93a3-9c8d4c6d9918 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d22ba20f962d4757847ba75ce1eef95a, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:34.988602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53164adf-4506-4137-93a3-9c8d4c6d9918 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:35.177785 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 24/46] 10.222.0.112 () {58 vars in 1366 bytes} [Thu May 26 16:32:34 2022] PUT /identity/v3/domains/default/users/d22ba20f962d4757847ba75ce1eef95a/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:32:37.094698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eaa09-2837-4b7f-a024-a08eef697d9a None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:37.095273 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eaa09-2837-4b7f-a024-a08eef697d9a None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:37.095859 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eaa09-2837-4b7f-a024-a08eef697d9a None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:37.097316 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 23/47] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:37.102874 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d537755-8200-4bc0-910c-01571fd45c2d None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:37.103306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d537755-8200-4bc0-910c-01571fd45c2d None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:37.103459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d537755-8200-4bc0-910c-01571fd45c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:37.121059 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-5d537755-8200-4bc0-910c-01571fd45c2d None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:37.122416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5d537755-8200-4bc0-910c-01571fd45c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:37.199098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 25/48] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:37.222892 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645eaa09-2837-4b7f-a024-a08eef697d9a None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:37.332395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645eaa09-2837-4b7f-a024-a08eef697d9a None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:37.334028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:37.368280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42391872-ec28-4123-a794-8e0dc5a00644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:37.368996 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42391872-ec28-4123-a794-8e0dc5a00644 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:37.369290 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42391872-ec28-4123-a794-8e0dc5a00644 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:37.369563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42391872-ec28-4123-a794-8e0dc5a00644 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:37.370827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42391872-ec28-4123-a794-8e0dc5a00644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:37.372297 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42391872-ec28-4123-a794-8e0dc5a00644 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:37.373937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 24/49] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:32:37 2022] GET /identity/v3/domains/default => generated 200 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:37.380342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d537755-8200-4bc0-910c-01571fd45c2d None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:37.434014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13180914-d5df-46e6-9687-54fe7308c427 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:37.434917 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13180914-d5df-46e6-9687-54fe7308c427 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:37.435391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13180914-d5df-46e6-9687-54fe7308c427 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:37.438052 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 25/50] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:37 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:32:37.447387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:37.448613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ad5d2-235c-4db4-9c46-501e13aed951 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:37.449085 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ad5d2-235c-4db4-9c46-501e13aed951 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:37.449544 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ad5d2-235c-4db4-9c46-501e13aed951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:37.471709 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-a33ad5d2-235c-4db4-9c46-501e13aed951 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:37.477311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a33ad5d2-235c-4db4-9c46-501e13aed951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:37.523912 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d537755-8200-4bc0-910c-01571fd45c2d None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:37.563228 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d9c31-3e4c-48ec-b6fd-b8093ad4040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:37.564831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d9c31-3e4c-48ec-b6fd-b8093ad4040a None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:37.565285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d9c31-3e4c-48ec-b6fd-b8093ad4040a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:37.566038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d9c31-3e4c-48ec-b6fd-b8093ad4040a None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:37.567012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d9c31-3e4c-48ec-b6fd-b8093ad4040a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:37.568966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 26/51] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:32:37.569559 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d9c31-3e4c-48ec-b6fd-b8093ad4040a None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:37.594524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ad5d2-235c-4db4-9c46-501e13aed951 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:37.705599 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:37.708809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ad5d2-235c-4db4-9c46-501e13aed951 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:37.745249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa20dc-2675-4ce1-9a62-d50276a5c8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:37.746079 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa20dc-2675-4ce1-9a62-d50276a5c8a1 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:37.746391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa20dc-2675-4ce1-9a62-d50276a5c8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:37.746672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa20dc-2675-4ce1-9a62-d50276a5c8a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:37.757947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa20dc-2675-4ce1-9a62-d50276a5c8a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-0faa20dc-2675-4ce1-9a62-d50276a5c8a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:37.765856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:37.766922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:37.768272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:37.768272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:37.768272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:37.768272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:37.768272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:37.768272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:37.768272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:37.768272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:37.768272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:37.768272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:37.768272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:37.768272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:32:37.768272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 27/52] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:32:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:32:37.773851 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa20dc-2675-4ce1-9a62-d50276a5c8a1 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:37.801779 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 26/53] 10.222.0.112 () {60 vars in 1145 bytes} [Thu May 26 16:32:37 2022] POST /identity/v3/projects => generated 299 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:32:37.915113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa20dc-2675-4ce1-9a62-d50276a5c8a1 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:37.964682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e93d2d-bb47-464f-91c3-9e23ebe02ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:37.964682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e93d2d-bb47-464f-91c3-9e23ebe02ae7 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:37.964682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e93d2d-bb47-464f-91c3-9e23ebe02ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:37.964682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e93d2d-bb47-464f-91c3-9e23ebe02ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:37.965126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e93d2d-bb47-464f-91c3-9e23ebe02ae7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:37.965126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e93d2d-bb47-464f-91c3-9e23ebe02ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:37.965126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e93d2d-bb47-464f-91c3-9e23ebe02ae7 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:37.969569 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 28/54] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:32:37 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:32:37.976227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d9c31-3e4c-48ec-b6fd-b8093ad4040a None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:38.093653 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d9c31-3e4c-48ec-b6fd-b8093ad4040a None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:38.095271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:38.129674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5c3d2-7e2f-4680-8b43-546a05c71bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:38.130619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5c3d2-7e2f-4680-8b43-546a05c71bde None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:38.130908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5c3d2-7e2f-4680-8b43-546a05c71bde None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:38.131189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5c3d2-7e2f-4680-8b43-546a05c71bde None admin] PATH_INFO: `/v3/users/d22ba20f962d4757847ba75ce1eef95a` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:38.132426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5c3d2-7e2f-4680-8b43-546a05c71bde None admin] RBAC: Authorizing `identity:get_user(user_id=d22ba20f962d4757847ba75ce1eef95a)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:38.133893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5c3d2-7e2f-4680-8b43-546a05c71bde None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:38.135592 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 27/55] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:37 2022] GET /identity/v3/users/d22ba20f962d4757847ba75ce1eef95a => generated 248 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:38.141230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e93d2d-bb47-464f-91c3-9e23ebe02ae7 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:38.178687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:38.269847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e93d2d-bb47-464f-91c3-9e23ebe02ae7 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:38.303850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599b15b-e456-443f-a0f3-c2d6b9551e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:38.304647 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599b15b-e456-443f-a0f3-c2d6b9551e04 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:38.304949 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599b15b-e456-443f-a0f3-c2d6b9551e04 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:38.305272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599b15b-e456-443f-a0f3-c2d6b9551e04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:38.306531 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599b15b-e456-443f-a0f3-c2d6b9551e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:38.308015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599b15b-e456-443f-a0f3-c2d6b9551e04 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:38.309655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 29/56] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:32:38 2022] GET /identity/v3/domains/default => generated 200 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:38.316236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5c3d2-7e2f-4680-8b43-546a05c71bde None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:38.443232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5c3d2-7e2f-4680-8b43-546a05c71bde None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:38.479128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b019d-f257-4a1f-829c-e30f81e23698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:38.479843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b019d-f257-4a1f-829c-e30f81e23698 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:38.480128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b019d-f257-4a1f-829c-e30f81e23698 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:38.480409 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b019d-f257-4a1f-829c-e30f81e23698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:38.481244 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b019d-f257-4a1f-829c-e30f81e23698 None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.domain.id=default, user.id=d22ba20f962d4757847ba75ce1eef95a) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:38.481561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b019d-f257-4a1f-829c-e30f81e23698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:38.483046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b019d-f257-4a1f-829c-e30f81e23698 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:38.490928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 28/57] 10.222.0.112 () {56 vars in 1327 bytes} [Thu May 26 16:32:38 2022] GET /identity/v3/role_assignments?user.id=d22ba20f962d4757847ba75ce1eef95a&scope.domain.id=default&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 532 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:40.092079 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd79996-71bd-4819-bc78-52c0ba195774 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:40.092600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd79996-71bd-4819-bc78-52c0ba195774 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:40.092688 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd79996-71bd-4819-bc78-52c0ba195774 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:40.094016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 30/58] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:40.099852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070b240-1b7e-4617-963e-48853c9b8321 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:40.100240 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070b240-1b7e-4617-963e-48853c9b8321 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:40.100422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070b240-1b7e-4617-963e-48853c9b8321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:40.116786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-a070b240-1b7e-4617-963e-48853c9b8321 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:40.117967 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a070b240-1b7e-4617-963e-48853c9b8321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:40.144555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:40.183930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 29/59] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:40.210277 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd79996-71bd-4819-bc78-52c0ba195774 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:40.310581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:40.325485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd79996-71bd-4819-bc78-52c0ba195774 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:40.360727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8ecb4-0a53-44a9-b452-fa892990f38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:40.361412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ecb4-0a53-44a9-b452-fa892990f38c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:40.361697 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ecb4-0a53-44a9-b452-fa892990f38c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:40.362000 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ecb4-0a53-44a9-b452-fa892990f38c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:40.363198 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8ecb4-0a53-44a9-b452-fa892990f38c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:40.364624 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8ecb4-0a53-44a9-b452-fa892990f38c None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:40.366223 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 31/60] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:32:40 2022] GET /identity/v3/domains/default => generated 200 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:40.372222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070b240-1b7e-4617-963e-48853c9b8321 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:40.492388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070b240-1b7e-4617-963e-48853c9b8321 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:40.529119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237210c6-0452-49ab-9627-69de9c6e83e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:40.529795 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237210c6-0452-49ab-9627-69de9c6e83e7 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:40.530079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237210c6-0452-49ab-9627-69de9c6e83e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:40.530379 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237210c6-0452-49ab-9627-69de9c6e83e7 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:40.531109 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237210c6-0452-49ab-9627-69de9c6e83e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:40.532619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237210c6-0452-49ab-9627-69de9c6e83e7 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:40.643946 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 30/61] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:32:40 2022] POST /identity/v3/users => generated 276 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:32:44.396982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33605977-a58d-481c-b55c-f89cb58fb748 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:44.397842 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33605977-a58d-481c-b55c-f89cb58fb748 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:44.398270 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33605977-a58d-481c-b55c-f89cb58fb748 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:44.399946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 32/62] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:44.406159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8984b06-e3ce-4256-b80b-5fb53da0882f None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:44.407121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8984b06-e3ce-4256-b80b-5fb53da0882f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:44.407552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8984b06-e3ce-4256-b80b-5fb53da0882f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:44.431450 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-a8984b06-e3ce-4256-b80b-5fb53da0882f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:44.432909 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a8984b06-e3ce-4256-b80b-5fb53da0882f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:44.454434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:44.463293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254a9f2-8a72-4d92-8752-091b8b382267 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:44.463819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254a9f2-8a72-4d92-8752-091b8b382267 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:44.464267 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254a9f2-8a72-4d92-8752-091b8b382267 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:44.465776 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 33/63] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:32:44.471774 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ffd4b-d3df-4a6a-abaa-ea58b6b95f76 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:44.472240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ffd4b-d3df-4a6a-abaa-ea58b6b95f76 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:44.472687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ffd4b-d3df-4a6a-abaa-ea58b6b95f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:44.492007 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-cf4ffd4b-d3df-4a6a-abaa-ea58b6b95f76 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:44.493545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-cf4ffd4b-d3df-4a6a-abaa-ea58b6b95f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:44.528581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 31/64] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:44.530270 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca4a03-9c3b-4ec7-9c2b-b60fd5735ee5 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:44.530794 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca4a03-9c3b-4ec7-9c2b-b60fd5735ee5 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:44.531249 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca4a03-9c3b-4ec7-9c2b-b60fd5735ee5 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:44.533528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 32/65] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:44.539148 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7254a4f-30e4-4474-9fd4-8e505948f83b None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:44.541193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7254a4f-30e4-4474-9fd4-8e505948f83b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:44.541707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7254a4f-30e4-4474-9fd4-8e505948f83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:44.568704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-e7254a4f-30e4-4474-9fd4-8e505948f83b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:44.569921 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-e7254a4f-30e4-4474-9fd4-8e505948f83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:44.586858 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 34/66] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:32:44.588406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ffd4b-d3df-4a6a-abaa-ea58b6b95f76 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:44.664790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 33/67] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:44.666820 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071504d7-d627-4f96-9a7f-ee71da9e5705 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:44.667414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071504d7-d627-4f96-9a7f-ee71da9e5705 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:44.667908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071504d7-d627-4f96-9a7f-ee71da9e5705 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:44.670004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 34/68] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:44.671263 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071504d7-d627-4f96-9a7f-ee71da9e5705 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:44.706766 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:44.722403 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ffd4b-d3df-4a6a-abaa-ea58b6b95f76 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:44.758559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c487403-e61c-44dd-9fa8-8f511c4f16de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:44.759456 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c487403-e61c-44dd-9fa8-8f511c4f16de None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:44.759739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c487403-e61c-44dd-9fa8-8f511c4f16de None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:44.760018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c487403-e61c-44dd-9fa8-8f511c4f16de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:44.772262 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:44.772956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c487403-e61c-44dd-9fa8-8f511c4f16de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-1c487403-e61c-44dd-9fa8-8f511c4f16de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:44.781588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:44.782772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:44.783527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:44.783527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:44.783527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:44.783527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:44.783527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:44.783527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:44.783527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:44.783527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:44.783527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:44.783527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:44.783527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:44.783527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:32:44.784096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 35/69] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:32:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:44.785899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a349ba-ae7e-406d-9714-793283ddd1b6 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:44.786241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a349ba-ae7e-406d-9714-793283ddd1b6 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:44.786563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a349ba-ae7e-406d-9714-793283ddd1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:44.797334 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071504d7-d627-4f96-9a7f-ee71da9e5705 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:44.805906 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-86a349ba-ae7e-406d-9714-793283ddd1b6 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:44.810948 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-86a349ba-ae7e-406d-9714-793283ddd1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:44.835035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0045e9f-5c3d-4182-8df6-0fd7a34fb40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:44.836178 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0045e9f-5c3d-4182-8df6-0fd7a34fb40b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:44.836868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0045e9f-5c3d-4182-8df6-0fd7a34fb40b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:44.837455 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0045e9f-5c3d-4182-8df6-0fd7a34fb40b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:44.849576 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0045e9f-5c3d-4182-8df6-0fd7a34fb40b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-d0045e9f-5c3d-4182-8df6-0fd7a34fb40b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:44.858540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:44.859626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:44.861115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:44.861115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:44.861115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:44.861115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:44.861115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:44.861115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:44.861115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:44.861115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:44.861115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:44.861115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:44.861115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:32:44.861115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:32:44.863294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 35/70] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:32:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:44.864252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0045e9f-5c3d-4182-8df6-0fd7a34fb40b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:44.881479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 36/71] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:44.883067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a349ba-ae7e-406d-9714-793283ddd1b6 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:44.961829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:44.965926 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0045e9f-5c3d-4182-8df6-0fd7a34fb40b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:44.983025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a349ba-ae7e-406d-9714-793283ddd1b6 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:45.000617 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936cb12-79c7-46af-b31a-b9f4c160462c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:45.001486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936cb12-79c7-46af-b31a-b9f4c160462c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:45.001771 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936cb12-79c7-46af-b31a-b9f4c160462c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:45.002047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936cb12-79c7-46af-b31a-b9f4c160462c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:45.009521 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:45.012285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936cb12-79c7-46af-b31a-b9f4c160462c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:45.017276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c76c5-95af-46c6-a3d8-169240bc179b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:45.017946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c76c5-95af-46c6-a3d8-169240bc179b None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:45.018239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c76c5-95af-46c6-a3d8-169240bc179b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:45.018542 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c76c5-95af-46c6-a3d8-169240bc179b None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:45.019288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c76c5-95af-46c6-a3d8-169240bc179b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:45.019602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c76c5-95af-46c6-a3d8-169240bc179b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-0936cb12-79c7-46af-b31a-b9f4c160462c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:45.020095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:45.021006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:45.021761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:45.021761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:45.021761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:45.021761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:45.021761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:45.021761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:45.021761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:45.021761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:45.021761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:45.021761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:45.021761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:32:45.021761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:32:45.022538 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c76c5-95af-46c6-a3d8-169240bc179b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:45.022620 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 36/72] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:32:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:45.022620 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936cb12-79c7-46af-b31a-b9f4c160462c None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:45.034446 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 37/73] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:32:44 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:45.035742 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37d154-e413-44c0-9580-b2b45c7544e4 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:45.036029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37d154-e413-44c0-9580-b2b45c7544e4 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:45.036309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37d154-e413-44c0-9580-b2b45c7544e4 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:45.037771 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 38/74] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:45.038352 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37d154-e413-44c0-9580-b2b45c7544e4 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:45.144706 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936cb12-79c7-46af-b31a-b9f4c160462c None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:45.156148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37d154-e413-44c0-9580-b2b45c7544e4 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:45.184085 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418365be-b5ea-489f-ba82-c5475c6fe774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:45.185165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418365be-b5ea-489f-ba82-c5475c6fe774 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:45.185658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418365be-b5ea-489f-ba82-c5475c6fe774 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:45.186126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418365be-b5ea-489f-ba82-c5475c6fe774 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:45.187329 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418365be-b5ea-489f-ba82-c5475c6fe774 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:45.187648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418365be-b5ea-489f-ba82-c5475c6fe774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:45.189723 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418365be-b5ea-489f-ba82-c5475c6fe774 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:45.202275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeda0e-ed73-4e1a-b717-b2b77b37a284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:45.203341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 37/75] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:32:45 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:45.203499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeda0e-ed73-4e1a-b717-b2b77b37a284 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:45.203499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeda0e-ed73-4e1a-b717-b2b77b37a284 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:45.204279 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeda0e-ed73-4e1a-b717-b2b77b37a284 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:45.204493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418365be-b5ea-489f-ba82-c5475c6fe774 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:45.218135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:45.222283 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baeda0e-ed73-4e1a-b717-b2b77b37a284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-2baeda0e-ed73-4e1a-b717-b2b77b37a284 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:45.230558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:45.231856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:45.232873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:45.232873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:45.232873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:45.232873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:45.232873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:45.232873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:45.232873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:45.232873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:45.232873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:45.232873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:45.232873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:32:45.232873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:32:45.232873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 39/76] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:32:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:45.232873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeda0e-ed73-4e1a-b717-b2b77b37a284 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:45.293086 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:45.341061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418365be-b5ea-489f-ba82-c5475c6fe774 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:45.364768 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeda0e-ed73-4e1a-b717-b2b77b37a284 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:45.380725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd6a40-984b-471b-8f88-06cae650e40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:45.381412 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd6a40-984b-471b-8f88-06cae650e40b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:45.381705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd6a40-984b-471b-8f88-06cae650e40b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:45.381992 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd6a40-984b-471b-8f88-06cae650e40b None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:45.382785 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd6a40-984b-471b-8f88-06cae650e40b None admin] RBAC: Adding query filter params (name=member) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:45.383162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd6a40-984b-471b-8f88-06cae650e40b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:45.384578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd6a40-984b-471b-8f88-06cae650e40b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:45.394210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 38/77] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:32:45 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:45.395702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca961-412f-4a45-908f-89b69e5a8eee None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:45.396003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca961-412f-4a45-908f-89b69e5a8eee None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:45.396288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca961-412f-4a45-908f-89b69e5a8eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:45.412183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7dcb1-6bfc-4dc5-94c7-befa006a4b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:45.413069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7dcb1-6bfc-4dc5-94c7-befa006a4b11 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:45.413358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7dcb1-6bfc-4dc5-94c7-befa006a4b11 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:45.413639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7dcb1-6bfc-4dc5-94c7-befa006a4b11 None admin] PATH_INFO: `/v3/users/d22ba20f962d4757847ba75ce1eef95a` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:45.415189 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7dcb1-6bfc-4dc5-94c7-befa006a4b11 None admin] RBAC: Authorizing `identity:get_user(user_id=d22ba20f962d4757847ba75ce1eef95a)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:45.416743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7dcb1-6bfc-4dc5-94c7-befa006a4b11 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:45.418444 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 40/78] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:45 2022] GET /identity/v3/users/d22ba20f962d4757847ba75ce1eef95a => generated 248 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:45.419237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7dcb1-6bfc-4dc5-94c7-befa006a4b11 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:45.420600 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-aa6ca961-412f-4a45-908f-89b69e5a8eee None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:45.421819 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-aa6ca961-412f-4a45-908f-89b69e5a8eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:45.491535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 39/79] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:45.492313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ca961-412f-4a45-908f-89b69e5a8eee None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:45.497147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:45.533215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7dcb1-6bfc-4dc5-94c7-befa006a4b11 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:45.566194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:45.575773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8a329-a3b4-414a-a437-f8b53aace441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:45.576659 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8a329-a3b4-414a-a437-f8b53aace441 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:45.576945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8a329-a3b4-414a-a437-f8b53aace441 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:45.577223 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8a329-a3b4-414a-a437-f8b53aace441 None admin] PATH_INFO: `/v3/users/75a051b2e49849fb9c162fa672f54248` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:45.601181 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8a329-a3b4-414a-a437-f8b53aace441 None admin] RBAC: Authorizing `identity:get_user(user_id=75a051b2e49849fb9c162fa672f54248)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:45.602827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8a329-a3b4-414a-a437-f8b53aace441 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:45.604630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 41/80] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:45 2022] GET /identity/v3/users/75a051b2e49849fb9c162fa672f54248 => generated 276 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:45.605443 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8a329-a3b4-414a-a437-f8b53aace441 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:45.614355 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ca961-412f-4a45-908f-89b69e5a8eee None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:45.650689 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976acf0-f995-4877-beee-f9d842b18eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:45.651375 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976acf0-f995-4877-beee-f9d842b18eb2 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:45.651748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976acf0-f995-4877-beee-f9d842b18eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:45.652220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976acf0-f995-4877-beee-f9d842b18eb2 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:45.652758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976acf0-f995-4877-beee-f9d842b18eb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:45.653098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976acf0-f995-4877-beee-f9d842b18eb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:45.654456 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976acf0-f995-4877-beee-f9d842b18eb2 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:45.665755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 40/81] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:32:45 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:45.667157 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976acf0-f995-4877-beee-f9d842b18eb2 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:45.720891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8a329-a3b4-414a-a437-f8b53aace441 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:45.749834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:45.758964 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336ff8a-90bf-48b6-b888-d4af67873667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:45.759896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ff8a-90bf-48b6-b888-d4af67873667 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:45.760267 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ff8a-90bf-48b6-b888-d4af67873667 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:45.760554 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ff8a-90bf-48b6-b888-d4af67873667 None admin] PATH_INFO: `/v3/users/75a051b2e49849fb9c162fa672f54248` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:45.761882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336ff8a-90bf-48b6-b888-d4af67873667 None admin] RBAC: Authorizing `identity:get_user(user_id=75a051b2e49849fb9c162fa672f54248)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:45.763431 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336ff8a-90bf-48b6-b888-d4af67873667 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:45.765154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 42/82] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:45 2022] GET /identity/v3/users/75a051b2e49849fb9c162fa672f54248 => generated 276 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:45.765954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336ff8a-90bf-48b6-b888-d4af67873667 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:45.791289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976acf0-f995-4877-beee-f9d842b18eb2 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:45.808086 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:45.827344 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b405a-40bf-402c-9bee-1b6bc21b0893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:45.828062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b405a-40bf-402c-9bee-1b6bc21b0893 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:45.828301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b405a-40bf-402c-9bee-1b6bc21b0893 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:45.828582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b405a-40bf-402c-9bee-1b6bc21b0893 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:45.886203 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336ff8a-90bf-48b6-b888-d4af67873667 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:45.913722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b405a-40bf-402c-9bee-1b6bc21b0893 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:45.915917 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b405a-40bf-402c-9bee-1b6bc21b0893 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:45.925389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ddcc9-c69b-42c9-aac6-0e4ae0608c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:45.926189 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ddcc9-c69b-42c9-aac6-0e4ae0608c2d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:45.926735 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ddcc9-c69b-42c9-aac6-0e4ae0608c2d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:45.927020 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ddcc9-c69b-42c9-aac6-0e4ae0608c2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:45.928698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ddcc9-c69b-42c9-aac6-0e4ae0608c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:45.930147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ddcc9-c69b-42c9-aac6-0e4ae0608c2d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:45.931829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 43/83] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:32:45 2022] GET /identity/v3/domains/default => generated 200 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:45.936646 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ddcc9-c69b-42c9-aac6-0e4ae0608c2d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:46.011821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:46.044139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 41/84] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:32:45 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:32:46.045000 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b405a-40bf-402c-9bee-1b6bc21b0893 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:46.053385 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ddcc9-c69b-42c9-aac6-0e4ae0608c2d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:46.068188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:46.104795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74120e7e-d84f-471b-9cd5-40c36a8c2501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:46.105464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74120e7e-d84f-471b-9cd5-40c36a8c2501 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:46.105748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74120e7e-d84f-471b-9cd5-40c36a8c2501 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:46.106028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74120e7e-d84f-471b-9cd5-40c36a8c2501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:46.154860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b405a-40bf-402c-9bee-1b6bc21b0893 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:46.182535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74120e7e-d84f-471b-9cd5-40c36a8c2501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:46.184037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74120e7e-d84f-471b-9cd5-40c36a8c2501 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:46.191133 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d6dcf-7e1c-4112-9390-36525495ad5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:46.192007 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d6dcf-7e1c-4112-9390-36525495ad5e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:46.192684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d6dcf-7e1c-4112-9390-36525495ad5e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:46.192684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d6dcf-7e1c-4112-9390-36525495ad5e None admin] PATH_INFO: `/v3/users/75a051b2e49849fb9c162fa672f54248` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:46.193796 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d6dcf-7e1c-4112-9390-36525495ad5e None admin] RBAC: Authorizing `identity:get_user(user_id=75a051b2e49849fb9c162fa672f54248)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:46.195329 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d6dcf-7e1c-4112-9390-36525495ad5e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:46.197282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 42/85] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:46 2022] GET /identity/v3/users/75a051b2e49849fb9c162fa672f54248 => generated 276 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:46.198070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d6dcf-7e1c-4112-9390-36525495ad5e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:46.254052 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:46.295200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:46.295511 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 44/86] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:32:45 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:32:46.295511 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74120e7e-d84f-471b-9cd5-40c36a8c2501 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:46.310222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d6dcf-7e1c-4112-9390-36525495ad5e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:46.345456 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6184b7-255d-4a0a-abe9-2ee43fcd088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:46.346106 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6184b7-255d-4a0a-abe9-2ee43fcd088c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:46.346429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6184b7-255d-4a0a-abe9-2ee43fcd088c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:46.346713 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6184b7-255d-4a0a-abe9-2ee43fcd088c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:46.411299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74120e7e-d84f-471b-9cd5-40c36a8c2501 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:46.428448 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6184b7-255d-4a0a-abe9-2ee43fcd088c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:46.429971 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6184b7-255d-4a0a-abe9-2ee43fcd088c None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:46.453588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90670f23-0345-4d7c-b7a2-c17e75c857c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:46.454833 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90670f23-0345-4d7c-b7a2-c17e75c857c4 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:46.454833 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90670f23-0345-4d7c-b7a2-c17e75c857c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:46.454833 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90670f23-0345-4d7c-b7a2-c17e75c857c4 None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:46.455556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90670f23-0345-4d7c-b7a2-c17e75c857c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:46.457029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90670f23-0345-4d7c-b7a2-c17e75c857c4 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:46.526041 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:46.550934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 43/87] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:32:46 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:32:46.551959 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6184b7-255d-4a0a-abe9-2ee43fcd088c None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:46.588978 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 45/88] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:32:46 2022] POST /identity/v3/users => generated 290 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:32:46.592901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90670f23-0345-4d7c-b7a2-c17e75c857c4 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:46.616039 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:46.711300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6184b7-255d-4a0a-abe9-2ee43fcd088c None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:46.748310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90670f23-0345-4d7c-b7a2-c17e75c857c4 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:46.768573 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067f29f-5f72-43cb-b185-62c0cbde5e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:46.769472 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067f29f-5f72-43cb-b185-62c0cbde5e15 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:46.769853 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067f29f-5f72-43cb-b185-62c0cbde5e15 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:46.770387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067f29f-5f72-43cb-b185-62c0cbde5e15 None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:46.772379 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067f29f-5f72-43cb-b185-62c0cbde5e15 None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:46.774553 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067f29f-5f72-43cb-b185-62c0cbde5e15 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:46.781770 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 44/89] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:32:46 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:46.781770 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067f29f-5f72-43cb-b185-62c0cbde5e15 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:46.804684 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53297d7-586b-4a82-96cd-306353071e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:46.805604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53297d7-586b-4a82-96cd-306353071e8f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:46.805896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53297d7-586b-4a82-96cd-306353071e8f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:46.806182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53297d7-586b-4a82-96cd-306353071e8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:46.869125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:46.913103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53297d7-586b-4a82-96cd-306353071e8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:46.913103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53297d7-586b-4a82-96cd-306353071e8f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:46.928873 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067f29f-5f72-43cb-b185-62c0cbde5e15 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:46.937797 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:46.981494 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c76953-8b3b-4940-a2f5-bad25153f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:46.982455 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c76953-8b3b-4940-a2f5-bad25153f4df None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:46.982939 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c76953-8b3b-4940-a2f5-bad25153f4df None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:46.983229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c76953-8b3b-4940-a2f5-bad25153f4df None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:46.984865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c76953-8b3b-4940-a2f5-bad25153f4df None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:46.986731 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c76953-8b3b-4940-a2f5-bad25153f4df None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:46.988718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 45/90] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:32:46 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:46.989927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c76953-8b3b-4940-a2f5-bad25153f4df None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:47.055001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 46/91] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:32:46 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:32:47.055895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53297d7-586b-4a82-96cd-306353071e8f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:47.144365 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c76953-8b3b-4940-a2f5-bad25153f4df None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:47.172874 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:47.190016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edd3a0-a75b-4d07-9ac0-4afe3fa53375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:47.193930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edd3a0-a75b-4d07-9ac0-4afe3fa53375 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:47.193930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edd3a0-a75b-4d07-9ac0-4afe3fa53375 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:47.193930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edd3a0-a75b-4d07-9ac0-4afe3fa53375 None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:47.193930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edd3a0-a75b-4d07-9ac0-4afe3fa53375 None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:47.194626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edd3a0-a75b-4d07-9ac0-4afe3fa53375 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:47.197455 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 46/92] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:32:46 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:47.198541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edd3a0-a75b-4d07-9ac0-4afe3fa53375 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:47.217243 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53297d7-586b-4a82-96cd-306353071e8f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:47.256289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:47.276987 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9096ad-7bf5-4bb3-9e23-877d75205b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:47.277664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9096ad-7bf5-4bb3-9e23-877d75205b9b None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:47.277955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9096ad-7bf5-4bb3-9e23-877d75205b9b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:47.278243 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9096ad-7bf5-4bb3-9e23-877d75205b9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:47.279227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9096ad-7bf5-4bb3-9e23-877d75205b9b None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=9e623ea7f63f489ba500d0b565430c01, user.id=d22ba20f962d4757847ba75ce1eef95a) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:47.279441 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9096ad-7bf5-4bb3-9e23-877d75205b9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:47.280909 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9096ad-7bf5-4bb3-9e23-877d75205b9b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:47.294379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 47/93] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:32:47 2022] GET /identity/v3/role_assignments?user.id=d22ba20f962d4757847ba75ce1eef95a&scope.project.id=9e623ea7f63f489ba500d0b565430c01&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:47.294379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9096ad-7bf5-4bb3-9e23-877d75205b9b None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:47.432148 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edd3a0-a75b-4d07-9ac0-4afe3fa53375 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:47.486364 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd23123-bc35-4064-bd00-346551ad5a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:47.487464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd23123-bc35-4064-bd00-346551ad5a90 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:47.487906 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd23123-bc35-4064-bd00-346551ad5a90 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:47.488449 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd23123-bc35-4064-bd00-346551ad5a90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:47.489938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd23123-bc35-4064-bd00-346551ad5a90 None admin] RBAC: Adding query filter params (role.id=0449b3526e454e9ea05258c90de6de31, scope.project.id=9e623ea7f63f489ba500d0b565430c01, user.id=75a051b2e49849fb9c162fa672f54248) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:47.490476 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd23123-bc35-4064-bd00-346551ad5a90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:47.492557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd23123-bc35-4064-bd00-346551ad5a90 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:47.502762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 47/94] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:32:47 2022] GET /identity/v3/role_assignments?user.id=75a051b2e49849fb9c162fa672f54248&scope.project.id=9e623ea7f63f489ba500d0b565430c01&role.id=0449b3526e454e9ea05258c90de6de31 => generated 260 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:47.504227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd23123-bc35-4064-bd00-346551ad5a90 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:47.549382 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9096ad-7bf5-4bb3-9e23-877d75205b9b None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:47.586285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:47.640368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd23123-bc35-4064-bd00-346551ad5a90 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:47.647213 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f9838-049d-4415-b982-a5507bce72ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:47.648111 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f9838-049d-4415-b982-a5507bce72ca None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:47.648404 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f9838-049d-4415-b982-a5507bce72ca None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:47.648687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f9838-049d-4415-b982-a5507bce72ca None admin] PATH_INFO: `/v3/projects/ca4559609c24403386c7cd82267e4be3` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:47.650027 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f9838-049d-4415-b982-a5507bce72ca None admin] RBAC: Authorizing `identity:get_project(project_id=ca4559609c24403386c7cd82267e4be3)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:47.651561 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f9838-049d-4415-b982-a5507bce72ca None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:47.653338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 48/95] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:32:47 2022] GET /identity/v3/projects/ca4559609c24403386c7cd82267e4be3 => generated 313 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:47.662303 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f9838-049d-4415-b982-a5507bce72ca None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:47.689603 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5001a0-c13a-4c4d-9036-7797c46afe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:47.690201 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5001a0-c13a-4c4d-9036-7797c46afe65 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:47.690609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5001a0-c13a-4c4d-9036-7797c46afe65 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:47.690943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5001a0-c13a-4c4d-9036-7797c46afe65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:47.691815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5001a0-c13a-4c4d-9036-7797c46afe65 None admin] RBAC: Adding query filter params (role.id=5a16a034a01e45b89530e8dd35d56588, scope.project.id=9e623ea7f63f489ba500d0b565430c01, user.id=75a051b2e49849fb9c162fa672f54248) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:47.692141 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5001a0-c13a-4c4d-9036-7797c46afe65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:47.693789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5001a0-c13a-4c4d-9036-7797c46afe65 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:47.701006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 48/96] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:32:47 2022] GET /identity/v3/role_assignments?user.id=75a051b2e49849fb9c162fa672f54248&scope.project.id=9e623ea7f63f489ba500d0b565430c01&role.id=5a16a034a01e45b89530e8dd35d56588 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:47.798029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:47.866546 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f9838-049d-4415-b982-a5507bce72ca None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:47.914218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddb330-06a8-4742-ade6-486308d1bd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:47.914934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddb330-06a8-4742-ade6-486308d1bd04 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:47.915225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddb330-06a8-4742-ade6-486308d1bd04 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:47.915511 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddb330-06a8-4742-ade6-486308d1bd04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:47.916371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddb330-06a8-4742-ade6-486308d1bd04 None admin] RBAC: Adding query filter params (role.id=5a16a034a01e45b89530e8dd35d56588, scope.project.id=ca4559609c24403386c7cd82267e4be3, user.id=75a051b2e49849fb9c162fa672f54248) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:47.916691 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddb330-06a8-4742-ade6-486308d1bd04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:47.918296 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddb330-06a8-4742-ade6-486308d1bd04 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:47.934218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 49/97] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:32:47 2022] GET /identity/v3/role_assignments?user.id=75a051b2e49849fb9c162fa672f54248&scope.project.id=ca4559609c24403386c7cd82267e4be3&role.id=5a16a034a01e45b89530e8dd35d56588 => generated 260 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:32:49.677368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0301f64-f42c-45fd-9491-c98eeec580f3 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:49.678399 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0301f64-f42c-45fd-9491-c98eeec580f3 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:49.678885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0301f64-f42c-45fd-9491-c98eeec580f3 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:49.680482 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 49/98] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:49.686078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333f70b-23e4-4a30-a5eb-873e2f92b5a5 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:49.686968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333f70b-23e4-4a30-a5eb-873e2f92b5a5 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:49.687451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333f70b-23e4-4a30-a5eb-873e2f92b5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:49.715806 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-b333f70b-23e4-4a30-a5eb-873e2f92b5a5 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:49.717444 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b333f70b-23e4-4a30-a5eb-873e2f92b5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:49.815477 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44649574-f9ac-4605-a93e-6a3f5f610c1b None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:49.816108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44649574-f9ac-4605-a93e-6a3f5f610c1b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:49.816584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44649574-f9ac-4605-a93e-6a3f5f610c1b None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:49.818168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 50/99] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:49.827812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c7a34-b0ad-4a33-bed3-dcd38a4a6256 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:49.828484 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c7a34-b0ad-4a33-bed3-dcd38a4a6256 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:49.828962 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c7a34-b0ad-4a33-bed3-dcd38a4a6256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:49.832905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 50/100] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:49.859392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-e86c7a34-b0ad-4a33-bed3-dcd38a4a6256 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:49.861778 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-e86c7a34-b0ad-4a33-bed3-dcd38a4a6256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:49.875384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333f70b-23e4-4a30-a5eb-873e2f92b5a5 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:49.959845 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 51/101] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:49.968572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:49.996614 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c7a34-b0ad-4a33-bed3-dcd38a4a6256 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:50.088882 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:50.096372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333f70b-23e4-4a30-a5eb-873e2f92b5a5 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:50.151618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58547c-5564-4ae0-9f7e-33344cdc7095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:50.154196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58547c-5564-4ae0-9f7e-33344cdc7095 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:50.154769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58547c-5564-4ae0-9f7e-33344cdc7095 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:50.155266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58547c-5564-4ae0-9f7e-33344cdc7095 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:50.168242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58547c-5564-4ae0-9f7e-33344cdc7095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-3b58547c-5564-4ae0-9f7e-33344cdc7095 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:50.177439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:50.178365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:50.179136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:50.179136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:50.179136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:50.179136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:50.179136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:50.179136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:50.179136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:50.179136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:50.179136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:50.179136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:50.179136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:32:50.179136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:32:50.182055 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 51/102] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:32:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:32:50.188808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58547c-5564-4ae0-9f7e-33344cdc7095 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:50.243858 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c7a34-b0ad-4a33-bed3-dcd38a4a6256 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:50.348615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04612954-3ba2-4f9e-9cda-777397057dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:50.349441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04612954-3ba2-4f9e-9cda-777397057dec None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:50.349733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04612954-3ba2-4f9e-9cda-777397057dec None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:50.350016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04612954-3ba2-4f9e-9cda-777397057dec None admin] PATH_INFO: `/v3/domains/default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:50.352829 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04612954-3ba2-4f9e-9cda-777397057dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:50.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04612954-3ba2-4f9e-9cda-777397057dec None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:50.363837 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 52/103] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:32:49 2022] GET /identity/v3/domains/default => generated 200 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:32:50.371887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04612954-3ba2-4f9e-9cda-777397057dec None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:50.480583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58547c-5564-4ae0-9f7e-33344cdc7095 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:50.498976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:50.543122 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04612954-3ba2-4f9e-9cda-777397057dec None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:50.568340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c84ce2-1f6b-4347-823e-a171343170de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:50.569397 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c84ce2-1f6b-4347-823e-a171343170de None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:50.569883 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c84ce2-1f6b-4347-823e-a171343170de None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:50.570405 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c84ce2-1f6b-4347-823e-a171343170de None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:50.572063 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c84ce2-1f6b-4347-823e-a171343170de None admin] RBAC: Adding query filter params (name=reader) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:50.572659 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c84ce2-1f6b-4347-823e-a171343170de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:50.574502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c84ce2-1f6b-4347-823e-a171343170de None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:50.577720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:50.585655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 52/104] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:32:50 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:50.587723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfab83-214b-44ee-b30f-8f15f37ecc23 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:50.588238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfab83-214b-44ee-b30f-8f15f37ecc23 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:50.588730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfab83-214b-44ee-b30f-8f15f37ecc23 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:50.595819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 53/105] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:50.597424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfab83-214b-44ee-b30f-8f15f37ecc23 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:50.633325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168bdb1-8ff0-41eb-959a-37b043841e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:50.635507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168bdb1-8ff0-41eb-959a-37b043841e0e None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:50.636692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168bdb1-8ff0-41eb-959a-37b043841e0e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:50.637815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168bdb1-8ff0-41eb-959a-37b043841e0e None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:50.638815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168bdb1-8ff0-41eb-959a-37b043841e0e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:50.640638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168bdb1-8ff0-41eb-959a-37b043841e0e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:50.736019 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfab83-214b-44ee-b30f-8f15f37ecc23 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:50.786415 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c36fe-b523-4879-81f9-0263d981b4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:50.787795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c36fe-b523-4879-81f9-0263d981b4cd None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:50.788265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c36fe-b523-4879-81f9-0263d981b4cd None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:50.788725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c36fe-b523-4879-81f9-0263d981b4cd None admin] PATH_INFO: `/v3/users/976466141bb54d22992ddff3c4e110a6` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:50.789807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 53/106] 10.222.0.112 () {60 vars in 1146 bytes} [Thu May 26 16:32:50 2022] POST /identity/v3/projects => generated 303 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:32:50.792768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a79894-f0ea-4b38-a4d5-edaf2670e94e None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:50.793246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a79894-f0ea-4b38-a4d5-edaf2670e94e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:50.793708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a79894-f0ea-4b38-a4d5-edaf2670e94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:50.833376 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c36fe-b523-4879-81f9-0263d981b4cd None admin] RBAC: Authorizing `identity:get_user(user_id=976466141bb54d22992ddff3c4e110a6)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:50.834894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c36fe-b523-4879-81f9-0263d981b4cd None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:50.837134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 54/107] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:50 2022] GET /identity/v3/users/976466141bb54d22992ddff3c4e110a6 => generated 290 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:50.843865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-28a79894-f0ea-4b38-a4d5-edaf2670e94e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:50.846435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-28a79894-f0ea-4b38-a4d5-edaf2670e94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:50.852221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c36fe-b523-4879-81f9-0263d981b4cd None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:50.899953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:50.972599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 54/108] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:51.010517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a79894-f0ea-4b38-a4d5-edaf2670e94e None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:51.128565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c36fe-b523-4879-81f9-0263d981b4cd None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:51.222936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6b847-247a-4c01-bbbe-a09342ab8cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:51.223600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6b847-247a-4c01-bbbe-a09342ab8cd2 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:51.224049 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6b847-247a-4c01-bbbe-a09342ab8cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:51.224493 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6b847-247a-4c01-bbbe-a09342ab8cd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:51.256921 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:51.269219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a79894-f0ea-4b38-a4d5-edaf2670e94e None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:51.309168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3fa81-7740-475f-ba4e-337e534d97b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:51.310221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3fa81-7740-475f-ba4e-337e534d97b1 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:51.311015 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3fa81-7740-475f-ba4e-337e534d97b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:51.311738 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3fa81-7740-475f-ba4e-337e534d97b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:51.322721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6b847-247a-4c01-bbbe-a09342ab8cd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:51.325239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6b847-247a-4c01-bbbe-a09342ab8cd2 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:51.327774 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3fa81-7740-475f-ba4e-337e534d97b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-1bf3fa81-7740-475f-ba4e-337e534d97b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:51.339032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:51.344129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:51.345677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:51.345677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:51.345677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:51.345677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:51.345677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:51.345677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:51.345677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:51.345677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:51.345677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:51.345677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:51.345677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:51.345677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:32:51.345677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 55/109] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:32:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:51.345677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b44c0-84cc-4c49-8608-2275640ff4d7 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:51.346786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b44c0-84cc-4c49-8608-2275640ff4d7 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:51.346786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b44c0-84cc-4c49-8608-2275640ff4d7 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:51.347434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 56/110] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:51 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:51.352436 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b44c0-84cc-4c49-8608-2275640ff4d7 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:51.369174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:51.468589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 55/111] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:32:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:32:51.470350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e216c61-0985-4b51-aaca-65424bc84e5e None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:51.470660 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e216c61-0985-4b51-aaca-65424bc84e5e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:51.471212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e216c61-0985-4b51-aaca-65424bc84e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:51.504623 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-6e216c61-0985-4b51-aaca-65424bc84e5e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:51.506144 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6e216c61-0985-4b51-aaca-65424bc84e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:51.512810 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b44c0-84cc-4c49-8608-2275640ff4d7 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:51.586835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9279a4b-4e2a-4d10-8f6b-f5fbaf4cc520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:51.587806 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9279a4b-4e2a-4d10-8f6b-f5fbaf4cc520 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:51.588244 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9279a4b-4e2a-4d10-8f6b-f5fbaf4cc520 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:51.588685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9279a4b-4e2a-4d10-8f6b-f5fbaf4cc520 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:51.589604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9279a4b-4e2a-4d10-8f6b-f5fbaf4cc520 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:51.590068 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9279a4b-4e2a-4d10-8f6b-f5fbaf4cc520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:51.591854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9279a4b-4e2a-4d10-8f6b-f5fbaf4cc520 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:51.602038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 57/112] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:32:51 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:51.603415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9279a4b-4e2a-4d10-8f6b-f5fbaf4cc520 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:51.622152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 56/113] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:51.627114 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42fd90-3645-4f6d-a8cc-8dc7991b3580 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:51.627678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42fd90-3645-4f6d-a8cc-8dc7991b3580 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:51.628271 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42fd90-3645-4f6d-a8cc-8dc7991b3580 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:51.629902 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 57/114] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:51 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:51.637865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42fd90-3645-4f6d-a8cc-8dc7991b3580 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:51.638275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:51.718921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:51.752355 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9279a4b-4e2a-4d10-8f6b-f5fbaf4cc520 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:51.766866 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42fd90-3645-4f6d-a8cc-8dc7991b3580 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:51.791416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670aa60-2182-4dd9-919b-c1f4484678c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:51.792300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670aa60-2182-4dd9-919b-c1f4484678c4 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:51.792606 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670aa60-2182-4dd9-919b-c1f4484678c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:51.792881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670aa60-2182-4dd9-919b-c1f4484678c4 None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:51.794269 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670aa60-2182-4dd9-919b-c1f4484678c4 None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:51.795773 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670aa60-2182-4dd9-919b-c1f4484678c4 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:51.797932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 58/115] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:32:51 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:51.799233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773437fc-49cd-421e-a592-ee3a9e55fddc None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:51.799530 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773437fc-49cd-421e-a592-ee3a9e55fddc None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:51.799903 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773437fc-49cd-421e-a592-ee3a9e55fddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:51.815351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c47c6-2787-4ca1-9aac-c521c483fb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:51.815556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c47c6-2787-4ca1-9aac-c521c483fb3a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:51.815851 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c47c6-2787-4ca1-9aac-c521c483fb3a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:51.816142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c47c6-2787-4ca1-9aac-c521c483fb3a None admin] PATH_INFO: `/v3/users/d22ba20f962d4757847ba75ce1eef95a` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:51.817394 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c47c6-2787-4ca1-9aac-c521c483fb3a None admin] RBAC: Authorizing `identity:get_user(user_id=d22ba20f962d4757847ba75ce1eef95a)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:51.818934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c47c6-2787-4ca1-9aac-c521c483fb3a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:51.821125 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 58/116] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:51 2022] GET /identity/v3/users/d22ba20f962d4757847ba75ce1eef95a => generated 248 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:51.821663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c47c6-2787-4ca1-9aac-c521c483fb3a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:51.825065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-773437fc-49cd-421e-a592-ee3a9e55fddc None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:51.826876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-773437fc-49cd-421e-a592-ee3a9e55fddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:51.915162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 59/117] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:51.915162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb99570-6015-4ce7-a47d-676f91ebdb71 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:51.915162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb99570-6015-4ce7-a47d-676f91ebdb71 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:51.915162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb99570-6015-4ce7-a47d-676f91ebdb71 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:51.915162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 60/118] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:51.915162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb99570-6015-4ce7-a47d-676f91ebdb71 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:51.939468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c47c6-2787-4ca1-9aac-c521c483fb3a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:51.943793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:51.966403 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:51.978923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027f90f-f104-41cd-af03-b5fba0f1400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:51.980050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027f90f-f104-41cd-af03-b5fba0f1400c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:51.980329 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027f90f-f104-41cd-af03-b5fba0f1400c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:51.980604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027f90f-f104-41cd-af03-b5fba0f1400c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:51.991688 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027f90f-f104-41cd-af03-b5fba0f1400c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-5027f90f-f104-41cd-af03-b5fba0f1400c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:51.999972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:52.001648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:52.003309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:52.003309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:52.003309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:52.003309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:52.003309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:52.003309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:52.003309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:52.003309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:52.003309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:52.003309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:52.003309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:32:52.003309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:32:52.003309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 59/119] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:32:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:52.003309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027f90f-f104-41cd-af03-b5fba0f1400c None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:52.091660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb99570-6015-4ce7-a47d-676f91ebdb71 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:52.141982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a93277-ec59-48f8-9d04-36ea0953e7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:52.142692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a93277-ec59-48f8-9d04-36ea0953e7df None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:52.142984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a93277-ec59-48f8-9d04-36ea0953e7df None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:52.143266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a93277-ec59-48f8-9d04-36ea0953e7df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:52.144259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a93277-ec59-48f8-9d04-36ea0953e7df None admin] RBAC: Adding query filter params (role.id=88d17c94ac464961ba0635bbb0d74025, scope.project.id=9e623ea7f63f489ba500d0b565430c01, user.id=976466141bb54d22992ddff3c4e110a6) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:52.144626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a93277-ec59-48f8-9d04-36ea0953e7df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:52.146125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a93277-ec59-48f8-9d04-36ea0953e7df None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:52.149014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027f90f-f104-41cd-af03-b5fba0f1400c None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:52.153036 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 61/120] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:32:51 2022] GET /identity/v3/role_assignments?user.id=976466141bb54d22992ddff3c4e110a6&scope.project.id=9e623ea7f63f489ba500d0b565430c01&role.id=88d17c94ac464961ba0635bbb0d74025 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:52.154351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a02ed-20e4-4e97-a1e1-0ac3964fdfbb None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:52.154659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a02ed-20e4-4e97-a1e1-0ac3964fdfbb None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:52.154948 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a02ed-20e4-4e97-a1e1-0ac3964fdfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:52.176953 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-7c1a02ed-20e4-4e97-a1e1-0ac3964fdfbb None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:52.178385 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7c1a02ed-20e4-4e97-a1e1-0ac3964fdfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:52.208875 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27ed64-f35f-479f-b33b-45058a3bf3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:52.212122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27ed64-f35f-479f-b33b-45058a3bf3ce None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:52.212122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27ed64-f35f-479f-b33b-45058a3bf3ce None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:52.212122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27ed64-f35f-479f-b33b-45058a3bf3ce None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:52.212122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27ed64-f35f-479f-b33b-45058a3bf3ce None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:52.213332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27ed64-f35f-479f-b33b-45058a3bf3ce None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:52.215639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 60/121] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:32:52 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:52.221177 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27ed64-f35f-479f-b33b-45058a3bf3ce None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:52.287276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:52.295779 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 62/122] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:52.298717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a02ed-20e4-4e97-a1e1-0ac3964fdfbb None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:52.316121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:52.349504 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27ed64-f35f-479f-b33b-45058a3bf3ce None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:52.388387 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658eb1a-1dee-415f-a635-4ecf85a65e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:52.389221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658eb1a-1dee-415f-a635-4ecf85a65e1c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:52.389485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658eb1a-1dee-415f-a635-4ecf85a65e1c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:52.389770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658eb1a-1dee-415f-a635-4ecf85a65e1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:52.403118 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658eb1a-1dee-415f-a635-4ecf85a65e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-0658eb1a-1dee-415f-a635-4ecf85a65e1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:52.410887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:52.411815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:52.412664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:52.412664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:52.412664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:52.412664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:52.412664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:52.412664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:52.412664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:52.412664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:52.412664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:52.412664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:52.412664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:32:52.412664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:32:52.412664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 61/123] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:32:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:52.413297 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658eb1a-1dee-415f-a635-4ecf85a65e1c None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:52.435394 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a02ed-20e4-4e97-a1e1-0ac3964fdfbb None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:52.475665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d369b1-3bed-4d91-b0e3-618bd0513904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:52.476687 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d369b1-3bed-4d91-b0e3-618bd0513904 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:52.476980 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d369b1-3bed-4d91-b0e3-618bd0513904 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:52.477268 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d369b1-3bed-4d91-b0e3-618bd0513904 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:52.478048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d369b1-3bed-4d91-b0e3-618bd0513904 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:52.478394 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d369b1-3bed-4d91-b0e3-618bd0513904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:52.480413 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d369b1-3bed-4d91-b0e3-618bd0513904 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:52.493181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 63/124] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:32:52 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:52.494439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d369b1-3bed-4d91-b0e3-618bd0513904 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:52.535140 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658eb1a-1dee-415f-a635-4ecf85a65e1c None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:52.547820 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:52.575057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567db9a-a28a-4087-ae27-facf7f42c3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:52.576111 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567db9a-a28a-4087-ae27-facf7f42c3cb None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:52.576474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567db9a-a28a-4087-ae27-facf7f42c3cb None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:52.576829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567db9a-a28a-4087-ae27-facf7f42c3cb None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01/users/d22ba20f962d4757847ba75ce1eef95a/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:52.579242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567db9a-a28a-4087-ae27-facf7f42c3cb None admin] RBAC: Authorizing `identity:create_grant(project_id=9e623ea7f63f489ba500d0b565430c01, user_id=d22ba20f962d4757847ba75ce1eef95a, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:52.581848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567db9a-a28a-4087-ae27-facf7f42c3cb None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:52.588578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:52.620918 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d369b1-3bed-4d91-b0e3-618bd0513904 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:52.656074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af262c-7c57-48dc-8244-a5122e4a52c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:52.657534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af262c-7c57-48dc-8244-a5122e4a52c8 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:52.657851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af262c-7c57-48dc-8244-a5122e4a52c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:52.658131 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af262c-7c57-48dc-8244-a5122e4a52c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:52.668841 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af262c-7c57-48dc-8244-a5122e4a52c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-c8af262c-7c57-48dc-8244-a5122e4a52c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:52.676868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:52.678238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:52.680427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:52.680427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:52.680427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:52.680427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:52.680427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:52.680427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:52.680427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:52.680427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:52.680427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:52.680427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:52.680427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:32:52.680427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:32:52.682238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 64/125] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:32:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:52.683971 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af262c-7c57-48dc-8244-a5122e4a52c8 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:52.789045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 62/126] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:32:52 2022] PUT /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01/users/d22ba20f962d4757847ba75ce1eef95a/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:32:52.790775 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567db9a-a28a-4087-ae27-facf7f42c3cb None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:52.826832 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af262c-7c57-48dc-8244-a5122e4a52c8 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:52.910639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:52.920918 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a71fbe-0a4b-496d-985f-4e2e0c06e905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:52.922040 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a71fbe-0a4b-496d-985f-4e2e0c06e905 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:52.922523 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a71fbe-0a4b-496d-985f-4e2e0c06e905 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:52.922966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a71fbe-0a4b-496d-985f-4e2e0c06e905 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:52.924160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a71fbe-0a4b-496d-985f-4e2e0c06e905 None admin] RBAC: Adding query filter params (name=member) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:52.925605 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a71fbe-0a4b-496d-985f-4e2e0c06e905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:52.927276 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a71fbe-0a4b-496d-985f-4e2e0c06e905 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:52.938094 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 65/127] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:32:52 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:52.939465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a71fbe-0a4b-496d-985f-4e2e0c06e905 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:53.031959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567db9a-a28a-4087-ae27-facf7f42c3cb None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:53.088921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea376d1-e102-4e17-be68-daf358b9f927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:53.090105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea376d1-e102-4e17-be68-daf358b9f927 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:53.090602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea376d1-e102-4e17-be68-daf358b9f927 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:53.091171 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea376d1-e102-4e17-be68-daf358b9f927 None admin] PATH_INFO: `/v3/users/75a051b2e49849fb9c162fa672f54248` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:53.093334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea376d1-e102-4e17-be68-daf358b9f927 None admin] RBAC: Authorizing `identity:get_user(user_id=75a051b2e49849fb9c162fa672f54248)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:53.096651 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea376d1-e102-4e17-be68-daf358b9f927 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:53.099803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 63/128] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:52 2022] GET /identity/v3/users/75a051b2e49849fb9c162fa672f54248 => generated 276 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:53.101557 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea376d1-e102-4e17-be68-daf358b9f927 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:53.152567 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:53.169785 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a71fbe-0a4b-496d-985f-4e2e0c06e905 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:53.213683 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924bba-6395-4f06-b1ed-f74a14e04597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:53.214396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924bba-6395-4f06-b1ed-f74a14e04597 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:53.214689 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924bba-6395-4f06-b1ed-f74a14e04597 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:53.215942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924bba-6395-4f06-b1ed-f74a14e04597 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:53.216377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d924bba-6395-4f06-b1ed-f74a14e04597 None admin] RBAC: Adding query filter params (name=member) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:53.216730 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d924bba-6395-4f06-b1ed-f74a14e04597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:53.219363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d924bba-6395-4f06-b1ed-f74a14e04597 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:53.234932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 66/129] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:32:52 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:53.234932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924bba-6395-4f06-b1ed-f74a14e04597 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:53.245065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea376d1-e102-4e17-be68-daf358b9f927 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:53.285335 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aeeee-97b8-45dc-959f-ba878f543fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:53.286673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aeeee-97b8-45dc-959f-ba878f543fbe None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:53.287168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aeeee-97b8-45dc-959f-ba878f543fbe None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:53.287754 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aeeee-97b8-45dc-959f-ba878f543fbe None admin] PATH_INFO: `/v3/users/75a051b2e49849fb9c162fa672f54248` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:53.289196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aeeee-97b8-45dc-959f-ba878f543fbe None admin] RBAC: Authorizing `identity:get_user(user_id=75a051b2e49849fb9c162fa672f54248)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:53.290904 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aeeee-97b8-45dc-959f-ba878f543fbe None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:53.292817 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 64/130] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:53 2022] GET /identity/v3/users/75a051b2e49849fb9c162fa672f54248 => generated 276 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:53.294001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aeeee-97b8-45dc-959f-ba878f543fbe None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:53.306408 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:53.373338 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924bba-6395-4f06-b1ed-f74a14e04597 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:53.411180 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e14d0-e968-400b-9848-def941796b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:53.412065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e14d0-e968-400b-9848-def941796b1e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:53.412353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e14d0-e968-400b-9848-def941796b1e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:53.412633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e14d0-e968-400b-9848-def941796b1e None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:53.413989 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e14d0-e968-400b-9848-def941796b1e None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:53.415496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e14d0-e968-400b-9848-def941796b1e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:53.417250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 67/131] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:32:53 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:53.418386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e14d0-e968-400b-9848-def941796b1e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:53.428420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aeeee-97b8-45dc-959f-ba878f543fbe None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:53.436740 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:53.467932 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9500ae8-0301-4720-a76e-3939196c91af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:53.469889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9500ae8-0301-4720-a76e-3939196c91af None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:53.470448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9500ae8-0301-4720-a76e-3939196c91af None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:53.470984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9500ae8-0301-4720-a76e-3939196c91af None admin] PATH_INFO: `/v3/users/75a051b2e49849fb9c162fa672f54248` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:53.472600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9500ae8-0301-4720-a76e-3939196c91af None admin] RBAC: Authorizing `identity:get_user(user_id=75a051b2e49849fb9c162fa672f54248)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:53.474456 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9500ae8-0301-4720-a76e-3939196c91af None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:53.477160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 65/132] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:53 2022] GET /identity/v3/users/75a051b2e49849fb9c162fa672f54248 => generated 276 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:53.483009 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9500ae8-0301-4720-a76e-3939196c91af None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:53.598834 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e14d0-e968-400b-9848-def941796b1e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:53.613848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9500ae8-0301-4720-a76e-3939196c91af None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:53.661597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fd198-2039-4ee4-b223-a3135204570f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:53.662474 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:53.665094 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fd198-2039-4ee4-b223-a3135204570f None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:53.665858 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fd198-2039-4ee4-b223-a3135204570f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:53.666641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fd198-2039-4ee4-b223-a3135204570f None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01/users/75a051b2e49849fb9c162fa672f54248/roles/0449b3526e454e9ea05258c90de6de31` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:53.670758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fd198-2039-4ee4-b223-a3135204570f None admin] RBAC: Authorizing `identity:create_grant(project_id=9e623ea7f63f489ba500d0b565430c01, user_id=75a051b2e49849fb9c162fa672f54248, role_id=0449b3526e454e9ea05258c90de6de31)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:53.673657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fd198-2039-4ee4-b223-a3135204570f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:53.689641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1c574-272d-480f-a76e-caedb0df2d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:53.689641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1c574-272d-480f-a76e-caedb0df2d60 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:53.689641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1c574-272d-480f-a76e-caedb0df2d60 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:53.689641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1c574-272d-480f-a76e-caedb0df2d60 None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:53.690222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1c574-272d-480f-a76e-caedb0df2d60 None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:53.691865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1c574-272d-480f-a76e-caedb0df2d60 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:53.695329 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 68/133] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:32:53 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:53.697005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1c574-272d-480f-a76e-caedb0df2d60 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:53.850606 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1c574-272d-480f-a76e-caedb0df2d60 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:53.877207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 66/134] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:32:53 2022] PUT /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01/users/75a051b2e49849fb9c162fa672f54248/roles/0449b3526e454e9ea05258c90de6de31 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:32:53.878829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fd198-2039-4ee4-b223-a3135204570f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:53.888337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610491ee-3ce6-4bf6-85a4-849ec53f8b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:53.889230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610491ee-3ce6-4bf6-85a4-849ec53f8b62 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:53.889517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610491ee-3ce6-4bf6-85a4-849ec53f8b62 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:53.889851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610491ee-3ce6-4bf6-85a4-849ec53f8b62 None admin] PATH_INFO: `/v3/projects/ca4559609c24403386c7cd82267e4be3` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:53.891783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610491ee-3ce6-4bf6-85a4-849ec53f8b62 None admin] RBAC: Authorizing `identity:get_project(project_id=ca4559609c24403386c7cd82267e4be3)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:53.893283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610491ee-3ce6-4bf6-85a4-849ec53f8b62 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:53.895163 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 69/135] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:32:53 2022] GET /identity/v3/projects/ca4559609c24403386c7cd82267e4be3 => generated 313 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:53.902478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610491ee-3ce6-4bf6-85a4-849ec53f8b62 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:53.957965 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:53.986692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:54.034984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610491ee-3ce6-4bf6-85a4-849ec53f8b62 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:54.075042 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308a842-573a-4339-9459-2b1051df0e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:54.077118 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308a842-573a-4339-9459-2b1051df0e17 None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:54.079349 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308a842-573a-4339-9459-2b1051df0e17 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:54.080095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308a842-573a-4339-9459-2b1051df0e17 None admin] PATH_INFO: `/v3/projects/ca4559609c24403386c7cd82267e4be3/users/75a051b2e49849fb9c162fa672f54248/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:54.085024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308a842-573a-4339-9459-2b1051df0e17 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca4559609c24403386c7cd82267e4be3, user_id=75a051b2e49849fb9c162fa672f54248, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:54.095021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308a842-573a-4339-9459-2b1051df0e17 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:54.111382 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fd198-2039-4ee4-b223-a3135204570f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:54.167254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363a9d6-45a9-487b-ae57-a321ba5ea6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:54.169572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363a9d6-45a9-487b-ae57-a321ba5ea6d3 None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:54.170394 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363a9d6-45a9-487b-ae57-a321ba5ea6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:54.170857 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363a9d6-45a9-487b-ae57-a321ba5ea6d3 None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01/users/75a051b2e49849fb9c162fa672f54248/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:54.174828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363a9d6-45a9-487b-ae57-a321ba5ea6d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e623ea7f63f489ba500d0b565430c01, user_id=75a051b2e49849fb9c162fa672f54248, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:54.177397 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363a9d6-45a9-487b-ae57-a321ba5ea6d3 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:54.325834 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 70/136] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:32:53 2022] PUT /identity/v3/projects/ca4559609c24403386c7cd82267e4be3/users/75a051b2e49849fb9c162fa672f54248/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:32:54.327447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4491c04-a165-42f2-a6d3-2354038b668d None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:54.327748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4491c04-a165-42f2-a6d3-2354038b668d None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:54.328650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4491c04-a165-42f2-a6d3-2354038b668d None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:54.333946 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 71/137] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:54 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:54.339901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebb001-04ce-4fae-aaca-335e7aeffa97 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:54.342762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebb001-04ce-4fae-aaca-335e7aeffa97 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:54.342762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebb001-04ce-4fae-aaca-335e7aeffa97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:54.366282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-26ebb001-04ce-4fae-aaca-335e7aeffa97 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:54.367541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-26ebb001-04ce-4fae-aaca-335e7aeffa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:54.420383 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 67/138] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:32:53 2022] PUT /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01/users/75a051b2e49849fb9c162fa672f54248/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:32:54.493568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 72/139] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:32:54.545833 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363a9d6-45a9-487b-ae57-a321ba5ea6d3 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:54.684377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:54.693024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363a9d6-45a9-487b-ae57-a321ba5ea6d3 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:54.738940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c760d80-fe99-4e7c-a98e-c1a0319d31f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:54.739946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c760d80-fe99-4e7c-a98e-c1a0319d31f4 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:54.740241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c760d80-fe99-4e7c-a98e-c1a0319d31f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:54.740522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c760d80-fe99-4e7c-a98e-c1a0319d31f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:54.741833 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c760d80-fe99-4e7c-a98e-c1a0319d31f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:54.743338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c760d80-fe99-4e7c-a98e-c1a0319d31f4 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:54.745027 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 68/140] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:32:54 2022] GET /identity/v3/domains/default => generated 200 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:54.751936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebb001-04ce-4fae-aaca-335e7aeffa97 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:54.819603 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:54.898534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebb001-04ce-4fae-aaca-335e7aeffa97 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:54.950884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ff959-ce35-41a2-86a7-ea615a72a1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:54.951780 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ff959-ce35-41a2-86a7-ea615a72a1ac None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:54.952271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ff959-ce35-41a2-86a7-ea615a72a1ac None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:54.952573 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ff959-ce35-41a2-86a7-ea615a72a1ac None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:54.954503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ff959-ce35-41a2-86a7-ea615a72a1ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:54.957155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ff959-ce35-41a2-86a7-ea615a72a1ac None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:55.006247 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecca24-9c4e-4e7c-9f7e-5dbbe34ab244 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:55.006808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecca24-9c4e-4e7c-9f7e-5dbbe34ab244 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:55.006884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecca24-9c4e-4e7c-9f7e-5dbbe34ab244 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:55.008404 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 69/141] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:32:55.014121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf44b8-a837-4ac8-a471-3f0eb7272664 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:55.014442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf44b8-a837-4ac8-a471-3f0eb7272664 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:55.014953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf44b8-a837-4ac8-a471-3f0eb7272664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:55.046235 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-73bf44b8-a837-4ac8-a471-3f0eb7272664 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:55.048590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-73bf44b8-a837-4ac8-a471-3f0eb7272664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:55.169455 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 73/142] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:32:54 2022] POST /identity/v3/users => generated 284 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:32:55.200629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 70/143] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 26 16:32:55.252190 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ff959-ce35-41a2-86a7-ea615a72a1ac None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:55.375663 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ff959-ce35-41a2-86a7-ea615a72a1ac None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:55.391450 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:55.425842 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707773d-cab4-4121-92a9-7731e82a2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:55.426708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707773d-cab4-4121-92a9-7731e82a2da6 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:55.426992 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707773d-cab4-4121-92a9-7731e82a2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:55.427269 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707773d-cab4-4121-92a9-7731e82a2da6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:55.444600 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707773d-cab4-4121-92a9-7731e82a2da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-a707773d-cab4-4121-92a9-7731e82a2da6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:55.453506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:55.454641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:55.456065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:55.456065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:55.456065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:55.456065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:55.456065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:55.456065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:55.456065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:55.456065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:55.456065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:55.456065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:55.456065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:32:55.456065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:32:55.456065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 74/144] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:32:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:32:55.462482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf44b8-a837-4ac8-a471-3f0eb7272664 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:55.639905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:55.653481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf44b8-a837-4ac8-a471-3f0eb7272664 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:55.696590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667853e-91b3-45c0-a6d3-3849ae646d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:55.697283 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667853e-91b3-45c0-a6d3-3849ae646d78 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:55.697568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667853e-91b3-45c0-a6d3-3849ae646d78 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:55.697847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667853e-91b3-45c0-a6d3-3849ae646d78 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:55.698641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667853e-91b3-45c0-a6d3-3849ae646d78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:55.698954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667853e-91b3-45c0-a6d3-3849ae646d78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:55.700358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667853e-91b3-45c0-a6d3-3849ae646d78 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:55.717004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 71/145] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:32:55 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:55.724800 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707773d-cab4-4121-92a9-7731e82a2da6 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:55.919464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707773d-cab4-4121-92a9-7731e82a2da6 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:55.978307 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f2600-eb4f-42f0-b67c-2c89ac4ec16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:55.979897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f2600-eb4f-42f0-b67c-2c89ac4ec16f None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:55.980395 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f2600-eb4f-42f0-b67c-2c89ac4ec16f None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:55.981039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f2600-eb4f-42f0-b67c-2c89ac4ec16f None admin] PATH_INFO: `/v3/users/976466141bb54d22992ddff3c4e110a6` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:55.987778 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f2600-eb4f-42f0-b67c-2c89ac4ec16f None admin] RBAC: Authorizing `identity:get_user(user_id=976466141bb54d22992ddff3c4e110a6)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:55.990423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f2600-eb4f-42f0-b67c-2c89ac4ec16f None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:55.993663 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 75/146] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:55 2022] GET /identity/v3/users/976466141bb54d22992ddff3c4e110a6 => generated 290 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:56.001051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667853e-91b3-45c0-a6d3-3849ae646d78 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:56.222366 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667853e-91b3-45c0-a6d3-3849ae646d78 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:56.282874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085937e-214a-4e14-b199-348590381756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:56.284650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085937e-214a-4e14-b199-348590381756 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:56.285170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085937e-214a-4e14-b199-348590381756 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:56.285669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085937e-214a-4e14-b199-348590381756 None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:56.287943 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085937e-214a-4e14-b199-348590381756 None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:56.290705 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085937e-214a-4e14-b199-348590381756 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:56.294297 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 72/147] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:32:55 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:32:56.304113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f2600-eb4f-42f0-b67c-2c89ac4ec16f None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:56.376324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:56.496809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f2600-eb4f-42f0-b67c-2c89ac4ec16f None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:56.559277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049f5f0-24db-41f3-81ce-4a0b3e7a069a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:56.560729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049f5f0-24db-41f3-81ce-4a0b3e7a069a None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:56.561114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049f5f0-24db-41f3-81ce-4a0b3e7a069a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:56.561570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049f5f0-24db-41f3-81ce-4a0b3e7a069a None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01/users/976466141bb54d22992ddff3c4e110a6/roles/88d17c94ac464961ba0635bbb0d74025` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:56.565076 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049f5f0-24db-41f3-81ce-4a0b3e7a069a None admin] RBAC: Authorizing `identity:create_grant(project_id=9e623ea7f63f489ba500d0b565430c01, user_id=976466141bb54d22992ddff3c4e110a6, role_id=88d17c94ac464961ba0635bbb0d74025)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:56.567935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049f5f0-24db-41f3-81ce-4a0b3e7a069a None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:56.671294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 76/148] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:32:56 2022] PUT /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01/users/976466141bb54d22992ddff3c4e110a6/roles/88d17c94ac464961ba0635bbb0d74025 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:32:56.810521 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36517223-0966-4213-8413-ec696580d1e1 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:56.811218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36517223-0966-4213-8413-ec696580d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:56.811715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36517223-0966-4213-8413-ec696580d1e1 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:56.814187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 73/149] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:56 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:56.819890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f7225-c93d-41e1-9f2f-3ae33f01184e None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:56.820787 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f7225-c93d-41e1-9f2f-3ae33f01184e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:56.821261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f7225-c93d-41e1-9f2f-3ae33f01184e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:56.847552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-d87f7225-c93d-41e1-9f2f-3ae33f01184e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:56.849066 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d87f7225-c93d-41e1-9f2f-3ae33f01184e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:56.937009 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 77/150] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:56.975479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36517223-0966-4213-8413-ec696580d1e1 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:57.007225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:57.097792 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36517223-0966-4213-8413-ec696580d1e1 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:57.136780 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc331e0e-dd28-49f0-8be2-a77b2f508894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:57.137638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc331e0e-dd28-49f0-8be2-a77b2f508894 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:57.137923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc331e0e-dd28-49f0-8be2-a77b2f508894 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:57.138196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc331e0e-dd28-49f0-8be2-a77b2f508894 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:57.151579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc331e0e-dd28-49f0-8be2-a77b2f508894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-bc331e0e-dd28-49f0-8be2-a77b2f508894 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:57.160207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:57.161099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:57.162657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:57.162657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:57.162657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:57.162657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:57.162657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:57.162657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:57.162657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:57.162657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:57.162657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:57.162657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:57.162657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:32:57.162657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:32:57.162657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 74/151] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:32:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:32:57.167616 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f7225-c93d-41e1-9f2f-3ae33f01184e None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:57.202028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:57.293479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f7225-c93d-41e1-9f2f-3ae33f01184e None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:57.346213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d62391-3630-4e5b-abc6-b9c1ec7d3e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:57.346930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d62391-3630-4e5b-abc6-b9c1ec7d3e3f None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:57.347209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d62391-3630-4e5b-abc6-b9c1ec7d3e3f None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:57.347490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d62391-3630-4e5b-abc6-b9c1ec7d3e3f None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:57.348311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d62391-3630-4e5b-abc6-b9c1ec7d3e3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:57.348567 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d62391-3630-4e5b-abc6-b9c1ec7d3e3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:57.349930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d62391-3630-4e5b-abc6-b9c1ec7d3e3f None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:57.360148 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 78/152] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:32:57 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:57.365453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc331e0e-dd28-49f0-8be2-a77b2f508894 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:57.470593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:57.491197 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc331e0e-dd28-49f0-8be2-a77b2f508894 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:57.542043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1162a-e575-4376-87d3-6361debc4a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:57.543406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1162a-e575-4376-87d3-6361debc4a98 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:57.543892 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1162a-e575-4376-87d3-6361debc4a98 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:57.544385 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1162a-e575-4376-87d3-6361debc4a98 None admin] PATH_INFO: `/v3/users/d22ba20f962d4757847ba75ce1eef95a` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:57.545817 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1162a-e575-4376-87d3-6361debc4a98 None admin] RBAC: Authorizing `identity:get_user(user_id=d22ba20f962d4757847ba75ce1eef95a)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:57.548656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1162a-e575-4376-87d3-6361debc4a98 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:57.551047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 75/153] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:57 2022] GET /identity/v3/users/d22ba20f962d4757847ba75ce1eef95a => generated 248 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:57.559555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d62391-3630-4e5b-abc6-b9c1ec7d3e3f None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:57.664843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:57.686775 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d62391-3630-4e5b-abc6-b9c1ec7d3e3f None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:57.729509 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822a475-33b1-41b4-9a21-e463ee0e6f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:57.730188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822a475-33b1-41b4-9a21-e463ee0e6f16 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:57.730476 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822a475-33b1-41b4-9a21-e463ee0e6f16 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:57.730755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822a475-33b1-41b4-9a21-e463ee0e6f16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:57.816200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822a475-33b1-41b4-9a21-e463ee0e6f16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:57.817675 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822a475-33b1-41b4-9a21-e463ee0e6f16 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:57.921941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:57.940281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 79/154] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:32:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:32:57.946347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1162a-e575-4376-87d3-6361debc4a98 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:58.164568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1162a-e575-4376-87d3-6361debc4a98 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:58.237858 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907eb19-7249-42dd-835f-0ecc29dbd2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:58.239155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907eb19-7249-42dd-835f-0ecc29dbd2b6 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:58.239545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907eb19-7249-42dd-835f-0ecc29dbd2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:58.239971 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907eb19-7249-42dd-835f-0ecc29dbd2b6 None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:58.247155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907eb19-7249-42dd-835f-0ecc29dbd2b6 None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:58.248677 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907eb19-7249-42dd-835f-0ecc29dbd2b6 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:58.251206 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 76/155] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:32:57 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:58.263493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822a475-33b1-41b4-9a21-e463ee0e6f16 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:58.464010 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822a475-33b1-41b4-9a21-e463ee0e6f16 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:58.513622 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f025014-6dae-4de2-8ab4-dc9d9aaf3fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:58.514292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f025014-6dae-4de2-8ab4-dc9d9aaf3fd5 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:58.514598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f025014-6dae-4de2-8ab4-dc9d9aaf3fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:58.514879 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f025014-6dae-4de2-8ab4-dc9d9aaf3fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:58.516128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f025014-6dae-4de2-8ab4-dc9d9aaf3fd5 None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=9e623ea7f63f489ba500d0b565430c01, user.id=d22ba20f962d4757847ba75ce1eef95a) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:58.516443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f025014-6dae-4de2-8ab4-dc9d9aaf3fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:58.518018 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f025014-6dae-4de2-8ab4-dc9d9aaf3fd5 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:58.525436 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 80/156] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:32:58 2022] GET /identity/v3/role_assignments?user.id=d22ba20f962d4757847ba75ce1eef95a&scope.project.id=9e623ea7f63f489ba500d0b565430c01&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 610 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:58.534009 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db9f17-ec70-425e-ace3-05ed5b1adc92 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:58.534599 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db9f17-ec70-425e-ace3-05ed5b1adc92 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:58.534679 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db9f17-ec70-425e-ace3-05ed5b1adc92 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:58.536123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 77/157] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:58.542256 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf60bb7-95fb-43b4-b10c-595023d44475 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:58.542563 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf60bb7-95fb-43b4-b10c-595023d44475 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:58.542847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf60bb7-95fb-43b4-b10c-595023d44475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:58.571804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-fbf60bb7-95fb-43b4-b10c-595023d44475 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:58.573221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-fbf60bb7-95fb-43b4-b10c-595023d44475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:58.648411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:58.657090 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31351f0e-ad77-4dac-9462-38622f6494fb None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:58.657924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31351f0e-ad77-4dac-9462-38622f6494fb None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:58.658670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31351f0e-ad77-4dac-9462-38622f6494fb None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:58.667071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 78/158] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:58 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:58.676889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52b595-ee73-46db-bba7-5c1d71651eb0 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:58.677524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52b595-ee73-46db-bba7-5c1d71651eb0 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:58.678087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52b595-ee73-46db-bba7-5c1d71651eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:58.685319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 81/159] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:32:58.732403 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-8d52b595-ee73-46db-bba7-5c1d71651eb0 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:58.735593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8d52b595-ee73-46db-bba7-5c1d71651eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:58.739082 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf60bb7-95fb-43b4-b10c-595023d44475 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:58.761851 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:58.909100 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 79/160] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:32:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:32:58.996470 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52b595-ee73-46db-bba7-5c1d71651eb0 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:58.997211 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf60bb7-95fb-43b4-b10c-595023d44475 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:59.071219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72de8ec-ac10-44e3-9ada-56a925241572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:59.072069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72de8ec-ac10-44e3-9ada-56a925241572 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:59.072356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72de8ec-ac10-44e3-9ada-56a925241572 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:59.072634 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72de8ec-ac10-44e3-9ada-56a925241572 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:59.107547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72de8ec-ac10-44e3-9ada-56a925241572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-b72de8ec-ac10-44e3-9ada-56a925241572 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:59.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:59.117615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:59.118439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:59.118439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:59.118439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:59.118439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:59.118439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:59.118439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:59.118439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:59.118439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:59.118439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:59.118439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:59.118439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:32:59.118439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:32:59.126811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 82/161] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:32:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:32:59.128297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72de8ec-ac10-44e3-9ada-56a925241572 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:59.161585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52b595-ee73-46db-bba7-5c1d71651eb0 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:59.234941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:59.235151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f7d8e-ce6a-4ebf-a9c7-1fe3b2966c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:59.236126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f7d8e-ce6a-4ebf-a9c7-1fe3b2966c9c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:59.236488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f7d8e-ce6a-4ebf-a9c7-1fe3b2966c9c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:59.236844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f7d8e-ce6a-4ebf-a9c7-1fe3b2966c9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:59.264714 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f7d8e-ce6a-4ebf-a9c7-1fe3b2966c9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-984f7d8e-ce6a-4ebf-a9c7-1fe3b2966c9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:32:59.273210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:32:59.274174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:32:59.275024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:32:59.275024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:32:59.275024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:32:59.275024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:32:59.275024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:32:59.275024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:32:59.275024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:32:59.275024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:32:59.275024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:32:59.275024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:32:59.275024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:32:59.275024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:32:59.276163 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 80/162] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:32:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:32:59.287469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f7d8e-ce6a-4ebf-a9c7-1fe3b2966c9c None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:59.310491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:59.318304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72de8ec-ac10-44e3-9ada-56a925241572 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:59.387765 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9db63-994a-4a16-b129-be63f4033972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:59.388462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9db63-994a-4a16-b129-be63f4033972 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:59.388752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9db63-994a-4a16-b129-be63f4033972 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:59.389038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9db63-994a-4a16-b129-be63f4033972 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:59.390349 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9db63-994a-4a16-b129-be63f4033972 None admin] RBAC: Adding query filter params (name=member) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:59.390676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9db63-994a-4a16-b129-be63f4033972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:59.392203 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9db63-994a-4a16-b129-be63f4033972 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:59.406566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 83/163] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:32:59 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:59.413006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9db63-994a-4a16-b129-be63f4033972 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:59.456295 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f7d8e-ce6a-4ebf-a9c7-1fe3b2966c9c None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:59.505926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08945649-1993-44d1-a06e-9cc9fa8370e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:59.506729 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08945649-1993-44d1-a06e-9cc9fa8370e5 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:59.507022 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08945649-1993-44d1-a06e-9cc9fa8370e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:59.507301 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08945649-1993-44d1-a06e-9cc9fa8370e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:59.508067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08945649-1993-44d1-a06e-9cc9fa8370e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:32:59.508379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08945649-1993-44d1-a06e-9cc9fa8370e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:59.509767 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08945649-1993-44d1-a06e-9cc9fa8370e5 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:59.524114 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 81/164] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:32:59 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:59.528621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08945649-1993-44d1-a06e-9cc9fa8370e5 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:59.580303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9db63-994a-4a16-b129-be63f4033972 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:59.591165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:59.651229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f8ff2-6ba1-4a1b-a091-803689d5291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:59.652408 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f8ff2-6ba1-4a1b-a091-803689d5291b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:59.652906 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f8ff2-6ba1-4a1b-a091-803689d5291b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:59.653173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:59.653602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f8ff2-6ba1-4a1b-a091-803689d5291b None admin] PATH_INFO: `/v3/users/75a051b2e49849fb9c162fa672f54248` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:59.654883 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f8ff2-6ba1-4a1b-a091-803689d5291b None admin] RBAC: Authorizing `identity:get_user(user_id=75a051b2e49849fb9c162fa672f54248)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:59.657504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f8ff2-6ba1-4a1b-a091-803689d5291b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:59.659685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 84/165] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:59 2022] GET /identity/v3/users/75a051b2e49849fb9c162fa672f54248 => generated 276 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:32:59.665865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f8ff2-6ba1-4a1b-a091-803689d5291b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:59.730866 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08945649-1993-44d1-a06e-9cc9fa8370e5 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:59.822986 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f8ff2-6ba1-4a1b-a091-803689d5291b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:59.824389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2db83e-5f3c-411f-b703-268cf98d975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:59.826241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2db83e-5f3c-411f-b703-268cf98d975c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:59.827027 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2db83e-5f3c-411f-b703-268cf98d975c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:59.828312 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2db83e-5f3c-411f-b703-268cf98d975c None admin] PATH_INFO: `/v3/users/75a051b2e49849fb9c162fa672f54248` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:59.835868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2db83e-5f3c-411f-b703-268cf98d975c None admin] RBAC: Authorizing `identity:get_user(user_id=75a051b2e49849fb9c162fa672f54248)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:59.839027 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2db83e-5f3c-411f-b703-268cf98d975c None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:59.842398 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 82/166] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:32:59 2022] GET /identity/v3/users/75a051b2e49849fb9c162fa672f54248 => generated 276 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:32:59.845377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c713ef7-a7ec-469f-b5ff-e9ee353acb6a None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:59.846158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c713ef7-a7ec-469f-b5ff-e9ee353acb6a None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:59.847055 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c713ef7-a7ec-469f-b5ff-e9ee353acb6a None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:59.854355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 83/167] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:32:59 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:59.856458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c713ef7-a7ec-469f-b5ff-e9ee353acb6a None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:59.885822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0885a4-db86-492e-9158-82a1b5bb607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:59.887401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0885a4-db86-492e-9158-82a1b5bb607c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:59.888164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0885a4-db86-492e-9158-82a1b5bb607c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:59.888871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0885a4-db86-492e-9158-82a1b5bb607c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:00.006583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:00.084663 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0885a4-db86-492e-9158-82a1b5bb607c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:00.086119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0885a4-db86-492e-9158-82a1b5bb607c None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:00.161636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c713ef7-a7ec-469f-b5ff-e9ee353acb6a None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:00.266548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896edb59-e525-4987-a336-45b98be8b106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:00.267224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896edb59-e525-4987-a336-45b98be8b106 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:00.267613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896edb59-e525-4987-a336-45b98be8b106 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:00.267896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896edb59-e525-4987-a336-45b98be8b106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:00.284108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:00.393880 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 85/168] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:32:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:00.395361 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e079b5-8991-4a11-b9bc-de3807307a53 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:00.395831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e079b5-8991-4a11-b9bc-de3807307a53 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:00.396125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e079b5-8991-4a11-b9bc-de3807307a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:00.433407 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-77e079b5-8991-4a11-b9bc-de3807307a53 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:00.434699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-77e079b5-8991-4a11-b9bc-de3807307a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:00.445365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896edb59-e525-4987-a336-45b98be8b106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:00.447851 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896edb59-e525-4987-a336-45b98be8b106 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:00.589925 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:00.599156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 86/169] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:00.599844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e079b5-8991-4a11-b9bc-de3807307a53 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:00.732699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 84/170] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:32:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 877 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:00.735238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896edb59-e525-4987-a336-45b98be8b106 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:00.806611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:00.875620 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e079b5-8991-4a11-b9bc-de3807307a53 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:00.945523 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896edb59-e525-4987-a336-45b98be8b106 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:00.976583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d62c7a-4515-431f-8c14-55c5c9964794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:00.977486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d62c7a-4515-431f-8c14-55c5c9964794 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:00.977771 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d62c7a-4515-431f-8c14-55c5c9964794 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:00.978049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d62c7a-4515-431f-8c14-55c5c9964794 None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:00.983343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d62c7a-4515-431f-8c14-55c5c9964794 None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:00.985625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d62c7a-4515-431f-8c14-55c5c9964794 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:00.990245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 87/171] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:00 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:00.991309 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d62c7a-4515-431f-8c14-55c5c9964794 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:01.001954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b30f81-83e8-474a-bd58-96244b32fc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:01.002819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b30f81-83e8-474a-bd58-96244b32fc8d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:01.003199 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b30f81-83e8-474a-bd58-96244b32fc8d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:01.003493 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b30f81-83e8-474a-bd58-96244b32fc8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:01.024118 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b30f81-83e8-474a-bd58-96244b32fc8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-f7b30f81-83e8-474a-bd58-96244b32fc8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:01.033342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:01.034537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:01.035332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:01.035332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:01.035332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:01.035332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:01.035332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:01.035332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:01.035332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:01.035332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:01.035332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:01.035332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:01.035332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:01.035332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:01.038277 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 85/172] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:01.040193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8da3-733c-488d-acca-69a2fb40569d None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:01.040723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8da3-733c-488d-acca-69a2fb40569d None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:01.041246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8da3-733c-488d-acca-69a2fb40569d None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:01.043278 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 86/173] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:01.044293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d8da3-733c-488d-acca-69a2fb40569d None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:01.170804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:01.274447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d62c7a-4515-431f-8c14-55c5c9964794 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:01.293094 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:01.295822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d8da3-733c-488d-acca-69a2fb40569d None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:01.366404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059115-2bf5-4f8e-870b-59deffcbdf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:01.368956 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059115-2bf5-4f8e-870b-59deffcbdf8f None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:01.369548 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059115-2bf5-4f8e-870b-59deffcbdf8f None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:01.370116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059115-2bf5-4f8e-870b-59deffcbdf8f None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:01.373519 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79059115-2bf5-4f8e-870b-59deffcbdf8f None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:01.376183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79059115-2bf5-4f8e-870b-59deffcbdf8f None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:01.377603 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3071af-1ac8-4b6c-9b35-69ba9637de0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:01.378577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3071af-1ac8-4b6c-9b35-69ba9637de0b None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:01.379037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 88/174] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:00 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:01.379453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3071af-1ac8-4b6c-9b35-69ba9637de0b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:01.379995 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3071af-1ac8-4b6c-9b35-69ba9637de0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:01.380582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059115-2bf5-4f8e-870b-59deffcbdf8f None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:01.381521 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3071af-1ac8-4b6c-9b35-69ba9637de0b None admin] RBAC: Adding query filter params (role.id=5a16a034a01e45b89530e8dd35d56588, scope.project.id=9e623ea7f63f489ba500d0b565430c01, user.id=75a051b2e49849fb9c162fa672f54248) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:01.382042 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3071af-1ac8-4b6c-9b35-69ba9637de0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:01.383770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3071af-1ac8-4b6c-9b35-69ba9637de0b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:01.398567 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 87/175] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:33:01 2022] GET /identity/v3/role_assignments?user.id=75a051b2e49849fb9c162fa672f54248&scope.project.id=9e623ea7f63f489ba500d0b565430c01&role.id=5a16a034a01e45b89530e8dd35d56588 => generated 610 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:01.401626 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f5a88-4c2f-4b69-9acf-3de81a2efcc6 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:01.402409 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f5a88-4c2f-4b69-9acf-3de81a2efcc6 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:01.402915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f5a88-4c2f-4b69-9acf-3de81a2efcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:01.431927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-ae9f5a88-4c2f-4b69-9acf-3de81a2efcc6 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:01.433280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ae9f5a88-4c2f-4b69-9acf-3de81a2efcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:01.550116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 88/176] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:01.551761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901c2e7-d303-437d-b1a0-18acf5fa28d2 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:01.552064 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901c2e7-d303-437d-b1a0-18acf5fa28d2 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:01.552351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901c2e7-d303-437d-b1a0-18acf5fa28d2 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:01.554686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 89/177] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:01.555629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901c2e7-d303-437d-b1a0-18acf5fa28d2 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:01.578555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059115-2bf5-4f8e-870b-59deffcbdf8f None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:01.641210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bebda0-6b48-4e0c-b50b-e598275d2a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:01.641513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bebda0-6b48-4e0c-b50b-e598275d2a6f None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:01.642116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bebda0-6b48-4e0c-b50b-e598275d2a6f None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:01.642260 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bebda0-6b48-4e0c-b50b-e598275d2a6f None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:01.643505 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bebda0-6b48-4e0c-b50b-e598275d2a6f None admin] RBAC: Adding query filter params (name=member) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:01.644013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bebda0-6b48-4e0c-b50b-e598275d2a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:01.646632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bebda0-6b48-4e0c-b50b-e598275d2a6f None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:01.654968 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:01.660869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 89/178] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:01 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:01.662345 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb3328-b595-4cb6-bf0c-10d49914f0a6 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:01.662639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb3328-b595-4cb6-bf0c-10d49914f0a6 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:01.662924 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb3328-b595-4cb6-bf0c-10d49914f0a6 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:01.664453 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 90/179] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:01.665378 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e28d2-5166-49a6-ac55-1cd6e70d4323 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:01.665660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e28d2-5166-49a6-ac55-1cd6e70d4323 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:01.665941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e28d2-5166-49a6-ac55-1cd6e70d4323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:01.692275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-655e28d2-5166-49a6-ac55-1cd6e70d4323 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:01.694851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-655e28d2-5166-49a6-ac55-1cd6e70d4323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:01.734251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:01.754619 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901c2e7-d303-437d-b1a0-18acf5fa28d2 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:01.802566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 91/180] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:01.804061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25216f-be2a-4286-83ba-93e1645b285d None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:01.804380 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25216f-be2a-4286-83ba-93e1645b285d None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:01.804679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25216f-be2a-4286-83ba-93e1645b285d None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:01.806187 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 92/181] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:01.807070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25216f-be2a-4286-83ba-93e1645b285d None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:01.807232 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33a473-4bdb-403b-aa09-c864ec97b381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:01.807917 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33a473-4bdb-403b-aa09-c864ec97b381 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:01.808237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33a473-4bdb-403b-aa09-c864ec97b381 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:01.808522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33a473-4bdb-403b-aa09-c864ec97b381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:01.809423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33a473-4bdb-403b-aa09-c864ec97b381 None admin] RBAC: Adding query filter params (role.id=0449b3526e454e9ea05258c90de6de31, scope.project.id=9e623ea7f63f489ba500d0b565430c01, user.id=75a051b2e49849fb9c162fa672f54248) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:01.809758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33a473-4bdb-403b-aa09-c864ec97b381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:01.812494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33a473-4bdb-403b-aa09-c864ec97b381 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:01.819712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 90/182] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:33:01 2022] GET /identity/v3/role_assignments?user.id=75a051b2e49849fb9c162fa672f54248&scope.project.id=9e623ea7f63f489ba500d0b565430c01&role.id=0449b3526e454e9ea05258c90de6de31 => generated 610 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:01.821912 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33a473-4bdb-403b-aa09-c864ec97b381 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:02.015228 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25216f-be2a-4286-83ba-93e1645b285d None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:02.015482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33a473-4bdb-403b-aa09-c864ec97b381 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:02.080819 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:02.085682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf68988-5959-4df2-87c8-7aa8106974e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:02.087581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf68988-5959-4df2-87c8-7aa8106974e5 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:02.088296 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf68988-5959-4df2-87c8-7aa8106974e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:02.088925 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf68988-5959-4df2-87c8-7aa8106974e5 None admin] PATH_INFO: `/v3/users/75a051b2e49849fb9c162fa672f54248` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:02.091005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddca64-65ed-427f-9cf1-edfa3d2fc1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:02.091255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf68988-5959-4df2-87c8-7aa8106974e5 None admin] RBAC: Authorizing `identity:get_user(user_id=75a051b2e49849fb9c162fa672f54248)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:02.091738 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddca64-65ed-427f-9cf1-edfa3d2fc1ce None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:02.092038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddca64-65ed-427f-9cf1-edfa3d2fc1ce None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:02.092317 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddca64-65ed-427f-9cf1-edfa3d2fc1ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:02.093707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf68988-5959-4df2-87c8-7aa8106974e5 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:02.096639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 91/183] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:01 2022] GET /identity/v3/users/75a051b2e49849fb9c162fa672f54248 => generated 276 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:02.098737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b371183-4aaf-47b4-a111-816d538e6375 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:02.099277 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b371183-4aaf-47b4-a111-816d538e6375 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:02.099711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b371183-4aaf-47b4-a111-816d538e6375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:02.113119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ddca64-65ed-427f-9cf1-edfa3d2fc1ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-34ddca64-65ed-427f-9cf1-edfa3d2fc1ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:02.122039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:02.124479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:02.126257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:02.126257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:02.126257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:02.126257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:02.126257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:02.126257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:02.126257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:02.126257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:02.126257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:02.126257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:02.126257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:02.126257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:02.126257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 93/184] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:33:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:02.128193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f384f-9ed8-46d3-8b68-cd25ed52adec None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:02.128193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f384f-9ed8-46d3-8b68-cd25ed52adec None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:02.128193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f384f-9ed8-46d3-8b68-cd25ed52adec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:02.129852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-6b371183-4aaf-47b4-a111-816d538e6375 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:02.132046 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6b371183-4aaf-47b4-a111-816d538e6375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:02.151401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-cc8f384f-9ed8-46d3-8b68-cd25ed52adec None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:02.152742 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-cc8f384f-9ed8-46d3-8b68-cd25ed52adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:02.162730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:02.235639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 92/185] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:02.238260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b371183-4aaf-47b4-a111-816d538e6375 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:02.271606 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 94/186] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:02.273212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f384f-9ed8-46d3-8b68-cd25ed52adec None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:02.377534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b371183-4aaf-47b4-a111-816d538e6375 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:02.424840 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efa4f0-40fe-48f9-9c88-2bf2ca5d0d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:02.425677 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efa4f0-40fe-48f9-9c88-2bf2ca5d0d9d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:02.425985 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efa4f0-40fe-48f9-9c88-2bf2ca5d0d9d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:02.426246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efa4f0-40fe-48f9-9c88-2bf2ca5d0d9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:02.443461 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f384f-9ed8-46d3-8b68-cd25ed52adec None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:02.449205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efa4f0-40fe-48f9-9c88-2bf2ca5d0d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-08efa4f0-40fe-48f9-9c88-2bf2ca5d0d9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:02.458106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:02.459989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:02.461640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:02.461640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:02.461640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:02.461640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:02.461640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:02.461640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:02.461640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:02.461640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:02.461640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:02.461640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:02.461640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:02.461640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:02.461640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 93/187] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:33:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:02.461640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efa4f0-40fe-48f9-9c88-2bf2ca5d0d9d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:02.473564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:02.478530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:02.497568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4b035-e44e-41e2-8446-02e0e4664619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:02.501247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4b035-e44e-41e2-8446-02e0e4664619 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:02.501247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4b035-e44e-41e2-8446-02e0e4664619 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:02.501247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4b035-e44e-41e2-8446-02e0e4664619 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:02.576805 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4b035-e44e-41e2-8446-02e0e4664619 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:02.578540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4b035-e44e-41e2-8446-02e0e4664619 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:02.598809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efa4f0-40fe-48f9-9c88-2bf2ca5d0d9d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:02.642333 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3d62d-cd8a-41b9-906a-a9894e7731c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:02.643433 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3d62d-cd8a-41b9-906a-a9894e7731c5 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:02.643888 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3d62d-cd8a-41b9-906a-a9894e7731c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:02.644360 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3d62d-cd8a-41b9-906a-a9894e7731c5 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:02.645715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3d62d-cd8a-41b9-906a-a9894e7731c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:02.646176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3d62d-cd8a-41b9-906a-a9894e7731c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:02.648509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3d62d-cd8a-41b9-906a-a9894e7731c5 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:02.658793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 94/188] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:02 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:02.658793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3d62d-cd8a-41b9-906a-a9894e7731c5 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:02.705628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 95/189] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:02 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:02.705628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4b035-e44e-41e2-8446-02e0e4664619 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:02.726239 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:02.757176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:02.792882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3d62d-cd8a-41b9-906a-a9894e7731c5 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:02.821725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4b035-e44e-41e2-8446-02e0e4664619 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:02.834345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766fa15-7451-4718-ba6a-0b4fd8ef690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:02.835668 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766fa15-7451-4718-ba6a-0b4fd8ef690c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:02.836151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766fa15-7451-4718-ba6a-0b4fd8ef690c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:02.836636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766fa15-7451-4718-ba6a-0b4fd8ef690c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:02.838651 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766fa15-7451-4718-ba6a-0b4fd8ef690c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:02.841162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766fa15-7451-4718-ba6a-0b4fd8ef690c None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:02.843023 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 95/190] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:02 2022] GET /identity/v3/domains/default => generated 200 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:02.844220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766fa15-7451-4718-ba6a-0b4fd8ef690c None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:02.859197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89f645-20a7-4b04-9bdf-294a2d483ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:02.860058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89f645-20a7-4b04-9bdf-294a2d483ece None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:02.860337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89f645-20a7-4b04-9bdf-294a2d483ece None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:02.860657 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89f645-20a7-4b04-9bdf-294a2d483ece None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:02.871289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89f645-20a7-4b04-9bdf-294a2d483ece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-6a89f645-20a7-4b04-9bdf-294a2d483ece None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:02.879660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:02.886195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:02.887137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:02.887137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:02.887137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:02.887137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:02.887137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:02.887137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:02.887137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:02.887137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:02.887137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:02.887137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:02.887137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:33:02.887137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:02.887137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 96/191] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:02.887137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89f645-20a7-4b04-9bdf-294a2d483ece None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:02.963242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766fa15-7451-4718-ba6a-0b4fd8ef690c None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:02.995831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:03.019394 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89f645-20a7-4b04-9bdf-294a2d483ece None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:03.028010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248fd7b-828e-4f19-9552-634ac7f7a7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:03.028691 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248fd7b-828e-4f19-9552-634ac7f7a7f9 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:03.028977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248fd7b-828e-4f19-9552-634ac7f7a7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:03.029252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248fd7b-828e-4f19-9552-634ac7f7a7f9 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:03.030013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248fd7b-828e-4f19-9552-634ac7f7a7f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:03.030414 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248fd7b-828e-4f19-9552-634ac7f7a7f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:03.031775 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248fd7b-828e-4f19-9552-634ac7f7a7f9 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:03.040422 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 96/192] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:33:02 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:03.041258 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248fd7b-828e-4f19-9552-634ac7f7a7f9 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:03.051648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:03.059977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aff15c-6043-4c7a-8cca-0146f5b1f4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:03.060866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aff15c-6043-4c7a-8cca-0146f5b1f4ea None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:03.061150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aff15c-6043-4c7a-8cca-0146f5b1f4ea None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:03.061966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aff15c-6043-4c7a-8cca-0146f5b1f4ea None admin] PATH_INFO: `/v3/users/edbff1b5ed2e40239b731fb971bfa4e5` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:03.082873 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aff15c-6043-4c7a-8cca-0146f5b1f4ea None admin] RBAC: Authorizing `identity:get_user(user_id=edbff1b5ed2e40239b731fb971bfa4e5)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:03.091229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aff15c-6043-4c7a-8cca-0146f5b1f4ea None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:03.091229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 97/193] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:02 2022] GET /identity/v3/users/edbff1b5ed2e40239b731fb971bfa4e5 => generated 284 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:03.091229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aff15c-6043-4c7a-8cca-0146f5b1f4ea None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:03.166451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248fd7b-828e-4f19-9552-634ac7f7a7f9 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:03.203090 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7af60-9dbc-41c3-b093-600a799363f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:03.203960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7af60-9dbc-41c3-b093-600a799363f6 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:03.204242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7af60-9dbc-41c3-b093-600a799363f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:03.204516 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7af60-9dbc-41c3-b093-600a799363f6 None admin] PATH_INFO: `/v3/projects/ca4559609c24403386c7cd82267e4be3` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:03.205724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7af60-9dbc-41c3-b093-600a799363f6 None admin] RBAC: Authorizing `identity:get_project(project_id=ca4559609c24403386c7cd82267e4be3)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:03.207221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7af60-9dbc-41c3-b093-600a799363f6 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:03.209116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 97/194] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:03 2022] GET /identity/v3/projects/ca4559609c24403386c7cd82267e4be3 => generated 313 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:03.211758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7af60-9dbc-41c3-b093-600a799363f6 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:03.222906 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aff15c-6043-4c7a-8cca-0146f5b1f4ea None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:03.259422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595493a9-c265-4f43-a87e-ffe93381fe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:03.260095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595493a9-c265-4f43-a87e-ffe93381fe32 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:03.260378 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595493a9-c265-4f43-a87e-ffe93381fe32 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:03.260653 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595493a9-c265-4f43-a87e-ffe93381fe32 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:03.261366 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595493a9-c265-4f43-a87e-ffe93381fe32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:03.262935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595493a9-c265-4f43-a87e-ffe93381fe32 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:03.271174 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:03.294760 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:03.326337 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7af60-9dbc-41c3-b093-600a799363f6 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:03.361822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e90fe-f466-4fb7-9d57-d044840113b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:03.362534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e90fe-f466-4fb7-9d57-d044840113b7 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:03.362863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e90fe-f466-4fb7-9d57-d044840113b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:03.363140 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e90fe-f466-4fb7-9d57-d044840113b7 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:03.363887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e90fe-f466-4fb7-9d57-d044840113b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:03.364194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e90fe-f466-4fb7-9d57-d044840113b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:03.365568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e90fe-f466-4fb7-9d57-d044840113b7 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:03.375802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 98/195] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:03 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:03.376741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e90fe-f466-4fb7-9d57-d044840113b7 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:03.401429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 98/196] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:33:03 2022] POST /identity/v3/users => generated 298 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:33:03.402289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595493a9-c265-4f43-a87e-ffe93381fe32 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:03.544846 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e90fe-f466-4fb7-9d57-d044840113b7 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:03.595405 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595493a9-c265-4f43-a87e-ffe93381fe32 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:03.604007 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4e52f-8173-4ed9-927d-bfd6920d9980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:03.604913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4e52f-8173-4ed9-927d-bfd6920d9980 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:03.605200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4e52f-8173-4ed9-927d-bfd6920d9980 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:03.605485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4e52f-8173-4ed9-927d-bfd6920d9980 None admin] PATH_INFO: `/v3/users/edbff1b5ed2e40239b731fb971bfa4e5` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:03.607095 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4e52f-8173-4ed9-927d-bfd6920d9980 None admin] RBAC: Authorizing `identity:get_user(user_id=edbff1b5ed2e40239b731fb971bfa4e5)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:03.609450 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4e52f-8173-4ed9-927d-bfd6920d9980 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:03.616465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 99/197] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:03 2022] GET /identity/v3/users/edbff1b5ed2e40239b731fb971bfa4e5 => generated 284 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:03.616465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4e52f-8173-4ed9-927d-bfd6920d9980 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:03.623532 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:03.656421 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa66cc-9da0-4aaf-b706-6b51df9cd3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:03.666277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa66cc-9da0-4aaf-b706-6b51df9cd3a1 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:03.666277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa66cc-9da0-4aaf-b706-6b51df9cd3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:03.666277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa66cc-9da0-4aaf-b706-6b51df9cd3a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:03.770003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:03.790735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa66cc-9da0-4aaf-b706-6b51df9cd3a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:03.793306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa66cc-9da0-4aaf-b706-6b51df9cd3a1 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:03.808451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4e52f-8173-4ed9-927d-bfd6920d9980 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:03.862403 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a3b78-b255-45e9-90e0-946e23461102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:03.863068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a3b78-b255-45e9-90e0-946e23461102 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:03.863363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a3b78-b255-45e9-90e0-946e23461102 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:03.863645 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a3b78-b255-45e9-90e0-946e23461102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:03.864499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a3b78-b255-45e9-90e0-946e23461102 None admin] RBAC: Adding query filter params (role.id=5a16a034a01e45b89530e8dd35d56588, scope.project.id=ca4559609c24403386c7cd82267e4be3, user.id=75a051b2e49849fb9c162fa672f54248) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:03.864826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a3b78-b255-45e9-90e0-946e23461102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:03.867311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a3b78-b255-45e9-90e0-946e23461102 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:03.878013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 100/198] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:33:03 2022] GET /identity/v3/role_assignments?user.id=75a051b2e49849fb9c162fa672f54248&scope.project.id=ca4559609c24403386c7cd82267e4be3&role.id=5a16a034a01e45b89530e8dd35d56588 => generated 610 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:03.878984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a3b78-b255-45e9-90e0-946e23461102 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:03.997194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 99/199] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:03 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:03.998280 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa66cc-9da0-4aaf-b706-6b51df9cd3a1 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:04.039391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:04.115862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a3b78-b255-45e9-90e0-946e23461102 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:04.195510 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbd820-46a4-4380-ac43-1644c6922128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:04.196413 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbd820-46a4-4380-ac43-1644c6922128 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:04.196694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbd820-46a4-4380-ac43-1644c6922128 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:04.196967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbd820-46a4-4380-ac43-1644c6922128 None admin] PATH_INFO: `/v3/users/976466141bb54d22992ddff3c4e110a6` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:04.201554 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbd820-46a4-4380-ac43-1644c6922128 None admin] RBAC: Authorizing `identity:get_user(user_id=976466141bb54d22992ddff3c4e110a6)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:04.203714 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbd820-46a4-4380-ac43-1644c6922128 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:04.206412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 101/200] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:03 2022] GET /identity/v3/users/976466141bb54d22992ddff3c4e110a6 => generated 290 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:04.207275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbd820-46a4-4380-ac43-1644c6922128 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:04.212596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:04.229185 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa66cc-9da0-4aaf-b706-6b51df9cd3a1 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:04.283390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849c11f-d95d-49cb-82b9-33a5fc45439b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:04.284059 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849c11f-d95d-49cb-82b9-33a5fc45439b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:04.284343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849c11f-d95d-49cb-82b9-33a5fc45439b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:04.284618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849c11f-d95d-49cb-82b9-33a5fc45439b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:04.370695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbd820-46a4-4380-ac43-1644c6922128 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:04.395625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849c11f-d95d-49cb-82b9-33a5fc45439b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:04.398570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849c11f-d95d-49cb-82b9-33a5fc45439b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:04.437031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce9b88-1f21-40e2-b7e9-d73e9915a546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:04.439409 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce9b88-1f21-40e2-b7e9-d73e9915a546 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:04.439868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce9b88-1f21-40e2-b7e9-d73e9915a546 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:04.440340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce9b88-1f21-40e2-b7e9-d73e9915a546 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:04.442447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce9b88-1f21-40e2-b7e9-d73e9915a546 None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:04.443943 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce9b88-1f21-40e2-b7e9-d73e9915a546 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:04.447057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 102/201] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:04 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:04.448539 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce9b88-1f21-40e2-b7e9-d73e9915a546 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:04.466975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:04.550079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:04.564860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 100/202] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:03 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:04.571192 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849c11f-d95d-49cb-82b9-33a5fc45439b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:04.644174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce9b88-1f21-40e2-b7e9-d73e9915a546 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:04.684237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a527db-9dc0-433d-bba5-3d34f8e6c770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:04.684884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a527db-9dc0-433d-bba5-3d34f8e6c770 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:04.685674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a527db-9dc0-433d-bba5-3d34f8e6c770 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:04.685961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a527db-9dc0-433d-bba5-3d34f8e6c770 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:04.699055 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849c11f-d95d-49cb-82b9-33a5fc45439b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:04.737551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f5c33-96cb-492b-afbf-8349852aab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:04.738222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f5c33-96cb-492b-afbf-8349852aab72 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:04.738610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f5c33-96cb-492b-afbf-8349852aab72 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:04.738897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f5c33-96cb-492b-afbf-8349852aab72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:04.739793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f5c33-96cb-492b-afbf-8349852aab72 None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=9dd29f6d3b974bff8206091ffee50316, user.id=edbff1b5ed2e40239b731fb971bfa4e5) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:04.740118 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f5c33-96cb-492b-afbf-8349852aab72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:04.741693 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f5c33-96cb-492b-afbf-8349852aab72 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:04.747981 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 101/203] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:33:04 2022] GET /identity/v3/role_assignments?user.id=edbff1b5ed2e40239b731fb971bfa4e5&scope.project.id=9dd29f6d3b974bff8206091ffee50316&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:04.755580 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f5c33-96cb-492b-afbf-8349852aab72 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:04.799498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a527db-9dc0-433d-bba5-3d34f8e6c770 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:04.801005 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a527db-9dc0-433d-bba5-3d34f8e6c770 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:04.812311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:04.882608 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:04.942377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f5c33-96cb-492b-afbf-8349852aab72 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:05.000055 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df361da7-8257-48ae-8fbc-9a7f06f62719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:05.000959 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df361da7-8257-48ae-8fbc-9a7f06f62719 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:05.001252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df361da7-8257-48ae-8fbc-9a7f06f62719 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:05.001635 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df361da7-8257-48ae-8fbc-9a7f06f62719 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:05.003065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df361da7-8257-48ae-8fbc-9a7f06f62719 None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:05.005019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df361da7-8257-48ae-8fbc-9a7f06f62719 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:05.007354 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 102/204] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:04 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:05.023875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df361da7-8257-48ae-8fbc-9a7f06f62719 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:05.070878 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 103/205] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:05.079126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a527db-9dc0-433d-bba5-3d34f8e6c770 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:05.242047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a527db-9dc0-433d-bba5-3d34f8e6c770 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:05.245482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:05.291542 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae6bb1-3822-456d-823b-2459b49f481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:05.292865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae6bb1-3822-456d-823b-2459b49f481e None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:05.293340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae6bb1-3822-456d-823b-2459b49f481e None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:05.293835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae6bb1-3822-456d-823b-2459b49f481e None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:05.295538 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae6bb1-3822-456d-823b-2459b49f481e None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:05.297511 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae6bb1-3822-456d-823b-2459b49f481e None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:05.300386 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 104/206] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:05 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:05.311999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae6bb1-3822-456d-823b-2459b49f481e None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:05.325085 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df361da7-8257-48ae-8fbc-9a7f06f62719 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:05.378649 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:05.401034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b2210-a331-4b1a-9da0-3f8bde488355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:05.401753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b2210-a331-4b1a-9da0-3f8bde488355 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:05.402039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b2210-a331-4b1a-9da0-3f8bde488355 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:05.402337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b2210-a331-4b1a-9da0-3f8bde488355 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:05.403766 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b2210-a331-4b1a-9da0-3f8bde488355 None admin] RBAC: Adding query filter params (role.id=0449b3526e454e9ea05258c90de6de31, scope.project.id=9dd29f6d3b974bff8206091ffee50316, user.id=edbff1b5ed2e40239b731fb971bfa4e5) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:05.405803 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b2210-a331-4b1a-9da0-3f8bde488355 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:05.408256 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b2210-a331-4b1a-9da0-3f8bde488355 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:05.423557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 103/207] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:33:05 2022] GET /identity/v3/role_assignments?user.id=edbff1b5ed2e40239b731fb971bfa4e5&scope.project.id=9dd29f6d3b974bff8206091ffee50316&role.id=0449b3526e454e9ea05258c90de6de31 => generated 260 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:05.533995 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae6bb1-3822-456d-823b-2459b49f481e None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:05.610821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07295dde-8173-4ede-9c99-e308371497f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:05.611793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07295dde-8173-4ede-9c99-e308371497f9 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:05.612076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07295dde-8173-4ede-9c99-e308371497f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:05.612347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07295dde-8173-4ede-9c99-e308371497f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:05.613216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07295dde-8173-4ede-9c99-e308371497f9 None admin] RBAC: Adding query filter params (role.id=88d17c94ac464961ba0635bbb0d74025, scope.project.id=9e623ea7f63f489ba500d0b565430c01, user.id=976466141bb54d22992ddff3c4e110a6) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:05.613527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07295dde-8173-4ede-9c99-e308371497f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:05.615370 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07295dde-8173-4ede-9c99-e308371497f9 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:05.629057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 105/208] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:33:05 2022] GET /identity/v3/role_assignments?user.id=976466141bb54d22992ddff3c4e110a6&scope.project.id=9e623ea7f63f489ba500d0b565430c01&role.id=88d17c94ac464961ba0635bbb0d74025 => generated 610 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:06.469762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df79fb-28e1-4312-8396-526e685cc254 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:06.470251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df79fb-28e1-4312-8396-526e685cc254 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:06.470590 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df79fb-28e1-4312-8396-526e685cc254 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:06.473357 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 104/209] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:06 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:06.481826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135601d1-cf4a-4f8d-adee-e6f45b7c300f None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:06.482348 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135601d1-cf4a-4f8d-adee-e6f45b7c300f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:06.482426 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135601d1-cf4a-4f8d-adee-e6f45b7c300f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:06.511463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-135601d1-cf4a-4f8d-adee-e6f45b7c300f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:06.513472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-135601d1-cf4a-4f8d-adee-e6f45b7c300f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:06.556923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:06.580539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bd273-faf2-4292-aae3-1b161cb65258 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:06.580870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bd273-faf2-4292-aae3-1b161cb65258 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:06.581119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bd273-faf2-4292-aae3-1b161cb65258 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:06.584845 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 105/210] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:06.589515 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b044b78-b7a1-4cd6-8a8e-72f30049ffbf None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:06.589861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b044b78-b7a1-4cd6-8a8e-72f30049ffbf None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:06.590258 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b044b78-b7a1-4cd6-8a8e-72f30049ffbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:06.603772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 106/211] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:06.618346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-0b044b78-b7a1-4cd6-8a8e-72f30049ffbf None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:06.619783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0b044b78-b7a1-4cd6-8a8e-72f30049ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:06.628856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135601d1-cf4a-4f8d-adee-e6f45b7c300f None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:06.718538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 106/212] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:06.741011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135601d1-cf4a-4f8d-adee-e6f45b7c300f None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:06.754199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b044b78-b7a1-4cd6-8a8e-72f30049ffbf None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:06.783968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6c61c-a99a-4ac1-b859-f5e997949efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:06.785145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c61c-a99a-4ac1-b859-f5e997949efd None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:06.785434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c61c-a99a-4ac1-b859-f5e997949efd None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:06.785713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c61c-a99a-4ac1-b859-f5e997949efd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:06.797658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6c61c-a99a-4ac1-b859-f5e997949efd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-aec6c61c-a99a-4ac1-b859-f5e997949efd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:06.805839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:06.806828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:06.807613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:06.807613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:06.807613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:06.807613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:06.807613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:06.807613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:06.807613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:06.807613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:06.807613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:06.807613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:06.807613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:06.807613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:06.807613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 107/213] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:06.814437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6c61c-a99a-4ac1-b859-f5e997949efd None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:06.861038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:06.876914 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b044b78-b7a1-4cd6-8a8e-72f30049ffbf None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:06.914309 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:06.927064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27b121-cd8f-4027-9499-2611d6f9ea84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:06.927903 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27b121-cd8f-4027-9499-2611d6f9ea84 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:06.928184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27b121-cd8f-4027-9499-2611d6f9ea84 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:06.928458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27b121-cd8f-4027-9499-2611d6f9ea84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:06.929885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27b121-cd8f-4027-9499-2611d6f9ea84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:06.931495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27b121-cd8f-4027-9499-2611d6f9ea84 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:06.933141 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 107/214] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:06 2022] GET /identity/v3/domains/default => generated 200 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:06.940867 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6c61c-a99a-4ac1-b859-f5e997949efd None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:06.941143 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27b121-cd8f-4027-9499-2611d6f9ea84 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:06.992815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8435e-a0ce-495f-9fa4-11e133f423eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:06.993887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8435e-a0ce-495f-9fa4-11e133f423eb None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:06.994408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8435e-a0ce-495f-9fa4-11e133f423eb None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:06.995469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8435e-a0ce-495f-9fa4-11e133f423eb None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:06.996449 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8435e-a0ce-495f-9fa4-11e133f423eb None admin] RBAC: Adding query filter params (name=member) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:06.996967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8435e-a0ce-495f-9fa4-11e133f423eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:06.999614 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8435e-a0ce-495f-9fa4-11e133f423eb None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:07.014553 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 108/215] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:06 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:07.017154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8435e-a0ce-495f-9fa4-11e133f423eb None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:07.074752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27b121-cd8f-4027-9499-2611d6f9ea84 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:07.132662 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f0f45-ff6e-4aff-8494-b05c91d945f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:07.133578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f0f45-ff6e-4aff-8494-b05c91d945f2 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:07.133688 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f0f45-ff6e-4aff-8494-b05c91d945f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:07.133944 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f0f45-ff6e-4aff-8494-b05c91d945f2 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:07.134747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f0f45-ff6e-4aff-8494-b05c91d945f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:07.137420 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f0f45-ff6e-4aff-8494-b05c91d945f2 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:07.141256 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:07.156789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8435e-a0ce-495f-9fa4-11e133f423eb None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:07.193866 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6a2d8-a639-4862-9c4b-cac21cd5eb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:07.195352 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6a2d8-a639-4862-9c4b-cac21cd5eb54 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:07.195804 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6a2d8-a639-4862-9c4b-cac21cd5eb54 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:07.196286 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6a2d8-a639-4862-9c4b-cac21cd5eb54 None admin] PATH_INFO: `/v3/users/c9dcd8b95de841548d36025c4bbc1899` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:07.216255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6a2d8-a639-4862-9c4b-cac21cd5eb54 None admin] RBAC: Authorizing `identity:get_user(user_id=c9dcd8b95de841548d36025c4bbc1899)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:07.218265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6a2d8-a639-4862-9c4b-cac21cd5eb54 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:07.221394 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 109/216] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:07 2022] GET /identity/v3/users/c9dcd8b95de841548d36025c4bbc1899 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:07.225867 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6a2d8-a639-4862-9c4b-cac21cd5eb54 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:07.351838 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6a2d8-a639-4862-9c4b-cac21cd5eb54 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:07.366867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 108/217] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:33:06 2022] POST /identity/v3/users => generated 298 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:33:07.414230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348072fe-8f82-4503-87c9-e9c818f069ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:07.415387 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348072fe-8f82-4503-87c9-e9c818f069ff None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:07.415869 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348072fe-8f82-4503-87c9-e9c818f069ff None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:07.416334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348072fe-8f82-4503-87c9-e9c818f069ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:07.439015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:07.506413 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348072fe-8f82-4503-87c9-e9c818f069ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:07.508707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348072fe-8f82-4503-87c9-e9c818f069ff None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:07.632354 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 110/218] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:07 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:33:07.639816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b277f-313d-4f79-b0cc-13e546df4813 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:07.640551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b277f-313d-4f79-b0cc-13e546df4813 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:07.640551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b277f-313d-4f79-b0cc-13e546df4813 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:07.641889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 109/219] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:07.643713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348072fe-8f82-4503-87c9-e9c818f069ff None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:07.647697 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73776b8c-1a8c-46a5-9785-3c2952614bfc None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:07.648064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73776b8c-1a8c-46a5-9785-3c2952614bfc None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:07.648319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73776b8c-1a8c-46a5-9785-3c2952614bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:07.673211 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-73776b8c-1a8c-46a5-9785-3c2952614bfc None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:07.674175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-73776b8c-1a8c-46a5-9785-3c2952614bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:07.725689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:07.747589 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:07.795992 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348072fe-8f82-4503-87c9-e9c818f069ff None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:07.797620 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 110/220] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:07.822646 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73776b8c-1a8c-46a5-9785-3c2952614bfc None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:07.849060 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f655897-68ab-4e8c-ae97-4a60deb7d8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:07.849947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f655897-68ab-4e8c-ae97-4a60deb7d8df None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:07.850548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f655897-68ab-4e8c-ae97-4a60deb7d8df None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:07.850886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f655897-68ab-4e8c-ae97-4a60deb7d8df None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:07.864608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f655897-68ab-4e8c-ae97-4a60deb7d8df None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:07.864608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f655897-68ab-4e8c-ae97-4a60deb7d8df None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:07.864608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 111/221] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:07 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:07.864608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f655897-68ab-4e8c-ae97-4a60deb7d8df None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:08.034727 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73776b8c-1a8c-46a5-9785-3c2952614bfc None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:08.074910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f655897-68ab-4e8c-ae97-4a60deb7d8df None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:08.094826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:08.118009 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821fd7c-7bcf-487a-a793-2fa2eb5dfdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:08.118711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821fd7c-7bcf-487a-a793-2fa2eb5dfdcf None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:08.119001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821fd7c-7bcf-487a-a793-2fa2eb5dfdcf None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:08.121186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821fd7c-7bcf-487a-a793-2fa2eb5dfdcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:08.121186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821fd7c-7bcf-487a-a793-2fa2eb5dfdcf None admin] RBAC: Adding query filter params (role.id=5a16a034a01e45b89530e8dd35d56588, scope.project.id=9dd29f6d3b974bff8206091ffee50316, user.id=c9dcd8b95de841548d36025c4bbc1899) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:08.121186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821fd7c-7bcf-487a-a793-2fa2eb5dfdcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:08.122017 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821fd7c-7bcf-487a-a793-2fa2eb5dfdcf None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:08.129265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 112/222] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:33:07 2022] GET /identity/v3/role_assignments?user.id=c9dcd8b95de841548d36025c4bbc1899&scope.project.id=9dd29f6d3b974bff8206091ffee50316&role.id=5a16a034a01e45b89530e8dd35d56588 => generated 260 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:08.135318 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed8843-08ba-4e9b-8bcc-dfbdff1547e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:08.136151 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed8843-08ba-4e9b-8bcc-dfbdff1547e6 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:08.136439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed8843-08ba-4e9b-8bcc-dfbdff1547e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:08.136793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed8843-08ba-4e9b-8bcc-dfbdff1547e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:08.175158 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed8843-08ba-4e9b-8bcc-dfbdff1547e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-d6ed8843-08ba-4e9b-8bcc-dfbdff1547e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:08.183265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:08.184297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:08.185113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:08.185113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:08.185113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:08.185113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:08.185113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:08.185113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:08.185113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:08.185113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:08.185113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:08.185113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:08.185113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:08.185113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:08.185113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 111/223] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:33:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:08.192438 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821fd7c-7bcf-487a-a793-2fa2eb5dfdcf None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:08.266452 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a05c74-7b33-4093-abd2-77f434a0cd7c None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:08.266749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a05c74-7b33-4093-abd2-77f434a0cd7c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:08.267034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a05c74-7b33-4093-abd2-77f434a0cd7c None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:08.269066 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 112/224] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:08 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:08.276638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e33d6b-e3ac-4135-9c05-f4cedce8515d None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:08.278208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e33d6b-e3ac-4135-9c05-f4cedce8515d None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:08.279109 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e33d6b-e3ac-4135-9c05-f4cedce8515d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:08.316570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-e9e33d6b-e3ac-4135-9c05-f4cedce8515d None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:08.316570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-e9e33d6b-e3ac-4135-9c05-f4cedce8515d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:08.392246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:08.437201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821fd7c-7bcf-487a-a793-2fa2eb5dfdcf None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:08.468798 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 113/225] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:08.493327 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722865b2-1d9d-455b-a77a-061835963aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:08.494301 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722865b2-1d9d-455b-a77a-061835963aa8 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:08.494760 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722865b2-1d9d-455b-a77a-061835963aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:08.495202 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722865b2-1d9d-455b-a77a-061835963aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:08.496115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722865b2-1d9d-455b-a77a-061835963aa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:08.496569 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722865b2-1d9d-455b-a77a-061835963aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:08.498125 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722865b2-1d9d-455b-a77a-061835963aa8 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:08.508769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 113/226] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:08 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:08.511935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e33d6b-e3ac-4135-9c05-f4cedce8515d None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:08.523040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722865b2-1d9d-455b-a77a-061835963aa8 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:08.626950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:08.713138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722865b2-1d9d-455b-a77a-061835963aa8 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:08.713342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e33d6b-e3ac-4135-9c05-f4cedce8515d None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:08.757779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576c82f-5bd4-4207-a4b4-d3f88e210e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:08.759418 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576c82f-5bd4-4207-a4b4-d3f88e210e8f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:08.759930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576c82f-5bd4-4207-a4b4-d3f88e210e8f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:08.760410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576c82f-5bd4-4207-a4b4-d3f88e210e8f None admin] PATH_INFO: `/v3/users/edbff1b5ed2e40239b731fb971bfa4e5` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:08.761860 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576c82f-5bd4-4207-a4b4-d3f88e210e8f None admin] RBAC: Authorizing `identity:get_user(user_id=edbff1b5ed2e40239b731fb971bfa4e5)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:08.765103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576c82f-5bd4-4207-a4b4-d3f88e210e8f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:08.767069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 114/227] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:08 2022] GET /identity/v3/users/edbff1b5ed2e40239b731fb971bfa4e5 => generated 284 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:08.772602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576c82f-5bd4-4207-a4b4-d3f88e210e8f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:08.777511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9d2fa-2e01-4a1d-a2e2-6b444dbfa8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:08.778152 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9d2fa-2e01-4a1d-a2e2-6b444dbfa8b7 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:08.778472 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9d2fa-2e01-4a1d-a2e2-6b444dbfa8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:08.778751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9d2fa-2e01-4a1d-a2e2-6b444dbfa8b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:08.802807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9d2fa-2e01-4a1d-a2e2-6b444dbfa8b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-36d9d2fa-2e01-4a1d-a2e2-6b444dbfa8b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:08.812539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:08.813535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:08.814762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:08.814762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:08.814762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:08.814762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:08.814762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:08.814762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:08.814762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:08.814762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:08.814762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:08.814762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:08.814762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:08.814762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:08.814762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 114/228] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:33:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:08.835521 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9d2fa-2e01-4a1d-a2e2-6b444dbfa8b7 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:08.902091 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576c82f-5bd4-4207-a4b4-d3f88e210e8f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:08.912227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:08.934702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:08.966712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e8e3a-c47c-48a6-ac8d-c54768239384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:08.968378 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e8e3a-c47c-48a6-ac8d-c54768239384 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:08.968674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e8e3a-c47c-48a6-ac8d-c54768239384 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:08.968954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e8e3a-c47c-48a6-ac8d-c54768239384 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:08.970461 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e8e3a-c47c-48a6-ac8d-c54768239384 None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:08.972170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e8e3a-c47c-48a6-ac8d-c54768239384 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:08.974569 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 115/229] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:08 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:08.984553 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e8e3a-c47c-48a6-ac8d-c54768239384 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:09.079388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9d2fa-2e01-4a1d-a2e2-6b444dbfa8b7 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:09.129653 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e8e3a-c47c-48a6-ac8d-c54768239384 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:09.172767 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c186f-bb7b-401c-baa4-8b802ff42186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:09.174032 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c186f-bb7b-401c-baa4-8b802ff42186 None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:09.174721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c186f-bb7b-401c-baa4-8b802ff42186 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:09.175205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c186f-bb7b-401c-baa4-8b802ff42186 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316/users/edbff1b5ed2e40239b731fb971bfa4e5/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:09.177455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c186f-bb7b-401c-baa4-8b802ff42186 None admin] RBAC: Authorizing `identity:create_grant(project_id=9dd29f6d3b974bff8206091ffee50316, user_id=edbff1b5ed2e40239b731fb971bfa4e5, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:09.179154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c186f-bb7b-401c-baa4-8b802ff42186 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:09.197089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ecd2b-38c8-467a-a607-610de94eedd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:09.197089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ecd2b-38c8-467a-a607-610de94eedd4 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:09.197089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ecd2b-38c8-467a-a607-610de94eedd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:09.197089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ecd2b-38c8-467a-a607-610de94eedd4 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:09.197464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ecd2b-38c8-467a-a607-610de94eedd4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:09.197464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ecd2b-38c8-467a-a607-610de94eedd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:09.200030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ecd2b-38c8-467a-a607-610de94eedd4 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:09.216174 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 115/230] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:33:08 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:09.222523 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ecd2b-38c8-467a-a607-610de94eedd4 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:09.318824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:09.330720 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 116/231] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:33:08 2022] PUT /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316/users/edbff1b5ed2e40239b731fb971bfa4e5/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:33:09.340804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ecd2b-38c8-467a-a607-610de94eedd4 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:09.385628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da95c29-928c-43ae-aae3-654d99c8f130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:09.386585 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da95c29-928c-43ae-aae3-654d99c8f130 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:09.386877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da95c29-928c-43ae-aae3-654d99c8f130 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:09.387156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da95c29-928c-43ae-aae3-654d99c8f130 None admin] PATH_INFO: `/v3/users/edbff1b5ed2e40239b731fb971bfa4e5` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:09.388536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da95c29-928c-43ae-aae3-654d99c8f130 None admin] RBAC: Authorizing `identity:get_user(user_id=edbff1b5ed2e40239b731fb971bfa4e5)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:09.390633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da95c29-928c-43ae-aae3-654d99c8f130 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:09.397040 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 116/232] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:09 2022] GET /identity/v3/users/edbff1b5ed2e40239b731fb971bfa4e5 => generated 284 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:09.399705 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c186f-bb7b-401c-baa4-8b802ff42186 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:09.478670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:09.571647 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c186f-bb7b-401c-baa4-8b802ff42186 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:09.613355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc192e61-15ed-4208-856d-74277f44470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:09.614253 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc192e61-15ed-4208-856d-74277f44470d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:09.614573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc192e61-15ed-4208-856d-74277f44470d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:09.614852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc192e61-15ed-4208-856d-74277f44470d None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:09.616123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc192e61-15ed-4208-856d-74277f44470d None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:09.617594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc192e61-15ed-4208-856d-74277f44470d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:09.619749 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 117/233] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:09 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:09.625339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da95c29-928c-43ae-aae3-654d99c8f130 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:09.772327 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da95c29-928c-43ae-aae3-654d99c8f130 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:09.824675 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a99e6b-412d-4fc7-a55a-1b8502757099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:09.825584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a99e6b-412d-4fc7-a55a-1b8502757099 None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:09.825868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a99e6b-412d-4fc7-a55a-1b8502757099 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:09.826144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a99e6b-412d-4fc7-a55a-1b8502757099 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316/users/edbff1b5ed2e40239b731fb971bfa4e5/roles/0449b3526e454e9ea05258c90de6de31` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:09.832275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a99e6b-412d-4fc7-a55a-1b8502757099 None admin] RBAC: Authorizing `identity:create_grant(project_id=9dd29f6d3b974bff8206091ffee50316, user_id=edbff1b5ed2e40239b731fb971bfa4e5, role_id=0449b3526e454e9ea05258c90de6de31)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:09.833770 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a99e6b-412d-4fc7-a55a-1b8502757099 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:10.001723 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 117/234] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:33:09 2022] PUT /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316/users/edbff1b5ed2e40239b731fb971bfa4e5/roles/0449b3526e454e9ea05258c90de6de31 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:33:10.143833 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd13980-e2fe-46d4-8c4b-08f80507017d None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:10.144216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd13980-e2fe-46d4-8c4b-08f80507017d None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:10.144419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd13980-e2fe-46d4-8c4b-08f80507017d None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:10.146175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 118/235] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:10.152694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae2a0c-53ec-462a-843a-4dee1e547918 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:10.153020 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae2a0c-53ec-462a-843a-4dee1e547918 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:10.153260 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae2a0c-53ec-462a-843a-4dee1e547918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:10.173930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-99ae2a0c-53ec-462a-843a-4dee1e547918 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:10.175198 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-99ae2a0c-53ec-462a-843a-4dee1e547918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:10.184212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:10.284486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 118/236] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:10.318030 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd13980-e2fe-46d4-8c4b-08f80507017d None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:10.403224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25861467-8364-4923-8b06-863471c9ed73 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:10.403426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25861467-8364-4923-8b06-863471c9ed73 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:10.404018 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25861467-8364-4923-8b06-863471c9ed73 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:10.406031 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 119/237] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:33:10.411823 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac676e-ed87-4c93-aaa2-7a7a699c2700 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:10.412451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac676e-ed87-4c93-aaa2-7a7a699c2700 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:10.412945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac676e-ed87-4c93-aaa2-7a7a699c2700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:10.432982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-4bac676e-ed87-4c93-aaa2-7a7a699c2700 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:10.434629 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4bac676e-ed87-4c93-aaa2-7a7a699c2700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:10.451961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd13980-e2fe-46d4-8c4b-08f80507017d None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:10.458314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:10.536460 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe9e80-683f-407d-8b56-4c62fd040e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:10.537765 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe9e80-683f-407d-8b56-4c62fd040e41 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:10.538243 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe9e80-683f-407d-8b56-4c62fd040e41 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:10.538761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe9e80-683f-407d-8b56-4c62fd040e41 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:10.542839 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 120/238] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:10.562901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe9e80-683f-407d-8b56-4c62fd040e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-0ffe9e80-683f-407d-8b56-4c62fd040e41 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:10.571583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:10.572946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:10.573726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:10.573726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:10.573726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:10.573726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:10.573726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:10.573726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:10.573726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:10.573726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:10.573726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:10.573726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:10.573726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:33:10.573726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:10.581652 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 119/239] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:10.587219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac676e-ed87-4c93-aaa2-7a7a699c2700 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:10.611352 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe9e80-683f-407d-8b56-4c62fd040e41 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:10.701593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:10.746494 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac676e-ed87-4c93-aaa2-7a7a699c2700 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:10.780007 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe9e80-683f-407d-8b56-4c62fd040e41 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:10.790192 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82ac43-4159-4f32-9bf4-e362b544f833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:10.790904 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82ac43-4159-4f32-9bf4-e362b544f833 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:10.791181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82ac43-4159-4f32-9bf4-e362b544f833 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:10.791456 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82ac43-4159-4f32-9bf4-e362b544f833 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:10.792210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82ac43-4159-4f32-9bf4-e362b544f833 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:10.792515 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82ac43-4159-4f32-9bf4-e362b544f833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:10.793912 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82ac43-4159-4f32-9bf4-e362b544f833 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:10.805130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 121/240] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:10 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:10.811288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82ac43-4159-4f32-9bf4-e362b544f833 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:10.862876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309d5f8-4f61-4bef-9a0d-26b2822b367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:10.864253 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309d5f8-4f61-4bef-9a0d-26b2822b367b None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:10.864781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309d5f8-4f61-4bef-9a0d-26b2822b367b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:10.865276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309d5f8-4f61-4bef-9a0d-26b2822b367b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:10.868005 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309d5f8-4f61-4bef-9a0d-26b2822b367b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:10.869851 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309d5f8-4f61-4bef-9a0d-26b2822b367b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:10.872174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 120/241] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:10 2022] GET /identity/v3/domains/default => generated 200 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:10.878966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309d5f8-4f61-4bef-9a0d-26b2822b367b None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:10.941957 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82ac43-4159-4f32-9bf4-e362b544f833 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:10.946219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:10.988745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137faf1-1c01-45ac-b2aa-380781107d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:10.989859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137faf1-1c01-45ac-b2aa-380781107d8c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:10.990585 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137faf1-1c01-45ac-b2aa-380781107d8c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:10.991005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137faf1-1c01-45ac-b2aa-380781107d8c None admin] PATH_INFO: `/v3/users/a1db5b57376b4f1a8cb8cb54f3f21f37` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:10.993502 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:11.009311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137faf1-1c01-45ac-b2aa-380781107d8c None admin] RBAC: Authorizing `identity:get_user(user_id=a1db5b57376b4f1a8cb8cb54f3f21f37)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:11.011532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137faf1-1c01-45ac-b2aa-380781107d8c None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:11.014283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 122/242] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:10 2022] GET /identity/v3/users/a1db5b57376b4f1a8cb8cb54f3f21f37 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:11.020121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137faf1-1c01-45ac-b2aa-380781107d8c None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:11.084586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309d5f8-4f61-4bef-9a0d-26b2822b367b None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:11.134784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e67e21-3150-4e27-b2b8-0e776016fec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:11.135465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e67e21-3150-4e27-b2b8-0e776016fec1 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:11.135749 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e67e21-3150-4e27-b2b8-0e776016fec1 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:11.136024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e67e21-3150-4e27-b2b8-0e776016fec1 None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:11.136739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e67e21-3150-4e27-b2b8-0e776016fec1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:11.138188 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e67e21-3150-4e27-b2b8-0e776016fec1 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:11.156614 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137faf1-1c01-45ac-b2aa-380781107d8c None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:11.197236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12f3b6-b668-476b-afe5-72e4d4042df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:11.197991 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12f3b6-b668-476b-afe5-72e4d4042df3 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:11.198282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12f3b6-b668-476b-afe5-72e4d4042df3 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:11.198586 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12f3b6-b668-476b-afe5-72e4d4042df3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:11.255408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 121/243] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:33:10 2022] POST /identity/v3/users => generated 294 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:33:11.257469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4cd1c-f5be-47f3-87ff-bd76ea634ef3 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:11.257819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4cd1c-f5be-47f3-87ff-bd76ea634ef3 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:11.258145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4cd1c-f5be-47f3-87ff-bd76ea634ef3 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:11.259918 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 122/244] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:11.269780 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25354b-3338-4588-8d71-e76f83c5f980 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:11.269780 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25354b-3338-4588-8d71-e76f83c5f980 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:11.269780 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25354b-3338-4588-8d71-e76f83c5f980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:11.288528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:11.293267 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-aa25354b-3338-4588-8d71-e76f83c5f980 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:11.294976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-aa25354b-3338-4588-8d71-e76f83c5f980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:11.315532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12f3b6-b668-476b-afe5-72e4d4042df3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:11.317230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12f3b6-b668-476b-afe5-72e4d4042df3 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:11.440198 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 123/245] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:11.473969 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25354b-3338-4588-8d71-e76f83c5f980 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:11.500364 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:11.515431 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 123/246] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:11 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:33:11.521257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12f3b6-b668-476b-afe5-72e4d4042df3 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:11.630310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25354b-3338-4588-8d71-e76f83c5f980 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:11.668127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:11.682624 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12f3b6-b668-476b-afe5-72e4d4042df3 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:11.687938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e771a24-bae8-49ad-adba-52acbacdfa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:11.691997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e771a24-bae8-49ad-adba-52acbacdfa5d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:11.692358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e771a24-bae8-49ad-adba-52acbacdfa5d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:11.692650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e771a24-bae8-49ad-adba-52acbacdfa5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:11.714937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e771a24-bae8-49ad-adba-52acbacdfa5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-5e771a24-bae8-49ad-adba-52acbacdfa5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:11.727484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:11.729161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:11.730713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:11.730713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:11.730713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:11.730713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:11.730713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:11.730713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:11.730713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:11.730713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:11.730713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:11.730713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:11.730713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:11.730713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:11.730713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 124/247] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:33:11.741626 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e771a24-bae8-49ad-adba-52acbacdfa5d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:11.755597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a9e49-2266-4819-9e2a-03ffcc379f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:11.758527 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a9e49-2266-4819-9e2a-03ffcc379f83 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:11.760092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a9e49-2266-4819-9e2a-03ffcc379f83 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:11.761252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a9e49-2266-4819-9e2a-03ffcc379f83 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:11.765822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a9e49-2266-4819-9e2a-03ffcc379f83 None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:11.770309 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a9e49-2266-4819-9e2a-03ffcc379f83 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:11.774488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 124/248] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:11 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:11.780476 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a9e49-2266-4819-9e2a-03ffcc379f83 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:11.904479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:11.945084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e771a24-bae8-49ad-adba-52acbacdfa5d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:12.004661 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a9e49-2266-4819-9e2a-03ffcc379f83 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:12.013319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2803b40-0f50-43bc-a2ad-cb9df6ab7c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:12.014522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2803b40-0f50-43bc-a2ad-cb9df6ab7c2d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:12.015273 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2803b40-0f50-43bc-a2ad-cb9df6ab7c2d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:12.015680 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2803b40-0f50-43bc-a2ad-cb9df6ab7c2d None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:12.016923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2803b40-0f50-43bc-a2ad-cb9df6ab7c2d None admin] RBAC: Adding query filter params (name=member) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:12.017180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2803b40-0f50-43bc-a2ad-cb9df6ab7c2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:12.018666 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2803b40-0f50-43bc-a2ad-cb9df6ab7c2d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:12.029739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 125/249] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:11 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:12.035563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2803b40-0f50-43bc-a2ad-cb9df6ab7c2d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:12.172314 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd8fdb-a92d-491e-8ab0-66790034c2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:12.173615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd8fdb-a92d-491e-8ab0-66790034c2db None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:12.174268 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd8fdb-a92d-491e-8ab0-66790034c2db None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:12.174769 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd8fdb-a92d-491e-8ab0-66790034c2db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:12.175824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd8fdb-a92d-491e-8ab0-66790034c2db None admin] RBAC: Adding query filter params (role.id=88d17c94ac464961ba0635bbb0d74025, scope.project.id=9dd29f6d3b974bff8206091ffee50316, user.id=a1db5b57376b4f1a8cb8cb54f3f21f37) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:12.176523 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd8fdb-a92d-491e-8ab0-66790034c2db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:12.178226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd8fdb-a92d-491e-8ab0-66790034c2db None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:12.187752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 125/250] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:33:11 2022] GET /identity/v3/role_assignments?user.id=a1db5b57376b4f1a8cb8cb54f3f21f37&scope.project.id=9dd29f6d3b974bff8206091ffee50316&role.id=88d17c94ac464961ba0635bbb0d74025 => generated 260 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:12.190879 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efa4d2-be3d-4c60-8915-2222ea6602e2 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:12.191428 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efa4d2-be3d-4c60-8915-2222ea6602e2 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:12.191938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efa4d2-be3d-4c60-8915-2222ea6602e2 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:12.200698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 126/251] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:12 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:12.210541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420546a-2f82-40cf-8bf8-f78998dcf858 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:12.211159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420546a-2f82-40cf-8bf8-f78998dcf858 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:12.211722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420546a-2f82-40cf-8bf8-f78998dcf858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:12.242508 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-7420546a-2f82-40cf-8bf8-f78998dcf858 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:12.244921 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7420546a-2f82-40cf-8bf8-f78998dcf858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:12.281156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:12.405593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 127/252] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:12.480655 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420546a-2f82-40cf-8bf8-f78998dcf858 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:12.486254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2803b40-0f50-43bc-a2ad-cb9df6ab7c2d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:12.601422 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd40e4-882b-4ac2-bfa3-a3c2d5bf6422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:12.603623 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd40e4-882b-4ac2-bfa3-a3c2d5bf6422 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:12.604112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd40e4-882b-4ac2-bfa3-a3c2d5bf6422 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:12.604579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd40e4-882b-4ac2-bfa3-a3c2d5bf6422 None admin] PATH_INFO: `/v3/users/c9dcd8b95de841548d36025c4bbc1899` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:12.606081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd40e4-882b-4ac2-bfa3-a3c2d5bf6422 None admin] RBAC: Authorizing `identity:get_user(user_id=c9dcd8b95de841548d36025c4bbc1899)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:12.609588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd40e4-882b-4ac2-bfa3-a3c2d5bf6422 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:12.618351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 126/253] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:12 2022] GET /identity/v3/users/c9dcd8b95de841548d36025c4bbc1899 => generated 298 bytes in 577 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:12.618827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd40e4-882b-4ac2-bfa3-a3c2d5bf6422 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:12.654839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:12.782445 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420546a-2f82-40cf-8bf8-f78998dcf858 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:12.831354 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd40e4-882b-4ac2-bfa3-a3c2d5bf6422 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:12.859311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759ef5-a0c0-4711-a9c4-c5c45152a0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:12.860596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759ef5-a0c0-4711-a9c4-c5c45152a0ff None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:12.861038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759ef5-a0c0-4711-a9c4-c5c45152a0ff None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:12.861548 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759ef5-a0c0-4711-a9c4-c5c45152a0ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:12.886854 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2ef20-80d2-4855-8e70-6d47bc8b8378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:12.888186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2ef20-80d2-4855-8e70-6d47bc8b8378 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:12.889215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2ef20-80d2-4855-8e70-6d47bc8b8378 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:12.889712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2ef20-80d2-4855-8e70-6d47bc8b8378 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:12.898357 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2ef20-80d2-4855-8e70-6d47bc8b8378 None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:12.900430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2ef20-80d2-4855-8e70-6d47bc8b8378 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:12.900790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59759ef5-a0c0-4711-a9c4-c5c45152a0ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:12.903888 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 127/254] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:12 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:12.911883 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2ef20-80d2-4855-8e70-6d47bc8b8378 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-59759ef5-a0c0-4711-a9c4-c5c45152a0ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:12.916129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:12.917047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:12.917821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:12.917821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:12.917821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:12.917821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:12.917821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:12.917821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:12.917821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:12.917821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:12.917821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:12.917821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:12.917821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:12.917821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:12.926550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 128/255] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:33:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:33:12.934347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759ef5-a0c0-4711-a9c4-c5c45152a0ff None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:12.987575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:13.088314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:13.119137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2ef20-80d2-4855-8e70-6d47bc8b8378 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:13.160868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b947ff-e20b-4622-8de9-126a8bc9a30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:13.162247 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b947ff-e20b-4622-8de9-126a8bc9a30b None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:13.162750 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b947ff-e20b-4622-8de9-126a8bc9a30b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:13.163244 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b947ff-e20b-4622-8de9-126a8bc9a30b None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316/users/c9dcd8b95de841548d36025c4bbc1899/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:13.165659 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b947ff-e20b-4622-8de9-126a8bc9a30b None admin] RBAC: Authorizing `identity:create_grant(project_id=9dd29f6d3b974bff8206091ffee50316, user_id=c9dcd8b95de841548d36025c4bbc1899, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:13.167410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b947ff-e20b-4622-8de9-126a8bc9a30b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:13.237714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759ef5-a0c0-4711-a9c4-c5c45152a0ff None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:13.303602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee559140-fc8a-4d01-9844-a6c7db465f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:13.304300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee559140-fc8a-4d01-9844-a6c7db465f7d None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:13.304587 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee559140-fc8a-4d01-9844-a6c7db465f7d None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:13.304938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee559140-fc8a-4d01-9844-a6c7db465f7d None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:13.305706 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee559140-fc8a-4d01-9844-a6c7db465f7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:13.306073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee559140-fc8a-4d01-9844-a6c7db465f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:13.307702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee559140-fc8a-4d01-9844-a6c7db465f7d None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:13.318305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 129/256] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:12 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:13.325179 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee559140-fc8a-4d01-9844-a6c7db465f7d None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:13.340108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 128/257] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:33:12 2022] PUT /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316/users/c9dcd8b95de841548d36025c4bbc1899/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:33:13.418159 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0086f4-c467-49c8-90e8-b5438292a391 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:13.418609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0086f4-c467-49c8-90e8-b5438292a391 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:13.418762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0086f4-c467-49c8-90e8-b5438292a391 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:13.420403 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 129/258] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:13.426487 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b4c0c-22f3-4d61-95cb-5769499dbbba None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:13.427103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b4c0c-22f3-4d61-95cb-5769499dbbba None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:13.427606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b4c0c-22f3-4d61-95cb-5769499dbbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:13.454158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-a10b4c0c-22f3-4d61-95cb-5769499dbbba None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:13.456701 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:13.460136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a10b4c0c-22f3-4d61-95cb-5769499dbbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:13.519198 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee559140-fc8a-4d01-9844-a6c7db465f7d None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:13.610501 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 130/259] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:13.618084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54791348-fcea-43b0-8cd7-a03f918f3ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:13.619039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54791348-fcea-43b0-8cd7-a03f918f3ce8 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:13.619325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54791348-fcea-43b0-8cd7-a03f918f3ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:13.619605 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54791348-fcea-43b0-8cd7-a03f918f3ce8 None admin] PATH_INFO: `/v3/users/edbff1b5ed2e40239b731fb971bfa4e5` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:13.627826 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54791348-fcea-43b0-8cd7-a03f918f3ce8 None admin] RBAC: Authorizing `identity:get_user(user_id=edbff1b5ed2e40239b731fb971bfa4e5)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:13.630627 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54791348-fcea-43b0-8cd7-a03f918f3ce8 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:13.633858 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 130/260] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:13 2022] GET /identity/v3/users/edbff1b5ed2e40239b731fb971bfa4e5 => generated 284 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:13.641727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b4c0c-22f3-4d61-95cb-5769499dbbba None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:13.695332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54791348-fcea-43b0-8cd7-a03f918f3ce8 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:13.781791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:13.877919 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b4c0c-22f3-4d61-95cb-5769499dbbba None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:13.924075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0438e0-5a27-4e31-ac3b-4faf8b7b3638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:13.925892 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0438e0-5a27-4e31-ac3b-4faf8b7b3638 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:13.926414 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0438e0-5a27-4e31-ac3b-4faf8b7b3638 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:13.926971 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0438e0-5a27-4e31-ac3b-4faf8b7b3638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:13.961017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54791348-fcea-43b0-8cd7-a03f918f3ce8 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:14.023922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0438e0-5a27-4e31-ac3b-4faf8b7b3638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:14.025771 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0438e0-5a27-4e31-ac3b-4faf8b7b3638 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:14.050410 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00993210-ceba-4ecd-bc72-909b9ffaff79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:14.051326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00993210-ceba-4ecd-bc72-909b9ffaff79 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:14.051619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00993210-ceba-4ecd-bc72-909b9ffaff79 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:14.051904 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00993210-ceba-4ecd-bc72-909b9ffaff79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:14.077872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00993210-ceba-4ecd-bc72-909b9ffaff79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-00993210-ceba-4ecd-bc72-909b9ffaff79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:14.086955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:14.087866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:14.088930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:14.088930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:14.088930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:14.088930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:14.088930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:14.088930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:14.088930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:14.088930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:14.088930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:14.088930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:14.088930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:14.088930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:14.088930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 131/261] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:33:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:14.100021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00993210-ceba-4ecd-bc72-909b9ffaff79 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:14.114242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:14.155657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:14.306352 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 131/262] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:14.320593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0438e0-5a27-4e31-ac3b-4faf8b7b3638 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:14.485461 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00993210-ceba-4ecd-bc72-909b9ffaff79 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:14.570514 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0438e0-5a27-4e31-ac3b-4faf8b7b3638 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:14.593932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0d1e9-fe76-426c-b576-5db0cda99873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:14.594688 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0d1e9-fe76-426c-b576-5db0cda99873 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:14.594983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0d1e9-fe76-426c-b576-5db0cda99873 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:14.595267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0d1e9-fe76-426c-b576-5db0cda99873 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:14.596046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0d1e9-fe76-426c-b576-5db0cda99873 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:14.596360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0d1e9-fe76-426c-b576-5db0cda99873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:14.597988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0d1e9-fe76-426c-b576-5db0cda99873 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:14.615756 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 132/263] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:33:14 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:14.624132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0d1e9-fe76-426c-b576-5db0cda99873 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:14.650355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6252b9-de3a-4b94-b21d-adf29dfc079f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:14.652327 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6252b9-de3a-4b94-b21d-adf29dfc079f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:14.653017 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6252b9-de3a-4b94-b21d-adf29dfc079f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:14.655165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6252b9-de3a-4b94-b21d-adf29dfc079f None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:14.657878 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6252b9-de3a-4b94-b21d-adf29dfc079f None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:14.661606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6252b9-de3a-4b94-b21d-adf29dfc079f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:14.666594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 132/264] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:14 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:14.682680 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6252b9-de3a-4b94-b21d-adf29dfc079f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:14.778257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:14.826860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:14.844815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6252b9-de3a-4b94-b21d-adf29dfc079f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:14.879522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0d1e9-fe76-426c-b576-5db0cda99873 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:14.924752 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c39dc-d6f9-456d-97df-ade7cc6956d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:14.925419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c39dc-d6f9-456d-97df-ade7cc6956d8 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:14.925704 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c39dc-d6f9-456d-97df-ade7cc6956d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:14.925983 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c39dc-d6f9-456d-97df-ade7cc6956d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:14.926860 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c39dc-d6f9-456d-97df-ade7cc6956d8 None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=9dd29f6d3b974bff8206091ffee50316, user.id=edbff1b5ed2e40239b731fb971bfa4e5) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:14.927175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c39dc-d6f9-456d-97df-ade7cc6956d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:14.928638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c39dc-d6f9-456d-97df-ade7cc6956d8 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:14.941526 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 133/265] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:33:14 2022] GET /identity/v3/role_assignments?user.id=edbff1b5ed2e40239b731fb971bfa4e5&scope.project.id=9dd29f6d3b974bff8206091ffee50316&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 610 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:14.957825 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62018ccb-b856-481f-9058-e7299a48fd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:14.959365 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62018ccb-b856-481f-9058-e7299a48fd13 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:14.959529 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62018ccb-b856-481f-9058-e7299a48fd13 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:14.959791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62018ccb-b856-481f-9058-e7299a48fd13 None admin] PATH_INFO: `/v3/users/edbff1b5ed2e40239b731fb971bfa4e5` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:14.968191 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62018ccb-b856-481f-9058-e7299a48fd13 None admin] RBAC: Authorizing `identity:get_user(user_id=edbff1b5ed2e40239b731fb971bfa4e5)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:14.970918 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62018ccb-b856-481f-9058-e7299a48fd13 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:14.974303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 133/266] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:14 2022] GET /identity/v3/users/edbff1b5ed2e40239b731fb971bfa4e5 => generated 284 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:14.982861 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c39dc-d6f9-456d-97df-ade7cc6956d8 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:15.150881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:15.158778 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c39dc-d6f9-456d-97df-ade7cc6956d8 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:15.206502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e837f-bd93-474c-9da4-1fce151758f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:15.206502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e837f-bd93-474c-9da4-1fce151758f9 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:15.206502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e837f-bd93-474c-9da4-1fce151758f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:15.206502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e837f-bd93-474c-9da4-1fce151758f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:15.314181 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e837f-bd93-474c-9da4-1fce151758f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:15.315711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e837f-bd93-474c-9da4-1fce151758f9 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:15.460773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:15.465276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 134/267] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:14 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:33:15.496005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62018ccb-b856-481f-9058-e7299a48fd13 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:15.621396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62018ccb-b856-481f-9058-e7299a48fd13 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:15.658470 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b7fcf-30d7-4089-995a-9b798ccb68f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:15.659362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b7fcf-30d7-4089-995a-9b798ccb68f6 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:15.659644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b7fcf-30d7-4089-995a-9b798ccb68f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:15.659927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b7fcf-30d7-4089-995a-9b798ccb68f6 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:15.661156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b7fcf-30d7-4089-995a-9b798ccb68f6 None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:15.662794 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b7fcf-30d7-4089-995a-9b798ccb68f6 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:15.664848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 134/268] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:15 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:15.673683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e837f-bd93-474c-9da4-1fce151758f9 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:15.809209 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e837f-bd93-474c-9da4-1fce151758f9 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:15.860835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee0a4f-9f98-4668-a5ea-ac89ca360fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:15.861862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee0a4f-9f98-4668-a5ea-ac89ca360fdc None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:15.861862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee0a4f-9f98-4668-a5ea-ac89ca360fdc None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:15.862138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee0a4f-9f98-4668-a5ea-ac89ca360fdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:15.863164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee0a4f-9f98-4668-a5ea-ac89ca360fdc None admin] RBAC: Adding query filter params (role.id=0449b3526e454e9ea05258c90de6de31, scope.project.id=9dd29f6d3b974bff8206091ffee50316, user.id=edbff1b5ed2e40239b731fb971bfa4e5) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:15.863472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee0a4f-9f98-4668-a5ea-ac89ca360fdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:15.865150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee0a4f-9f98-4668-a5ea-ac89ca360fdc None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:15.876868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 135/269] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:33:15 2022] GET /identity/v3/role_assignments?user.id=edbff1b5ed2e40239b731fb971bfa4e5&scope.project.id=9dd29f6d3b974bff8206091ffee50316&role.id=0449b3526e454e9ea05258c90de6de31 => generated 610 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:15.908397 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9be9de-92a7-4372-b081-96767da67952 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:15.909321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9be9de-92a7-4372-b081-96767da67952 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:15.910087 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9be9de-92a7-4372-b081-96767da67952 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:15.913820 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 135/270] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:15 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:33:15.923454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39dd78-274a-456d-a8c4-e7d88f9521b9 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:15.925058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39dd78-274a-456d-a8c4-e7d88f9521b9 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:15.925058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39dd78-274a-456d-a8c4-e7d88f9521b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:15.947314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-cc39dd78-274a-456d-a8c4-e7d88f9521b9 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:15.948718 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-cc39dd78-274a-456d-a8c4-e7d88f9521b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:16.027639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:16.039965 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 136/271] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:15 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:16.113087 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d9324-8cf6-4e98-81d4-d38f67f4e51f None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:16.113326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d9324-8cf6-4e98-81d4-d38f67f4e51f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:16.113753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d9324-8cf6-4e98-81d4-d38f67f4e51f None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:16.115552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 136/272] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:16.118453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39dd78-274a-456d-a8c4-e7d88f9521b9 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:16.132809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952a13a-bfc5-45bb-a77b-24b9ebf51ee3 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:16.133328 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952a13a-bfc5-45bb-a77b-24b9ebf51ee3 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:16.133837 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952a13a-bfc5-45bb-a77b-24b9ebf51ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:16.141250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:16.163813 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-8952a13a-bfc5-45bb-a77b-24b9ebf51ee3 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:16.168795 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8952a13a-bfc5-45bb-a77b-24b9ebf51ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:16.279458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 137/273] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:16.282980 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f2139-e1b8-4ac9-b8e8-febd1c09e15e None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:16.283745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f2139-e1b8-4ac9-b8e8-febd1c09e15e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:16.284344 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f2139-e1b8-4ac9-b8e8-febd1c09e15e None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:16.286928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 138/274] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:16 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:16.297794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39dd78-274a-456d-a8c4-e7d88f9521b9 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:16.298600 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52e9a-fbb6-41dc-88ba-929b04eaf4b5 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:16.299123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52e9a-fbb6-41dc-88ba-929b04eaf4b5 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:16.300522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52e9a-fbb6-41dc-88ba-929b04eaf4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:16.324220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-4df52e9a-fbb6-41dc-88ba-929b04eaf4b5 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:16.324220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4df52e9a-fbb6-41dc-88ba-929b04eaf4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:16.354311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac269274-e07c-49f4-ad62-ab1186706558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:16.356178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac269274-e07c-49f4-ad62-ab1186706558 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:16.356682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac269274-e07c-49f4-ad62-ab1186706558 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:16.357420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac269274-e07c-49f4-ad62-ab1186706558 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:16.361992 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac269274-e07c-49f4-ad62-ab1186706558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:16.364963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac269274-e07c-49f4-ad62-ab1186706558 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:16.370695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 137/275] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:16 2022] GET /identity/v3/domains/default => generated 200 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:16.371579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac269274-e07c-49f4-ad62-ab1186706558 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:16.417974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 139/276] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:16.430363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df52e9a-fbb6-41dc-88ba-929b04eaf4b5 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:16.467491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:16.514988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:16.528721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac269274-e07c-49f4-ad62-ab1186706558 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:16.561064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df52e9a-fbb6-41dc-88ba-929b04eaf4b5 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:16.571783 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9725a2-629d-4b41-89d1-dd60b674d8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:16.572593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9725a2-629d-4b41-89d1-dd60b674d8cb None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:16.572877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9725a2-629d-4b41-89d1-dd60b674d8cb None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:16.573150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9725a2-629d-4b41-89d1-dd60b674d8cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:16.585359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9725a2-629d-4b41-89d1-dd60b674d8cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-7a9725a2-629d-4b41-89d1-dd60b674d8cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:16.593922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:16.595003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:16.595923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:16.595923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:16.595923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:16.595923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:16.595923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:16.595923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:16.595923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:16.595923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:16.595923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:16.595923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:16.595923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:33:16.595923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:16.595923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 138/277] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:16.596629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9725a2-629d-4b41-89d1-dd60b674d8cb None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:16.616498 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587421a9-3a02-4e9d-a9ce-ed54946e1979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:16.617156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587421a9-3a02-4e9d-a9ce-ed54946e1979 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:16.617667 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587421a9-3a02-4e9d-a9ce-ed54946e1979 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:16.618177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587421a9-3a02-4e9d-a9ce-ed54946e1979 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:16.619551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587421a9-3a02-4e9d-a9ce-ed54946e1979 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:16.621418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587421a9-3a02-4e9d-a9ce-ed54946e1979 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:16.733621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9725a2-629d-4b41-89d1-dd60b674d8cb None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:16.756910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:16.771763 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9543dd0-ab6e-4d71-8ead-b36ec89d04c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:16.772604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9543dd0-ab6e-4d71-8ead-b36ec89d04c9 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:16.772891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9543dd0-ab6e-4d71-8ead-b36ec89d04c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:16.773267 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9543dd0-ab6e-4d71-8ead-b36ec89d04c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:16.786584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 140/278] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:33:16 2022] POST /identity/v3/users => generated 294 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:33:16.786584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587421a9-3a02-4e9d-a9ce-ed54946e1979 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:16.796739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9543dd0-ab6e-4d71-8ead-b36ec89d04c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-f9543dd0-ab6e-4d71-8ead-b36ec89d04c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:16.805268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:16.862201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:16.863074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:16.863074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:16.863074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:16.863074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:16.863074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:16.863074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:16.863074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:16.863074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:16.863074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:16.863074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:16.863074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:16.863074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:16.863074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 139/279] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:16.863074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9543dd0-ab6e-4d71-8ead-b36ec89d04c9 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:16.937459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587421a9-3a02-4e9d-a9ce-ed54946e1979 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:16.962913 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:16.976640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9543dd0-ab6e-4d71-8ead-b36ec89d04c9 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:16.994517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32b280-2ac9-4ea6-8739-0bcd8fc28dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:16.995922 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32b280-2ac9-4ea6-8739-0bcd8fc28dc3 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:16.999230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32b280-2ac9-4ea6-8739-0bcd8fc28dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:16.999230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32b280-2ac9-4ea6-8739-0bcd8fc28dc3 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:16.999230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32b280-2ac9-4ea6-8739-0bcd8fc28dc3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:16.999230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32b280-2ac9-4ea6-8739-0bcd8fc28dc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:17.001848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32b280-2ac9-4ea6-8739-0bcd8fc28dc3 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:17.016680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 141/280] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:16 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:17.021249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3166ca-1037-44e6-9102-3b6371783329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:17.021976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3166ca-1037-44e6-9102-3b6371783329 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:17.022264 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3166ca-1037-44e6-9102-3b6371783329 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:17.023014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3166ca-1037-44e6-9102-3b6371783329 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:17.023818 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3166ca-1037-44e6-9102-3b6371783329 None admin] RBAC: Adding query filter params (name=member) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:17.024135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3166ca-1037-44e6-9102-3b6371783329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:17.024416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32b280-2ac9-4ea6-8739-0bcd8fc28dc3 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:17.025580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3166ca-1037-44e6-9102-3b6371783329 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:17.040533 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 140/281] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:16 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:17.047291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3166ca-1037-44e6-9102-3b6371783329 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:17.134103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:17.183710 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32b280-2ac9-4ea6-8739-0bcd8fc28dc3 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:17.233497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3166ca-1037-44e6-9102-3b6371783329 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:17.259183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1b814-652f-4dc4-8ee1-51819f5d251e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:17.259183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1b814-652f-4dc4-8ee1-51819f5d251e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:17.259183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1b814-652f-4dc4-8ee1-51819f5d251e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:17.259694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1b814-652f-4dc4-8ee1-51819f5d251e None admin] PATH_INFO: `/v3/users/a1db5b57376b4f1a8cb8cb54f3f21f37` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:17.261744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1b814-652f-4dc4-8ee1-51819f5d251e None admin] RBAC: Authorizing `identity:get_user(user_id=a1db5b57376b4f1a8cb8cb54f3f21f37)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:17.264181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1b814-652f-4dc4-8ee1-51819f5d251e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:17.267392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 142/282] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:17 2022] GET /identity/v3/users/a1db5b57376b4f1a8cb8cb54f3f21f37 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:17.269680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491713c-e5a2-478d-868f-72711d0b4841 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:17.269968 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491713c-e5a2-478d-868f-72711d0b4841 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:17.270538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491713c-e5a2-478d-868f-72711d0b4841 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:17.274702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 143/283] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:17 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:17.275967 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491713c-e5a2-478d-868f-72711d0b4841 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:17.277481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5adff-d0a0-46df-a714-6fe7114daf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:17.278945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5adff-d0a0-46df-a714-6fe7114daf48 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:17.279229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5adff-d0a0-46df-a714-6fe7114daf48 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:17.279500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5adff-d0a0-46df-a714-6fe7114daf48 None admin] PATH_INFO: `/v3/users/c72b92e901934a1b9521e25e6dcb40ee` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:17.296868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5adff-d0a0-46df-a714-6fe7114daf48 None admin] RBAC: Authorizing `identity:get_user(user_id=c72b92e901934a1b9521e25e6dcb40ee)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:17.298416 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5adff-d0a0-46df-a714-6fe7114daf48 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:17.300369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 141/284] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:17 2022] GET /identity/v3/users/c72b92e901934a1b9521e25e6dcb40ee => generated 294 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:17.301434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc285c46-e009-4cf8-8e53-33a9e546ff9a None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:17.301721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc285c46-e009-4cf8-8e53-33a9e546ff9a None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:17.302005 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc285c46-e009-4cf8-8e53-33a9e546ff9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:17.324345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-fc285c46-e009-4cf8-8e53-33a9e546ff9a None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:17.325879 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-fc285c46-e009-4cf8-8e53-33a9e546ff9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:17.353261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:17.417506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491713c-e5a2-478d-868f-72711d0b4841 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:17.437455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 142/285] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:17.444551 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc285c46-e009-4cf8-8e53-33a9e546ff9a None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:17.465006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bb3db-e94b-4e94-9d1a-feb016be5feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:17.465781 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bb3db-e94b-4e94-9d1a-feb016be5feb None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:17.466082 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bb3db-e94b-4e94-9d1a-feb016be5feb None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:17.466445 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bb3db-e94b-4e94-9d1a-feb016be5feb None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:17.467787 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bb3db-e94b-4e94-9d1a-feb016be5feb None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:17.469280 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bb3db-e94b-4e94-9d1a-feb016be5feb None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:17.471070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 144/286] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:17 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:17.479476 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bb3db-e94b-4e94-9d1a-feb016be5feb None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:17.517102 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:17.636197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bb3db-e94b-4e94-9d1a-feb016be5feb None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:17.637416 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc285c46-e009-4cf8-8e53-33a9e546ff9a None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:17.662509 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:17.677022 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c6574-94c2-49a6-9fe7-65c1dcd3072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:17.677819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c6574-94c2-49a6-9fe7-65c1dcd3072e None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:17.683799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c6574-94c2-49a6-9fe7-65c1dcd3072e None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:17.683799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c6574-94c2-49a6-9fe7-65c1dcd3072e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:17.683799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c6574-94c2-49a6-9fe7-65c1dcd3072e None admin] RBAC: Adding query filter params (role.id=5a16a034a01e45b89530e8dd35d56588, user.id=c72b92e901934a1b9521e25e6dcb40ee, scope.system=all) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:17.684092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df6cd6-dfab-42ea-973f-68f400695299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:17.684207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c6574-94c2-49a6-9fe7-65c1dcd3072e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:17.684342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df6cd6-dfab-42ea-973f-68f400695299 None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:17.684342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df6cd6-dfab-42ea-973f-68f400695299 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:17.684342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df6cd6-dfab-42ea-973f-68f400695299 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316/users/a1db5b57376b4f1a8cb8cb54f3f21f37/roles/88d17c94ac464961ba0635bbb0d74025` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:17.684564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c6574-94c2-49a6-9fe7-65c1dcd3072e None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:17.684732 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df6cd6-dfab-42ea-973f-68f400695299 None admin] RBAC: Authorizing `identity:create_grant(project_id=9dd29f6d3b974bff8206091ffee50316, user_id=a1db5b57376b4f1a8cb8cb54f3f21f37, role_id=88d17c94ac464961ba0635bbb0d74025)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:17.687240 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df6cd6-dfab-42ea-973f-68f400695299 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:17.697092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 143/287] 10.222.0.112 () {56 vars in 1313 bytes} [Thu May 26 16:33:17 2022] GET /identity/v3/role_assignments?user.id=c72b92e901934a1b9521e25e6dcb40ee&scope.system=all&role.id=5a16a034a01e45b89530e8dd35d56588 => generated 227 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:17.697092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c6574-94c2-49a6-9fe7-65c1dcd3072e None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:17.789200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 145/288] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:33:17 2022] PUT /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316/users/a1db5b57376b4f1a8cb8cb54f3f21f37/roles/88d17c94ac464961ba0635bbb0d74025 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:33:17.841126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:17.850725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c6574-94c2-49a6-9fe7-65c1dcd3072e None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:17.908088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fce10-0d26-42f2-9a87-55d4d6038d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:17.909006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fce10-0d26-42f2-9a87-55d4d6038d4c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:17.909332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fce10-0d26-42f2-9a87-55d4d6038d4c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:17.909507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fce10-0d26-42f2-9a87-55d4d6038d4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:17.923069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fce10-0d26-42f2-9a87-55d4d6038d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-606fce10-0d26-42f2-9a87-55d4d6038d4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:17.931178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:17.932157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:17.933737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:17.933737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:17.933737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:17.933737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:17.933737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:17.933737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:17.933737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:17.933737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:17.933737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:17.933737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:17.933737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:17.933737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:17.933737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 144/289] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:17.939625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df6cd6-dfab-42ea-973f-68f400695299 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:18.107490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df6cd6-dfab-42ea-973f-68f400695299 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:18.163000 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd682b2-c4c3-4662-bde1-f29d65b48407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:18.163683 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd682b2-c4c3-4662-bde1-f29d65b48407 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:18.163965 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd682b2-c4c3-4662-bde1-f29d65b48407 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:18.164239 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd682b2-c4c3-4662-bde1-f29d65b48407 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:18.164996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd682b2-c4c3-4662-bde1-f29d65b48407 None admin] RBAC: Adding query filter params (name=member) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:18.165302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd682b2-c4c3-4662-bde1-f29d65b48407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:18.166742 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd682b2-c4c3-4662-bde1-f29d65b48407 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:18.177618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 146/290] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:17 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:18.186152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fce10-0d26-42f2-9a87-55d4d6038d4c None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:18.328910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fce10-0d26-42f2-9a87-55d4d6038d4c None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:18.386452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecf91f-6fe9-436f-8073-8e60f0e38d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:18.387490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecf91f-6fe9-436f-8073-8e60f0e38d02 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:18.387905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecf91f-6fe9-436f-8073-8e60f0e38d02 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:18.388880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecf91f-6fe9-436f-8073-8e60f0e38d02 None admin] PATH_INFO: `/v3/users/c9dcd8b95de841548d36025c4bbc1899` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:18.393006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecf91f-6fe9-436f-8073-8e60f0e38d02 None admin] RBAC: Authorizing `identity:get_user(user_id=c9dcd8b95de841548d36025c4bbc1899)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:18.394498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecf91f-6fe9-436f-8073-8e60f0e38d02 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:18.396482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 145/291] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:18 2022] GET /identity/v3/users/c9dcd8b95de841548d36025c4bbc1899 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:18.401923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd682b2-c4c3-4662-bde1-f29d65b48407 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:18.462546 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:18.556597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd682b2-c4c3-4662-bde1-f29d65b48407 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:18.610795 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c77111-ee02-4ebb-9dbf-3c1070b8065c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:18.611468 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c77111-ee02-4ebb-9dbf-3c1070b8065c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:18.611753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c77111-ee02-4ebb-9dbf-3c1070b8065c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:18.612033 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c77111-ee02-4ebb-9dbf-3c1070b8065c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:18.708561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c77111-ee02-4ebb-9dbf-3c1070b8065c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:18.710041 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c77111-ee02-4ebb-9dbf-3c1070b8065c None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:18.773827 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:18.860169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 147/292] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:18 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:18.865692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecf91f-6fe9-436f-8073-8e60f0e38d02 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:18.902363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:19.016643 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecf91f-6fe9-436f-8073-8e60f0e38d02 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:19.065624 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa09c7-5f41-4c08-8390-486e382bbe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:19.066543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa09c7-5f41-4c08-8390-486e382bbe82 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:19.066827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa09c7-5f41-4c08-8390-486e382bbe82 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:19.067105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa09c7-5f41-4c08-8390-486e382bbe82 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:19.068355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa09c7-5f41-4c08-8390-486e382bbe82 None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:19.070076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa09c7-5f41-4c08-8390-486e382bbe82 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:19.071925 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 146/293] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:18 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:19.078904 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c77111-ee02-4ebb-9dbf-3c1070b8065c None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:19.210815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c77111-ee02-4ebb-9dbf-3c1070b8065c None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:19.268715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff577c-ae4a-4dd0-8985-7b1c84bffe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:19.269298 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff577c-ae4a-4dd0-8985-7b1c84bffe74 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:19.269616 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff577c-ae4a-4dd0-8985-7b1c84bffe74 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:19.269897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff577c-ae4a-4dd0-8985-7b1c84bffe74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:19.270829 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff577c-ae4a-4dd0-8985-7b1c84bffe74 None admin] RBAC: Adding query filter params (role.id=5a16a034a01e45b89530e8dd35d56588, scope.project.id=9dd29f6d3b974bff8206091ffee50316, user.id=c9dcd8b95de841548d36025c4bbc1899) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:19.271192 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff577c-ae4a-4dd0-8985-7b1c84bffe74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:19.272732 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff577c-ae4a-4dd0-8985-7b1c84bffe74 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:19.280809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 148/294] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:33:19 2022] GET /identity/v3/role_assignments?user.id=c9dcd8b95de841548d36025c4bbc1899&scope.project.id=9dd29f6d3b974bff8206091ffee50316&role.id=5a16a034a01e45b89530e8dd35d56588 => generated 610 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:19.860169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c0a88-2707-450d-8c93-fe756df35d6b None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:19.860547 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c0a88-2707-450d-8c93-fe756df35d6b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:19.861002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c0a88-2707-450d-8c93-fe756df35d6b None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:19.863497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 147/295] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:19.873036 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02378b51-7b09-4b8e-ab29-3c77cce3cb6e None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:19.873762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02378b51-7b09-4b8e-ab29-3c77cce3cb6e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:19.873913 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02378b51-7b09-4b8e-ab29-3c77cce3cb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:19.879266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:19.895982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-02378b51-7b09-4b8e-ab29-3c77cce3cb6e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:19.897805 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-02378b51-7b09-4b8e-ab29-3c77cce3cb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:19.991624 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 149/296] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:20.017544 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c0a88-2707-450d-8c93-fe756df35d6b None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:20.129608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:20.141498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c0a88-2707-450d-8c93-fe756df35d6b None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:20.168574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a3850-7730-4c18-a87d-d133716598b5 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.169091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a3850-7730-4c18-a87d-d133716598b5 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.169279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a3850-7730-4c18-a87d-d133716598b5 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.170931 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 150/297] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:20.176527 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc26f8-fddb-45cc-a2cf-5d8369a58bcb None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.176798 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc26f8-fddb-45cc-a2cf-5d8369a58bcb None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.177134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc26f8-fddb-45cc-a2cf-5d8369a58bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.181782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0662f2-c360-438f-9047-105212db6b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:20.182827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0662f2-c360-438f-9047-105212db6b50 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.184010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0662f2-c360-438f-9047-105212db6b50 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.184290 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0662f2-c360-438f-9047-105212db6b50 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.197796 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0662f2-c360-438f-9047-105212db6b50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:20.198313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-eafc26f8-fddb-45cc-a2cf-5d8369a58bcb None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:20.199885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-eafc26f8-fddb-45cc-a2cf-5d8369a58bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-9d0662f2-c360-438f-9047-105212db6b50 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:20.207865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:20.208821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:20.209606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:20.209606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:20.209606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:20.209606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:20.209606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:20.209606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:20.209606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:20.209606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:20.209606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:20.209606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:20.209606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:33:20.209606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:20.209606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 148/298] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:20.216867 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0662f2-c360-438f-9047-105212db6b50 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:20.284666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 151/299] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:20.308131 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc26f8-fddb-45cc-a2cf-5d8369a58bcb None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:20.345936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0662f2-c360-438f-9047-105212db6b50 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:20.383494 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:20.394656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e70240-a64c-438b-b8e7-6398d30c9b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:20.396169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e70240-a64c-438b-b8e7-6398d30c9b8f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.396453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e70240-a64c-438b-b8e7-6398d30c9b8f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.396732 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e70240-a64c-438b-b8e7-6398d30c9b8f None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.397579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e70240-a64c-438b-b8e7-6398d30c9b8f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:20.397885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e70240-a64c-438b-b8e7-6398d30c9b8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:20.399324 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e70240-a64c-438b-b8e7-6398d30c9b8f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:20.418416 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 149/300] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:20 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:20.420709 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e70240-a64c-438b-b8e7-6398d30c9b8f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:20.442685 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:20.445338 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc26f8-fddb-45cc-a2cf-5d8369a58bcb None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:20.504915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbb6a7-e11c-449a-9789-b297bb25e8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:20.506368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbb6a7-e11c-449a-9789-b297bb25e8b9 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.506666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbb6a7-e11c-449a-9789-b297bb25e8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.506945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbb6a7-e11c-449a-9789-b297bb25e8b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.508651 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbb6a7-e11c-449a-9789-b297bb25e8b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:20.510176 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbb6a7-e11c-449a-9789-b297bb25e8b9 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:20.513496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 152/301] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:20 2022] GET /identity/v3/domains/default => generated 200 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:20.521550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbb6a7-e11c-449a-9789-b297bb25e8b9 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:20.585394 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e70240-a64c-438b-b8e7-6398d30c9b8f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:20.628106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1ea18-c235-45f5-9550-64fbea87cd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:20.629001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1ea18-c235-45f5-9550-64fbea87cd1f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.629280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1ea18-c235-45f5-9550-64fbea87cd1f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.629555 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1ea18-c235-45f5-9550-64fbea87cd1f None admin] PATH_INFO: `/v3/users/9c364df1bc3a44d486cfdfa7d7ed1853` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.648970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1ea18-c235-45f5-9550-64fbea87cd1f None admin] RBAC: Authorizing `identity:get_user(user_id=9c364df1bc3a44d486cfdfa7d7ed1853)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:20.650486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1ea18-c235-45f5-9550-64fbea87cd1f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:20.652334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 150/302] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:20 2022] GET /identity/v3/users/9c364df1bc3a44d486cfdfa7d7ed1853 => generated 294 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:20.658452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1ea18-c235-45f5-9550-64fbea87cd1f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:20.729033 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbb6a7-e11c-449a-9789-b297bb25e8b9 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:20.750175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:20.794595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:20.801587 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5a6c-558d-4bd1-b9fd-a67bad8d24a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:20.802290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5a6c-558d-4bd1-b9fd-a67bad8d24a8 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.802613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5a6c-558d-4bd1-b9fd-a67bad8d24a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.803007 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5a6c-558d-4bd1-b9fd-a67bad8d24a8 None admin] PATH_INFO: `/v3/groups` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.803621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d5a6c-558d-4bd1-b9fd-a67bad8d24a8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:20.805164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d5a6c-558d-4bd1-b9fd-a67bad8d24a8 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:20.815770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1ea18-c235-45f5-9550-64fbea87cd1f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:20.854748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176d299-4a6f-4616-bb08-90132a42e49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:20.855401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176d299-4a6f-4616-bb08-90132a42e49f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.855726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176d299-4a6f-4616-bb08-90132a42e49f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.856132 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176d299-4a6f-4616-bb08-90132a42e49f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.858138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176d299-4a6f-4616-bb08-90132a42e49f None admin] RBAC: Adding query filter params (role.id=88d17c94ac464961ba0635bbb0d74025, user.id=9c364df1bc3a44d486cfdfa7d7ed1853, scope.system=all) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:20.858681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176d299-4a6f-4616-bb08-90132a42e49f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:20.861311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176d299-4a6f-4616-bb08-90132a42e49f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:20.867040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 151/303] 10.222.0.112 () {56 vars in 1313 bytes} [Thu May 26 16:33:20 2022] GET /identity/v3/role_assignments?user.id=9c364df1bc3a44d486cfdfa7d7ed1853&scope.system=all&role.id=88d17c94ac464961ba0635bbb0d74025 => generated 227 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:20.869442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b07289-0dd1-4a71-9bf4-4031b4724df6 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.869927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b07289-0dd1-4a71-9bf4-4031b4724df6 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.870284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b07289-0dd1-4a71-9bf4-4031b4724df6 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.871949 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 152/304] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:20.879515 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dfe64-1eec-4fdb-b015-888807289144 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.879827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dfe64-1eec-4fdb-b015-888807289144 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.880079 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dfe64-1eec-4fdb-b015-888807289144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.900002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-f00dfe64-1eec-4fdb-b015-888807289144 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:20.901154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-f00dfe64-1eec-4fdb-b015-888807289144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:20.966605 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 153/305] 10.222.0.112 () {60 vars in 1139 bytes} [Thu May 26 16:33:20 2022] POST /identity/v3/groups => generated 230 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:33:20.987386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e192d5-cfd2-4225-b6ba-1a73b739e95b None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.987684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e192d5-cfd2-4225-b6ba-1a73b739e95b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.987973 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e192d5-cfd2-4225-b6ba-1a73b739e95b None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.989439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 154/306] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:33:20.997749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2fc13-a5b6-4601-9c4e-60be5a82d02b None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.998074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2fc13-a5b6-4601-9c4e-60be5a82d02b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.998506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2fc13-a5b6-4601-9c4e-60be5a82d02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:21.014463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 153/307] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:21.026786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-e1d2fc13-a5b6-4601-9c4e-60be5a82d02b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:21.028062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-e1d2fc13-a5b6-4601-9c4e-60be5a82d02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:21.037123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dfe64-1eec-4fdb-b015-888807289144 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:21.135724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:21.146464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 155/308] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:21.177991 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2fc13-a5b6-4601-9c4e-60be5a82d02b None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:21.198454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dfe64-1eec-4fdb-b015-888807289144 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:21.252484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b75b2-4f09-49fc-a80f-0e94e852038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:21.253298 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b75b2-4f09-49fc-a80f-0e94e852038d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:21.253583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b75b2-4f09-49fc-a80f-0e94e852038d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:21.253859 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b75b2-4f09-49fc-a80f-0e94e852038d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:21.270110 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b75b2-4f09-49fc-a80f-0e94e852038d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-1d8b75b2-4f09-49fc-a80f-0e94e852038d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:21.279451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:21.280396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:21.281192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:21.281192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:21.281192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:21.281192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:21.281192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:21.281192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:21.281192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:21.281192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:21.281192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:21.281192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:21.281192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:21.281192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:21.281192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 154/309] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:33:21.287819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b75b2-4f09-49fc-a80f-0e94e852038d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:21.336851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2fc13-a5b6-4601-9c4e-60be5a82d02b None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:21.363978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:21.389317 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b642cc0-6b4c-4a11-8dbc-8b58ddb6615a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:21.390224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642cc0-6b4c-4a11-8dbc-8b58ddb6615a None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:21.390607 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642cc0-6b4c-4a11-8dbc-8b58ddb6615a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:21.390891 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642cc0-6b4c-4a11-8dbc-8b58ddb6615a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:21.406210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b642cc0-6b4c-4a11-8dbc-8b58ddb6615a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:21.406916 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b75b2-4f09-49fc-a80f-0e94e852038d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-9b642cc0-6b4c-4a11-8dbc-8b58ddb6615a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:21.416023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:21.416949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:21.417749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:21.417749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:21.417749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:21.417749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:21.417749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:21.417749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:21.417749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:21.417749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:21.417749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:21.417749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:21.417749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:33:21.417749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:21.425154 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 156/310] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:21.426369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b642cc0-6b4c-4a11-8dbc-8b58ddb6615a None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:21.456043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1420d85-6875-4ecf-80fb-a504dd48be07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:21.456774 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420d85-6875-4ecf-80fb-a504dd48be07 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:21.457065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420d85-6875-4ecf-80fb-a504dd48be07 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:21.457343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420d85-6875-4ecf-80fb-a504dd48be07 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:21.458099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1420d85-6875-4ecf-80fb-a504dd48be07 None admin] RBAC: Adding query filter params (name=member) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:21.458444 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1420d85-6875-4ecf-80fb-a504dd48be07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:21.461286 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1420d85-6875-4ecf-80fb-a504dd48be07 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:21.463024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:21.478482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 155/311] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:21 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:21.479840 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1420d85-6875-4ecf-80fb-a504dd48be07 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:21.561841 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b642cc0-6b4c-4a11-8dbc-8b58ddb6615a None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:21.609568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b49724-5df3-4d57-91ea-5b88967ccf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:21.610654 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b49724-5df3-4d57-91ea-5b88967ccf77 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:21.611185 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b49724-5df3-4d57-91ea-5b88967ccf77 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:21.611480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1420d85-6875-4ecf-80fb-a504dd48be07 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:21.611890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b49724-5df3-4d57-91ea-5b88967ccf77 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:21.613025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b49724-5df3-4d57-91ea-5b88967ccf77 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:21.613553 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b49724-5df3-4d57-91ea-5b88967ccf77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:21.615886 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b49724-5df3-4d57-91ea-5b88967ccf77 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:21.630404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 157/312] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:21 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:21.635281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b49724-5df3-4d57-91ea-5b88967ccf77 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:21.656578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4bbcf-b52c-4717-8560-b10dcc113bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:21.657549 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4bbcf-b52c-4717-8560-b10dcc113bce None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:21.657837 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4bbcf-b52c-4717-8560-b10dcc113bce None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:21.658162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4bbcf-b52c-4717-8560-b10dcc113bce None admin] PATH_INFO: `/v3/users/c72b92e901934a1b9521e25e6dcb40ee` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:21.659437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4bbcf-b52c-4717-8560-b10dcc113bce None admin] RBAC: Authorizing `identity:get_user(user_id=c72b92e901934a1b9521e25e6dcb40ee)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:21.660965 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4bbcf-b52c-4717-8560-b10dcc113bce None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:21.662739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 156/313] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:21 2022] GET /identity/v3/users/c72b92e901934a1b9521e25e6dcb40ee => generated 294 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:21.671663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4bbcf-b52c-4717-8560-b10dcc113bce None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:21.697077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:21.761832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:21.775802 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b49724-5df3-4d57-91ea-5b88967ccf77 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:21.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4919fd0-d965-49c5-8765-cf4dc5073ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:21.815580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4bbcf-b52c-4717-8560-b10dcc113bce None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:21.816434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4919fd0-d965-49c5-8765-cf4dc5073ee3 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:21.816865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4919fd0-d965-49c5-8765-cf4dc5073ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:21.817414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4919fd0-d965-49c5-8765-cf4dc5073ee3 None admin] PATH_INFO: `/v3/users/a1db5b57376b4f1a8cb8cb54f3f21f37` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:21.819143 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4919fd0-d965-49c5-8765-cf4dc5073ee3 None admin] RBAC: Authorizing `identity:get_user(user_id=a1db5b57376b4f1a8cb8cb54f3f21f37)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:21.820749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4919fd0-d965-49c5-8765-cf4dc5073ee3 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:21.826714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 158/314] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:21 2022] GET /identity/v3/users/a1db5b57376b4f1a8cb8cb54f3f21f37 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:21.828738 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4919fd0-d965-49c5-8765-cf4dc5073ee3 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:21.853254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b0899-fbac-43fc-94bd-0fbae9851923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:21.854345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b0899-fbac-43fc-94bd-0fbae9851923 None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:21.854778 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b0899-fbac-43fc-94bd-0fbae9851923 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:21.855152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b0899-fbac-43fc-94bd-0fbae9851923 None admin] PATH_INFO: `/v3/system/users/c72b92e901934a1b9521e25e6dcb40ee/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:21.857249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b0899-fbac-43fc-94bd-0fbae9851923 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c72b92e901934a1b9521e25e6dcb40ee, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:21.859040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b0899-fbac-43fc-94bd-0fbae9851923 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:21.967578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4919fd0-d965-49c5-8765-cf4dc5073ee3 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:21.981587 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:22.006081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 157/315] 10.222.0.112 () {58 vars in 1339 bytes} [Thu May 26 16:33:21 2022] PUT /identity/v3/system/users/c72b92e901934a1b9521e25e6dcb40ee/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:33:22.019662 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51593020-b537-48e6-b29a-35840397ca2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:22.020709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51593020-b537-48e6-b29a-35840397ca2b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:22.021209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51593020-b537-48e6-b29a-35840397ca2b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:22.021692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51593020-b537-48e6-b29a-35840397ca2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:22.142042 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51593020-b537-48e6-b29a-35840397ca2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:22.144542 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51593020-b537-48e6-b29a-35840397ca2b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:22.337553 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 159/316] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:22.346046 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b0899-fbac-43fc-94bd-0fbae9851923 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:22.506818 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b0899-fbac-43fc-94bd-0fbae9851923 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:22.536447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:22.564975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb39e7e-1f97-4470-86ef-148cff7eeecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:22.566751 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb39e7e-1f97-4470-86ef-148cff7eeecf None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:22.567495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb39e7e-1f97-4470-86ef-148cff7eeecf None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:22.568228 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb39e7e-1f97-4470-86ef-148cff7eeecf None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:22.571089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb39e7e-1f97-4470-86ef-148cff7eeecf None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:22.573901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb39e7e-1f97-4470-86ef-148cff7eeecf None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:22.578305 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 158/317] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:22 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:22.588076 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51593020-b537-48e6-b29a-35840397ca2b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:22.611640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:22.728222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51593020-b537-48e6-b29a-35840397ca2b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:22.765768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3cc65-775d-42f6-a110-77b5abb09bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:22.766799 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3cc65-775d-42f6-a110-77b5abb09bfc None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:22.767257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3cc65-775d-42f6-a110-77b5abb09bfc None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:22.767719 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3cc65-775d-42f6-a110-77b5abb09bfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:22.768727 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3cc65-775d-42f6-a110-77b5abb09bfc None admin] RBAC: Adding query filter params (role.id=88d17c94ac464961ba0635bbb0d74025, scope.project.id=9dd29f6d3b974bff8206091ffee50316, user.id=a1db5b57376b4f1a8cb8cb54f3f21f37) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:22.769213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3cc65-775d-42f6-a110-77b5abb09bfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:22.770870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3cc65-775d-42f6-a110-77b5abb09bfc None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:22.777794 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 160/318] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:33:22 2022] GET /identity/v3/role_assignments?user.id=a1db5b57376b4f1a8cb8cb54f3f21f37&scope.project.id=9dd29f6d3b974bff8206091ffee50316&role.id=88d17c94ac464961ba0635bbb0d74025 => generated 610 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:23.570070 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac566bb2-1a97-4034-bfb4-e4f0fb33f7b7 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:23.570921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac566bb2-1a97-4034-bfb4-e4f0fb33f7b7 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:23.570921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac566bb2-1a97-4034-bfb4-e4f0fb33f7b7 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:23.573024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 159/319] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:23.580167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77acb0f-2eb5-4443-873d-b9cd638fc441 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:23.580942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77acb0f-2eb5-4443-873d-b9cd638fc441 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:23.581076 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77acb0f-2eb5-4443-873d-b9cd638fc441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:23.610024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-b77acb0f-2eb5-4443-873d-b9cd638fc441 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:23.611255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b77acb0f-2eb5-4443-873d-b9cd638fc441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:23.716421 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 161/320] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:23.740621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac566bb2-1a97-4034-bfb4-e4f0fb33f7b7 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:23.865539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb88cd-8281-45c4-a51e-65cd73a4e201 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:23.865924 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb88cd-8281-45c4-a51e-65cd73a4e201 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:23.866213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb88cd-8281-45c4-a51e-65cd73a4e201 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:23.867838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 162/321] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:33:23.874405 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403332c-a0ea-48ba-b0c9-68e5b56432ca None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:23.874758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403332c-a0ea-48ba-b0c9-68e5b56432ca None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:23.874978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403332c-a0ea-48ba-b0c9-68e5b56432ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:23.882593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac566bb2-1a97-4034-bfb4-e4f0fb33f7b7 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:23.882857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:23.898335 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-6403332c-a0ea-48ba-b0c9-68e5b56432ca None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:23.900055 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-6403332c-a0ea-48ba-b0c9-68e5b56432ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:23.926773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059b7be-caa6-4c71-b5be-b65e1870d215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:23.937727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b7be-caa6-4c71-b5be-b65e1870d215 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:23.937727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b7be-caa6-4c71-b5be-b65e1870d215 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:23.937727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b7be-caa6-4c71-b5be-b65e1870d215 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:23.942102 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059b7be-caa6-4c71-b5be-b65e1870d215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-3059b7be-caa6-4c71-b5be-b65e1870d215 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:23.950702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:23.951746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:23.952816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:23.952816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:23.952816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:23.952816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:23.952816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:23.952816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:23.952816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:23.952816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:23.952816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:23.952816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:23.952816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:33:23.952816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:23.952816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 160/322] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:23.960213 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059b7be-caa6-4c71-b5be-b65e1870d215 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:24.007124 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 163/323] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:24.037618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403332c-a0ea-48ba-b0c9-68e5b56432ca None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:24.041865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:24.143236 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059b7be-caa6-4c71-b5be-b65e1870d215 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:24.198683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0476b-7063-4626-b0ff-81ea5b062c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:24.199986 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0476b-7063-4626-b0ff-81ea5b062c51 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:24.200885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0476b-7063-4626-b0ff-81ea5b062c51 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:24.201491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0476b-7063-4626-b0ff-81ea5b062c51 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:24.202854 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0476b-7063-4626-b0ff-81ea5b062c51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:24.203174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0476b-7063-4626-b0ff-81ea5b062c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:24.204627 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0476b-7063-4626-b0ff-81ea5b062c51 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:24.219229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 161/324] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:23 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:24.224399 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403332c-a0ea-48ba-b0c9-68e5b56432ca None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:24.230596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0476b-7063-4626-b0ff-81ea5b062c51 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:24.299015 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d615bb-7d21-485a-9286-4aefd925b77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:24.300295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d615bb-7d21-485a-9286-4aefd925b77b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:24.300751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d615bb-7d21-485a-9286-4aefd925b77b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:24.301194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d615bb-7d21-485a-9286-4aefd925b77b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:24.303279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d615bb-7d21-485a-9286-4aefd925b77b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:24.305958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d615bb-7d21-485a-9286-4aefd925b77b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:24.310371 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 164/325] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:24 2022] GET /identity/v3/domains/default => generated 200 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:24.318466 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d615bb-7d21-485a-9286-4aefd925b77b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:24.321922 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:24.427917 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0476b-7063-4626-b0ff-81ea5b062c51 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:24.445677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d615bb-7d21-485a-9286-4aefd925b77b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:24.447008 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:24.490997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a94f2-5379-42a4-9474-99884eb93e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:24.492187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a94f2-5379-42a4-9474-99884eb93e61 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:24.492674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a94f2-5379-42a4-9474-99884eb93e61 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:24.493119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a94f2-5379-42a4-9474-99884eb93e61 None admin] PATH_INFO: `/v3/users/9c364df1bc3a44d486cfdfa7d7ed1853` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:24.494641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a94f2-5379-42a4-9474-99884eb93e61 None admin] RBAC: Authorizing `identity:get_user(user_id=9c364df1bc3a44d486cfdfa7d7ed1853)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:24.496171 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a94f2-5379-42a4-9474-99884eb93e61 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:24.502782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 162/326] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:24 2022] GET /identity/v3/users/9c364df1bc3a44d486cfdfa7d7ed1853 => generated 294 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:24.503872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a94f2-5379-42a4-9474-99884eb93e61 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:24.505558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c049a-5db3-4564-88d7-6f3826c2a7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:24.506407 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c049a-5db3-4564-88d7-6f3826c2a7d9 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:24.507299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c049a-5db3-4564-88d7-6f3826c2a7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:24.507795 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c049a-5db3-4564-88d7-6f3826c2a7d9 None admin] PATH_INFO: `/v3/groups` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:24.510211 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c049a-5db3-4564-88d7-6f3826c2a7d9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:24.512004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c049a-5db3-4564-88d7-6f3826c2a7d9 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:24.671922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a94f2-5379-42a4-9474-99884eb93e61 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:24.690591 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 165/327] 10.222.0.112 () {60 vars in 1139 bytes} [Thu May 26 16:33:24 2022] POST /identity/v3/groups => generated 227 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:33:24.750733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a774c1c-b7b4-48d1-8e41-8c7b6fb888f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:24.752242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a774c1c-b7b4-48d1-8e41-8c7b6fb888f6 None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:24.752687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a774c1c-b7b4-48d1-8e41-8c7b6fb888f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:24.753127 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a774c1c-b7b4-48d1-8e41-8c7b6fb888f6 None admin] PATH_INFO: `/v3/system/users/9c364df1bc3a44d486cfdfa7d7ed1853/roles/88d17c94ac464961ba0635bbb0d74025` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:24.755801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a774c1c-b7b4-48d1-8e41-8c7b6fb888f6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9c364df1bc3a44d486cfdfa7d7ed1853, role_id=88d17c94ac464961ba0635bbb0d74025)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:24.758658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a774c1c-b7b4-48d1-8e41-8c7b6fb888f6 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:24.898291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 163/328] 10.222.0.112 () {58 vars in 1339 bytes} [Thu May 26 16:33:24 2022] PUT /identity/v3/system/users/9c364df1bc3a44d486cfdfa7d7ed1853/roles/88d17c94ac464961ba0635bbb0d74025 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:33:25.006774 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43ed7-8dd1-489c-98bb-370607115858 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:25.007207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43ed7-8dd1-489c-98bb-370607115858 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:25.007573 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43ed7-8dd1-489c-98bb-370607115858 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:25.009972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 166/329] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:25 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:25.019533 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33638b30-d39b-4d6a-b3df-421aa7254f09 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:25.019980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33638b30-d39b-4d6a-b3df-421aa7254f09 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:25.020395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33638b30-d39b-4d6a-b3df-421aa7254f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:25.040838 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-33638b30-d39b-4d6a-b3df-421aa7254f09 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:25.042313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-33638b30-d39b-4d6a-b3df-421aa7254f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:25.097421 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:25.147576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 164/330] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:25.173884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43ed7-8dd1-489c-98bb-370607115858 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:25.254292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:25.313703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43ed7-8dd1-489c-98bb-370607115858 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:25.366950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70764db4-6e76-4d89-8ab1-d7398b358031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:25.368070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70764db4-6e76-4d89-8ab1-d7398b358031 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:25.368532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70764db4-6e76-4d89-8ab1-d7398b358031 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:25.368984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70764db4-6e76-4d89-8ab1-d7398b358031 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:25.385128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70764db4-6e76-4d89-8ab1-d7398b358031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-70764db4-6e76-4d89-8ab1-d7398b358031 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:25.395259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:25.396429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:25.397417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:25.397417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:25.397417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:25.397417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:25.397417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:25.397417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:25.397417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:25.397417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:25.397417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:25.397417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:25.397417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:25.397417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:25.399634 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 167/331] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:25.406641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33638b30-d39b-4d6a-b3df-421aa7254f09 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:25.620202 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33638b30-d39b-4d6a-b3df-421aa7254f09 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:25.671802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9732ff4-f85b-44fa-8ce9-42d7a77c2bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:25.672537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9732ff4-f85b-44fa-8ce9-42d7a77c2bf9 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:25.673391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9732ff4-f85b-44fa-8ce9-42d7a77c2bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:25.673391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9732ff4-f85b-44fa-8ce9-42d7a77c2bf9 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:25.673957 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9732ff4-f85b-44fa-8ce9-42d7a77c2bf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:25.674265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9732ff4-f85b-44fa-8ce9-42d7a77c2bf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:25.675714 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9732ff4-f85b-44fa-8ce9-42d7a77c2bf9 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:25.698812 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 165/332] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:25 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:25.707829 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70764db4-6e76-4d89-8ab1-d7398b358031 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:25.923573 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70764db4-6e76-4d89-8ab1-d7398b358031 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:25.954833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:25.968383 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6722b1-e8c0-4e86-b1b5-3345e0a54628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:25.969267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6722b1-e8c0-4e86-b1b5-3345e0a54628 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:25.969618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6722b1-e8c0-4e86-b1b5-3345e0a54628 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:25.969907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6722b1-e8c0-4e86-b1b5-3345e0a54628 None admin] PATH_INFO: `/v3/users/c72b92e901934a1b9521e25e6dcb40ee` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:25.975574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6722b1-e8c0-4e86-b1b5-3345e0a54628 None admin] RBAC: Authorizing `identity:get_user(user_id=c72b92e901934a1b9521e25e6dcb40ee)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:25.975574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6722b1-e8c0-4e86-b1b5-3345e0a54628 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:25.975574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 168/333] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:25 2022] GET /identity/v3/users/c72b92e901934a1b9521e25e6dcb40ee => generated 294 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:25.982289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9732ff4-f85b-44fa-8ce9-42d7a77c2bf9 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:26.054938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:26.180870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9732ff4-f85b-44fa-8ce9-42d7a77c2bf9 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:26.243145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8761d5-ff19-4074-a941-36ec3380fcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:26.244227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8761d5-ff19-4074-a941-36ec3380fcae None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:26.244717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8761d5-ff19-4074-a941-36ec3380fcae None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:26.245216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8761d5-ff19-4074-a941-36ec3380fcae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:26.246261 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8761d5-ff19-4074-a941-36ec3380fcae None admin] RBAC: Adding query filter params (role.id=5a16a034a01e45b89530e8dd35d56588, user.id=c72b92e901934a1b9521e25e6dcb40ee, scope.system=all) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:26.247435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8761d5-ff19-4074-a941-36ec3380fcae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:26.249191 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8761d5-ff19-4074-a941-36ec3380fcae None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:26.273573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 166/334] 10.222.0.112 () {56 vars in 1313 bytes} [Thu May 26 16:33:25 2022] GET /identity/v3/role_assignments?user.id=c72b92e901934a1b9521e25e6dcb40ee&scope.system=all&role.id=5a16a034a01e45b89530e8dd35d56588 => generated 512 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:28.876684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bb3b8-8353-4c33-b179-607e4774f999 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:28.877196 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bb3b8-8353-4c33-b179-607e4774f999 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:28.877273 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bb3b8-8353-4c33-b179-607e4774f999 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:28.879755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 169/335] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:28.884895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf3f8b-3880-497d-a8f4-7e47db53f809 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:28.885415 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf3f8b-3880-497d-a8f4-7e47db53f809 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:28.885494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf3f8b-3880-497d-a8f4-7e47db53f809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:28.912636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-2cdf3f8b-3880-497d-a8f4-7e47db53f809 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:28.913654 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-2cdf3f8b-3880-497d-a8f4-7e47db53f809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:28.927040 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd05daf-2b4d-444a-8499-5e9001f128aa None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:28.927928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd05daf-2b4d-444a-8499-5e9001f128aa None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:28.928719 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd05daf-2b4d-444a-8499-5e9001f128aa None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:28.936904 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 170/336] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:28 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:28.944467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcf83b-d27a-4520-a67d-9adea30adfc5 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:28.945417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcf83b-d27a-4520-a67d-9adea30adfc5 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:28.946201 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcf83b-d27a-4520-a67d-9adea30adfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:29.004166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-80bcf83b-d27a-4520-a67d-9adea30adfc5 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:29.006643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-80bcf83b-d27a-4520-a67d-9adea30adfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:29.010428 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 167/337] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:29.037697 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8ff1a-0a09-4f46-9bdf-7eef73774be1 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:29.038226 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8ff1a-0a09-4f46-9bdf-7eef73774be1 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:29.038690 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8ff1a-0a09-4f46-9bdf-7eef73774be1 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:29.040572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 168/338] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:33:29.046590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7044d-db3f-4270-a414-49624db7e095 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:29.047199 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7044d-db3f-4270-a414-49624db7e095 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:29.047690 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7044d-db3f-4270-a414-49624db7e095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:29.080202 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-38e7044d-db3f-4270-a414-49624db7e095 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:29.081506 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-38e7044d-db3f-4270-a414-49624db7e095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:29.114808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:29.198034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 171/339] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:29.198034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcf83b-d27a-4520-a67d-9adea30adfc5 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:29.287577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 169/340] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:29.291533 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7044d-db3f-4270-a414-49624db7e095 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:29.486860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcf83b-d27a-4520-a67d-9adea30adfc5 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:29.522311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:29.529491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7044d-db3f-4270-a414-49624db7e095 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:29.560004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d07e30-e426-4e3e-a192-76bd19172b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:29.560828 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d07e30-e426-4e3e-a192-76bd19172b96 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:29.561113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d07e30-e426-4e3e-a192-76bd19172b96 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:29.561390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d07e30-e426-4e3e-a192-76bd19172b96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:29.581208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc462217-c162-49b1-87da-30a3dadf47df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:29.582074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc462217-c162-49b1-87da-30a3dadf47df None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:29.582379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc462217-c162-49b1-87da-30a3dadf47df None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:29.582660 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc462217-c162-49b1-87da-30a3dadf47df None admin] PATH_INFO: `/v3/roles/member` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:29.584041 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d07e30-e426-4e3e-a192-76bd19172b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-89d07e30-e426-4e3e-a192-76bd19172b96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:29.599665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:29.600595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:29.601377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:29.601377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:29.601377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:29.601377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:29.601377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:29.601377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:29.601377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:29.601377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:29.601377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:29.601377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:29.601377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:33:29.601377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:29.601377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 172/341] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:29.605563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc462217-c162-49b1-87da-30a3dadf47df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:29.613238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d07e30-e426-4e3e-a192-76bd19172b96 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-fc462217-c162-49b1-87da-30a3dadf47df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:29.618347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:29.619212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:29.620600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:29.620600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:29.620600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:29.620600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:29.620600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:29.620600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:29.620600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:29.620600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:29.620600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:29.620600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:29.620600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:29.620600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:29.620600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 170/342] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:29.621425 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc462217-c162-49b1-87da-30a3dadf47df None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:29.647615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:29.808295 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc462217-c162-49b1-87da-30a3dadf47df None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:29.808860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d07e30-e426-4e3e-a192-76bd19172b96 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:29.858032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75675174-1d2b-4d5a-8307-8e1469307dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:29.858483 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75675174-1d2b-4d5a-8307-8e1469307dc8 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:29.858766 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75675174-1d2b-4d5a-8307-8e1469307dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:29.859037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75675174-1d2b-4d5a-8307-8e1469307dc8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:29.860843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d222c8a-1668-44ba-a6ef-cccaf1cb6b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:29.861511 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d222c8a-1668-44ba-a6ef-cccaf1cb6b89 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:29.861790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d222c8a-1668-44ba-a6ef-cccaf1cb6b89 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:29.862057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d222c8a-1668-44ba-a6ef-cccaf1cb6b89 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:29.862843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d222c8a-1668-44ba-a6ef-cccaf1cb6b89 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:29.863147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d222c8a-1668-44ba-a6ef-cccaf1cb6b89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:29.864918 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d222c8a-1668-44ba-a6ef-cccaf1cb6b89 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:29.875800 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75675174-1d2b-4d5a-8307-8e1469307dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:29.876763 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 171/343] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:29 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:29.877629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d222c8a-1668-44ba-a6ef-cccaf1cb6b89 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-75675174-1d2b-4d5a-8307-8e1469307dc8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:29.885666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:29.887511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:29.888337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:29.888337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:29.888337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:29.888337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:29.888337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:29.888337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:29.888337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:29.888337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:29.888337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:29.888337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:29.888337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:29.888337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:29.890910 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 173/344] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:33:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:29.892564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670293a-10d0-48ae-a2bd-366799fe2e19 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:29.893078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670293a-10d0-48ae-a2bd-366799fe2e19 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:29.893555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670293a-10d0-48ae-a2bd-366799fe2e19 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:29.895477 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 174/345] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:29.896466 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670293a-10d0-48ae-a2bd-366799fe2e19 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:29.960813 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:29.978998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:30.025632 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d222c8a-1668-44ba-a6ef-cccaf1cb6b89 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:30.037019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670293a-10d0-48ae-a2bd-366799fe2e19 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:30.071803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51b3f7-38f0-4dbe-abb4-06fdf641c12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:30.072012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51b3f7-38f0-4dbe-abb4-06fdf641c12d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.072225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51b3f7-38f0-4dbe-abb4-06fdf641c12d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.072453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51b3f7-38f0-4dbe-abb4-06fdf641c12d None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.073641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51b3f7-38f0-4dbe-abb4-06fdf641c12d None admin] RBAC: Adding query filter params (name=member) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:30.073979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51b3f7-38f0-4dbe-abb4-06fdf641c12d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:30.078469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51b3f7-38f0-4dbe-abb4-06fdf641c12d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:30.085565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad79dd7-d8a0-45cf-8e0c-b6118e5588b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:30.087633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad79dd7-d8a0-45cf-8e0c-b6118e5588b7 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.088625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 172/346] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:29 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:30.088857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad79dd7-d8a0-45cf-8e0c-b6118e5588b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.093631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad79dd7-d8a0-45cf-8e0c-b6118e5588b7 None admin] PATH_INFO: `/v3/users/9c364df1bc3a44d486cfdfa7d7ed1853` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.093800 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51b3f7-38f0-4dbe-abb4-06fdf641c12d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:30.095244 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad79dd7-d8a0-45cf-8e0c-b6118e5588b7 None admin] RBAC: Authorizing `identity:get_user(user_id=9c364df1bc3a44d486cfdfa7d7ed1853)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:30.097024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad79dd7-d8a0-45cf-8e0c-b6118e5588b7 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:30.100149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 175/347] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:33:29 2022] GET /identity/v3/users/9c364df1bc3a44d486cfdfa7d7ed1853 => generated 294 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:30.101888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677649b-5ee4-416a-a845-199ff013e654 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.102447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677649b-5ee4-416a-a845-199ff013e654 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.102965 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677649b-5ee4-416a-a845-199ff013e654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.128995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-6677649b-5ee4-416a-a845-199ff013e654 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:30.132384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-6677649b-5ee4-416a-a845-199ff013e654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:30.242795 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 176/348] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:30.243769 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677649b-5ee4-416a-a845-199ff013e654 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:30.292663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51b3f7-38f0-4dbe-abb4-06fdf641c12d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:30.298535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:30.351926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25c2c9-0d94-4ea4-bc00-3fff8584b4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:30.353486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25c2c9-0d94-4ea4-bc00-3fff8584b4bb None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.354353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25c2c9-0d94-4ea4-bc00-3fff8584b4bb None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.358959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25c2c9-0d94-4ea4-bc00-3fff8584b4bb None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.360451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25c2c9-0d94-4ea4-bc00-3fff8584b4bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:30.362057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25c2c9-0d94-4ea4-bc00-3fff8584b4bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:30.363733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25c2c9-0d94-4ea4-bc00-3fff8584b4bb None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:30.366375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:30.389092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 173/349] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:33:30 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:30.391004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25c2c9-0d94-4ea4-bc00-3fff8584b4bb None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:30.427724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677649b-5ee4-416a-a845-199ff013e654 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:30.474366 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106865ec-c81c-403a-8d9e-d42acfdca075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:30.475313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106865ec-c81c-403a-8d9e-d42acfdca075 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.475599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106865ec-c81c-403a-8d9e-d42acfdca075 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.475876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106865ec-c81c-403a-8d9e-d42acfdca075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.522116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25c2c9-0d94-4ea4-bc00-3fff8584b4bb None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:30.568607 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106865ec-c81c-403a-8d9e-d42acfdca075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:30.570096 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106865ec-c81c-403a-8d9e-d42acfdca075 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:30.575106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402229d-130d-4405-bad1-7bc7338caf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:30.575854 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402229d-130d-4405-bad1-7bc7338caf52 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.576139 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402229d-130d-4405-bad1-7bc7338caf52 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.576453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402229d-130d-4405-bad1-7bc7338caf52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.577310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402229d-130d-4405-bad1-7bc7338caf52 None admin] RBAC: Adding query filter params (role.id=88d17c94ac464961ba0635bbb0d74025, user.id=9c364df1bc3a44d486cfdfa7d7ed1853, scope.system=all) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:30.577626 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402229d-130d-4405-bad1-7bc7338caf52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:30.579365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402229d-130d-4405-bad1-7bc7338caf52 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:30.594980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 174/350] 10.222.0.112 () {56 vars in 1313 bytes} [Thu May 26 16:33:30 2022] GET /identity/v3/role_assignments?user.id=9c364df1bc3a44d486cfdfa7d7ed1853&scope.system=all&role.id=88d17c94ac464961ba0635bbb0d74025 => generated 512 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:30.596106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4fff4-40cf-416a-ad8e-afd906679d58 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.596395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4fff4-40cf-416a-ad8e-afd906679d58 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.596672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4fff4-40cf-416a-ad8e-afd906679d58 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.598205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 175/351] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:30.603168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4fff4-40cf-416a-ad8e-afd906679d58 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:30.620982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:30.693412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:30.706571 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 177/352] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:30 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:30.707703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106865ec-c81c-403a-8d9e-d42acfdca075 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:30.745984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4fff4-40cf-416a-ad8e-afd906679d58 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:30.798994 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f05231-ccf5-410e-9461-2ce31bba0306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:30.800293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f05231-ccf5-410e-9461-2ce31bba0306 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.800573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f05231-ccf5-410e-9461-2ce31bba0306 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.800840 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f05231-ccf5-410e-9461-2ce31bba0306 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.816389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f05231-ccf5-410e-9461-2ce31bba0306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-50f05231-ccf5-410e-9461-2ce31bba0306 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:30.825238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:30.826187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:30.827131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:30.827131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:30.827131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:30.827131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:30.827131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:30.827131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:30.827131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:30.827131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:30.827131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:30.827131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:30.827131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:30.827131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:30.827131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 176/353] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:30.827794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2cc81-182c-4e72-9d8d-5e211ef3efd9 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.828210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2cc81-182c-4e72-9d8d-5e211ef3efd9 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.828367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2cc81-182c-4e72-9d8d-5e211ef3efd9 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.838712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 177/354] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:30 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:30.840694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650d243-6395-4162-9cad-aaf8ce56528d None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.840986 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650d243-6395-4162-9cad-aaf8ce56528d None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.841262 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650d243-6395-4162-9cad-aaf8ce56528d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.862272 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106865ec-c81c-403a-8d9e-d42acfdca075 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:30.862831 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-2650d243-6395-4162-9cad-aaf8ce56528d None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:30.864034 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-2650d243-6395-4162-9cad-aaf8ce56528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:30.904194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da085426-93ab-420d-bf41-c8e8716c563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:30.904850 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da085426-93ab-420d-bf41-c8e8716c563f None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.905137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da085426-93ab-420d-bf41-c8e8716c563f None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.905414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da085426-93ab-420d-bf41-c8e8716c563f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.915642 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:30.951567 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 178/355] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:30.952510 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650d243-6395-4162-9cad-aaf8ce56528d None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:30.989899 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da085426-93ab-420d-bf41-c8e8716c563f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:30.991462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da085426-93ab-420d-bf41-c8e8716c563f None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:31.009491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:31.075825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650d243-6395-4162-9cad-aaf8ce56528d None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:31.113185 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 178/356] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:30 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:31.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe662d1-b3e9-45ad-904c-3447b75a4b1f None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:31.117035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe662d1-b3e9-45ad-904c-3447b75a4b1f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:31.117215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409bb6a-56d5-4044-8d98-cc18265f71a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:31.117994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe662d1-b3e9-45ad-904c-3447b75a4b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:31.118144 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409bb6a-56d5-4044-8d98-cc18265f71a8 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:31.118438 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409bb6a-56d5-4044-8d98-cc18265f71a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:31.118719 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409bb6a-56d5-4044-8d98-cc18265f71a8 None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:31.119944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409bb6a-56d5-4044-8d98-cc18265f71a8 None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:31.121481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409bb6a-56d5-4044-8d98-cc18265f71a8 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:31.123377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 179/357] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:30 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:31.124084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409bb6a-56d5-4044-8d98-cc18265f71a8 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:31.141897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-bbe662d1-b3e9-45ad-904c-3447b75a4b1f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:31.143115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-bbe662d1-b3e9-45ad-904c-3447b75a4b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:31.182541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:31.232103 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 179/358] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:31.232799 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe662d1-b3e9-45ad-904c-3447b75a4b1f None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:31.248895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409bb6a-56d5-4044-8d98-cc18265f71a8 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:31.264531 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:31.295650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499e0e9-79b3-4b92-b758-9b8cccdab129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:31.297099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499e0e9-79b3-4b92-b758-9b8cccdab129 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:31.297099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499e0e9-79b3-4b92-b758-9b8cccdab129 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:31.297099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499e0e9-79b3-4b92-b758-9b8cccdab129 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:31.297740 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499e0e9-79b3-4b92-b758-9b8cccdab129 None admin] RBAC: Adding query filter params (name=member) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:31.298058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499e0e9-79b3-4b92-b758-9b8cccdab129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:31.299481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499e0e9-79b3-4b92-b758-9b8cccdab129 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:31.309367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 180/359] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:31 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:31.310370 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499e0e9-79b3-4b92-b758-9b8cccdab129 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:31.382239 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe662d1-b3e9-45ad-904c-3447b75a4b1f None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:31.442832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499e0e9-79b3-4b92-b758-9b8cccdab129 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:31.443021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e0eae-0176-4b2a-9980-b2d706863062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:31.444231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e0eae-0176-4b2a-9980-b2d706863062 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:31.444521 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e0eae-0176-4b2a-9980-b2d706863062 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:31.444802 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e0eae-0176-4b2a-9980-b2d706863062 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:31.460583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e0eae-0176-4b2a-9980-b2d706863062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-1b5e0eae-0176-4b2a-9980-b2d706863062 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:31.470081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:31.471340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:31.472200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:31.472200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:31.472200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:31.472200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:31.472200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:31.472200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:31.472200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:31.472200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:31.472200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:31.472200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:31.472200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:31.472200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:31.472200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 180/360] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:33:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:31.477110 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e0eae-0176-4b2a-9980-b2d706863062 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:31.498785 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db678833-81f0-494c-bb06-cbc0608ecfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:31.499682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db678833-81f0-494c-bb06-cbc0608ecfe5 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:31.500429 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db678833-81f0-494c-bb06-cbc0608ecfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:31.500429 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db678833-81f0-494c-bb06-cbc0608ecfe5 None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:31.501504 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db678833-81f0-494c-bb06-cbc0608ecfe5 None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:31.503507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db678833-81f0-494c-bb06-cbc0608ecfe5 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:31.507229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 181/361] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:31 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:31.507229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db678833-81f0-494c-bb06-cbc0608ecfe5 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:31.525855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:31.573949 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:31.659573 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e0eae-0176-4b2a-9980-b2d706863062 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:31.683315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db678833-81f0-494c-bb06-cbc0608ecfe5 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:31.714179 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77652664-94ed-4ce1-8b8f-d47272c29ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:31.718227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77652664-94ed-4ce1-8b8f-d47272c29ce5 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:31.718791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77652664-94ed-4ce1-8b8f-d47272c29ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:31.719246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77652664-94ed-4ce1-8b8f-d47272c29ce5 None admin] PATH_INFO: `/v3/groups/7326986284c14d2885e2bbdc1db71520` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:31.730919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77652664-94ed-4ce1-8b8f-d47272c29ce5 None admin] RBAC: Authorizing `identity:get_group(group_id=7326986284c14d2885e2bbdc1db71520)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:31.733527 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77652664-94ed-4ce1-8b8f-d47272c29ce5 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:31.738061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 181/362] 10.222.0.112 () {56 vars in 1185 bytes} [Thu May 26 16:33:31 2022] GET /identity/v3/groups/7326986284c14d2885e2bbdc1db71520 => generated 227 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:31.739338 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77652664-94ed-4ce1-8b8f-d47272c29ce5 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:31.750138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411c2e8-54e4-45d7-837a-b67a25b3b16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:31.754847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411c2e8-54e4-45d7-837a-b67a25b3b16a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:31.754847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411c2e8-54e4-45d7-837a-b67a25b3b16a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:31.754847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411c2e8-54e4-45d7-837a-b67a25b3b16a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:31.773662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411c2e8-54e4-45d7-837a-b67a25b3b16a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-a411c2e8-54e4-45d7-837a-b67a25b3b16a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:31.782451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:31.791105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:31.792044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:31.792044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:31.792044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:31.792044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:31.792044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:31.792044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:31.792044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:31.792044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:31.792044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:31.792044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:31.792044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:31.792044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:31.792044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 182/363] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:33:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:31.792044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411c2e8-54e4-45d7-837a-b67a25b3b16a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:31.894906 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:31.908535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77652664-94ed-4ce1-8b8f-d47272c29ce5 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:31.946700 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411c2e8-54e4-45d7-837a-b67a25b3b16a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:31.948360 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:31.965453 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a45965-22ba-405c-b5f9-4583312db818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:31.967016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a45965-22ba-405c-b5f9-4583312db818 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:31.967016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a45965-22ba-405c-b5f9-4583312db818 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:31.967250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a45965-22ba-405c-b5f9-4583312db818 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:31.994794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e07c7-6a7d-4704-b02c-7da8fc5d7bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:31.995470 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e07c7-6a7d-4704-b02c-7da8fc5d7bd2 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:31.995752 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e07c7-6a7d-4704-b02c-7da8fc5d7bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:31.996859 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e07c7-6a7d-4704-b02c-7da8fc5d7bd2 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:31.997621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e07c7-6a7d-4704-b02c-7da8fc5d7bd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:31.998045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e07c7-6a7d-4704-b02c-7da8fc5d7bd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:31.999476 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e07c7-6a7d-4704-b02c-7da8fc5d7bd2 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:32.014217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 183/364] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:33:31 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:32.015168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e07c7-6a7d-4704-b02c-7da8fc5d7bd2 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:32.081990 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a45965-22ba-405c-b5f9-4583312db818 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:32.084799 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a45965-22ba-405c-b5f9-4583312db818 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:32.151574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e07c7-6a7d-4704-b02c-7da8fc5d7bd2 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:32.189341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:32.201864 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562bc6d-cb7e-45fb-bf44-15b927c69a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:32.203307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562bc6d-cb7e-45fb-bf44-15b927c69a0f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:32.203755 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562bc6d-cb7e-45fb-bf44-15b927c69a0f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:32.209953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562bc6d-cb7e-45fb-bf44-15b927c69a0f None admin] PATH_INFO: `/v3/groups/7326986284c14d2885e2bbdc1db71520` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:32.210152 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 182/365] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:31 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:32.210152 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a45965-22ba-405c-b5f9-4583312db818 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:32.210420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562bc6d-cb7e-45fb-bf44-15b927c69a0f None admin] RBAC: Authorizing `identity:get_group(group_id=7326986284c14d2885e2bbdc1db71520)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:32.210420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562bc6d-cb7e-45fb-bf44-15b927c69a0f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:32.211510 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 184/366] 10.222.0.112 () {56 vars in 1185 bytes} [Thu May 26 16:33:32 2022] GET /identity/v3/groups/7326986284c14d2885e2bbdc1db71520 => generated 227 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:32.212934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562bc6d-cb7e-45fb-bf44-15b927c69a0f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:32.253425 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:32.334213 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562bc6d-cb7e-45fb-bf44-15b927c69a0f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:32.354769 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a45965-22ba-405c-b5f9-4583312db818 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:32.373764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce56e59-fa67-4d6f-8d99-140f3fdb728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:32.374585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce56e59-fa67-4d6f-8d99-140f3fdb728a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:32.374885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce56e59-fa67-4d6f-8d99-140f3fdb728a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:32.375163 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce56e59-fa67-4d6f-8d99-140f3fdb728a None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:32.375922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce56e59-fa67-4d6f-8d99-140f3fdb728a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:32.376232 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce56e59-fa67-4d6f-8d99-140f3fdb728a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:32.377622 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce56e59-fa67-4d6f-8d99-140f3fdb728a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:32.387317 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 185/367] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:32 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:32.388275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce56e59-fa67-4d6f-8d99-140f3fdb728a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:32.390204 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bace8a-b424-4662-a080-58d8f8c1b7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:32.390906 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bace8a-b424-4662-a080-58d8f8c1b7f4 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:32.391192 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bace8a-b424-4662-a080-58d8f8c1b7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:32.391475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bace8a-b424-4662-a080-58d8f8c1b7f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:32.393023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bace8a-b424-4662-a080-58d8f8c1b7f4 None admin] RBAC: Adding query filter params (group.id=7326986284c14d2885e2bbdc1db71520, role.id=5a16a034a01e45b89530e8dd35d56588, scope.project.id=9e623ea7f63f489ba500d0b565430c01) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:32.393023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bace8a-b424-4662-a080-58d8f8c1b7f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:32.394048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bace8a-b424-4662-a080-58d8f8c1b7f4 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:32.400255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 183/368] 10.222.0.112 () {56 vars in 1381 bytes} [Thu May 26 16:33:32 2022] GET /identity/v3/role_assignments?group.id=7326986284c14d2885e2bbdc1db71520&scope.project.id=9e623ea7f63f489ba500d0b565430c01&role.id=5a16a034a01e45b89530e8dd35d56588 => generated 261 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:32.401049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bace8a-b424-4662-a080-58d8f8c1b7f4 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:32.477274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:32.553922 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bace8a-b424-4662-a080-58d8f8c1b7f4 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:32.556557 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:32.572512 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce56e59-fa67-4d6f-8d99-140f3fdb728a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:32.616451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbdf93-72ef-40b0-a312-e0421f09b516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:32.617653 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbdf93-72ef-40b0-a312-e0421f09b516 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:32.617942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbdf93-72ef-40b0-a312-e0421f09b516 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:32.619053 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbdf93-72ef-40b0-a312-e0421f09b516 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:32.621510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbdf93-72ef-40b0-a312-e0421f09b516 None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:32.623689 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbdf93-72ef-40b0-a312-e0421f09b516 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:32.630629 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 184/369] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:32 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:32.630629 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbdf93-72ef-40b0-a312-e0421f09b516 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:32.634242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbff68-f6bd-428c-95c4-bfe5a1cb8eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:32.635408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbff68-f6bd-428c-95c4-bfe5a1cb8eca None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:32.635922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbff68-f6bd-428c-95c4-bfe5a1cb8eca None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:32.637430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbff68-f6bd-428c-95c4-bfe5a1cb8eca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:32.727863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbff68-f6bd-428c-95c4-bfe5a1cb8eca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:32.729322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbff68-f6bd-428c-95c4-bfe5a1cb8eca None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:32.802108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbdf93-72ef-40b0-a312-e0421f09b516 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:32.845685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:32.860776 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9bc4f-e5e7-4092-b572-ec058aa14af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:32.861838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9bc4f-e5e7-4092-b572-ec058aa14af5 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:32.862289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9bc4f-e5e7-4092-b572-ec058aa14af5 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:32.862787 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9bc4f-e5e7-4092-b572-ec058aa14af5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:32.864965 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9bc4f-e5e7-4092-b572-ec058aa14af5 None admin] RBAC: Adding query filter params (group.id=7326986284c14d2885e2bbdc1db71520, role.id=0449b3526e454e9ea05258c90de6de31, scope.project.id=9e623ea7f63f489ba500d0b565430c01) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:32.864965 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9bc4f-e5e7-4092-b572-ec058aa14af5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:32.866641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9bc4f-e5e7-4092-b572-ec058aa14af5 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:32.867487 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:32.875433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 185/370] 10.222.0.112 () {56 vars in 1381 bytes} [Thu May 26 16:33:32 2022] GET /identity/v3/role_assignments?group.id=7326986284c14d2885e2bbdc1db71520&scope.project.id=9e623ea7f63f489ba500d0b565430c01&role.id=0449b3526e454e9ea05258c90de6de31 => generated 261 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:32.876498 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9bc4f-e5e7-4092-b572-ec058aa14af5 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:32.883016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 186/371] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:32 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:32.884599 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbff68-f6bd-428c-95c4-bfe5a1cb8eca None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:33.048782 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9bc4f-e5e7-4092-b572-ec058aa14af5 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:33.057824 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbff68-f6bd-428c-95c4-bfe5a1cb8eca None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:33.110219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917a0ef-4f4a-48bb-94ec-d2b50c0871d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:33.110954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917a0ef-4f4a-48bb-94ec-d2b50c0871d7 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.111250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917a0ef-4f4a-48bb-94ec-d2b50c0871d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.111576 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917a0ef-4f4a-48bb-94ec-d2b50c0871d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.112976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a008bae-5462-42d6-b68b-58dac271c5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:33.114520 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a008bae-5462-42d6-b68b-58dac271c5ca None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.114979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a008bae-5462-42d6-b68b-58dac271c5ca None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.115447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a008bae-5462-42d6-b68b-58dac271c5ca None admin] PATH_INFO: `/v3/groups/7326986284c14d2885e2bbdc1db71520` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.117500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a008bae-5462-42d6-b68b-58dac271c5ca None admin] RBAC: Authorizing `identity:get_group(group_id=7326986284c14d2885e2bbdc1db71520)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:33.119459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a008bae-5462-42d6-b68b-58dac271c5ca None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:33.124043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 187/372] 10.222.0.112 () {56 vars in 1185 bytes} [Thu May 26 16:33:32 2022] GET /identity/v3/groups/7326986284c14d2885e2bbdc1db71520 => generated 227 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:33.126142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a008bae-5462-42d6-b68b-58dac271c5ca None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:33.221437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:33.225609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:33.258120 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917a0ef-4f4a-48bb-94ec-d2b50c0871d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:33.260575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917a0ef-4f4a-48bb-94ec-d2b50c0871d7 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:33.292535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a008bae-5462-42d6-b68b-58dac271c5ca None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:33.368343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba372703-da0d-4234-bb59-63c72e3380de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:33.368343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba372703-da0d-4234-bb59-63c72e3380de None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.368343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba372703-da0d-4234-bb59-63c72e3380de None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.368343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba372703-da0d-4234-bb59-63c72e3380de None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.368731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba372703-da0d-4234-bb59-63c72e3380de None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:33.368731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba372703-da0d-4234-bb59-63c72e3380de None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:33.368731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 188/373] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:33 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:33.368731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba372703-da0d-4234-bb59-63c72e3380de None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:33.396153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 186/374] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:32 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:33.397235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917a0ef-4f4a-48bb-94ec-d2b50c0871d7 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:33.502219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba372703-da0d-4234-bb59-63c72e3380de None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:33.547866 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:33.550519 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:33.557982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d203a-2193-459b-9f6d-c5eab57a71f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:33.569970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d203a-2193-459b-9f6d-c5eab57a71f6 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.569970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d203a-2193-459b-9f6d-c5eab57a71f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.569970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d203a-2193-459b-9f6d-c5eab57a71f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.569970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d203a-2193-459b-9f6d-c5eab57a71f6 None admin] RBAC: Adding query filter params (group.id=7326986284c14d2885e2bbdc1db71520, role.id=5a16a034a01e45b89530e8dd35d56588, scope.project.id=9dd29f6d3b974bff8206091ffee50316) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:33.569970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d203a-2193-459b-9f6d-c5eab57a71f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:33.569970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d203a-2193-459b-9f6d-c5eab57a71f6 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:33.570711 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917a0ef-4f4a-48bb-94ec-d2b50c0871d7 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:33.574595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 189/375] 10.222.0.112 () {56 vars in 1381 bytes} [Thu May 26 16:33:33 2022] GET /identity/v3/role_assignments?group.id=7326986284c14d2885e2bbdc1db71520&scope.project.id=9dd29f6d3b974bff8206091ffee50316&role.id=5a16a034a01e45b89530e8dd35d56588 => generated 261 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:33.576993 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d203a-2193-459b-9f6d-c5eab57a71f6 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:33.621743 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776fe55-412c-4359-821f-78d1299a27b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:33.622309 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776fe55-412c-4359-821f-78d1299a27b9 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.622720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776fe55-412c-4359-821f-78d1299a27b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.623104 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776fe55-412c-4359-821f-78d1299a27b9 None admin] PATH_INFO: `/v3/groups/7326986284c14d2885e2bbdc1db71520` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.625537 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776fe55-412c-4359-821f-78d1299a27b9 None admin] RBAC: Authorizing `identity:get_group(group_id=7326986284c14d2885e2bbdc1db71520)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:33.628406 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776fe55-412c-4359-821f-78d1299a27b9 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:33.631045 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 187/376] 10.222.0.112 () {56 vars in 1185 bytes} [Thu May 26 16:33:33 2022] GET /identity/v3/groups/7326986284c14d2885e2bbdc1db71520 => generated 227 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:33.638220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776fe55-412c-4359-821f-78d1299a27b9 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:33.783181 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d203a-2193-459b-9f6d-c5eab57a71f6 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:33.877499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4028f5-061c-4ab7-954a-8fae585be916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:33.878308 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4028f5-061c-4ab7-954a-8fae585be916 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.878619 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4028f5-061c-4ab7-954a-8fae585be916 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.878901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4028f5-061c-4ab7-954a-8fae585be916 None admin] PATH_INFO: `/v3/projects/9dda95f8437548158ad5e83593c71483` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.880322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4028f5-061c-4ab7-954a-8fae585be916 None admin] RBAC: Authorizing `identity:get_project(project_id=9dda95f8437548158ad5e83593c71483)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:33.881798 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4028f5-061c-4ab7-954a-8fae585be916 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:33.883668 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 190/377] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:33 2022] GET /identity/v3/projects/9dda95f8437548158ad5e83593c71483 => generated 345 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:33.891648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4028f5-061c-4ab7-954a-8fae585be916 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:33.898768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776fe55-412c-4359-821f-78d1299a27b9 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:33.979063 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2526b40-56ef-44bf-9cda-3e543ab5afcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:33.982844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2526b40-56ef-44bf-9cda-3e543ab5afcb None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.983459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2526b40-56ef-44bf-9cda-3e543ab5afcb None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.983935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2526b40-56ef-44bf-9cda-3e543ab5afcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.985455 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2526b40-56ef-44bf-9cda-3e543ab5afcb None admin] RBAC: Adding query filter params (group.id=7326986284c14d2885e2bbdc1db71520, role.id=0449b3526e454e9ea05258c90de6de31, scope.project.id=9dd29f6d3b974bff8206091ffee50316) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:33.986948 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2526b40-56ef-44bf-9cda-3e543ab5afcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:33.989034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2526b40-56ef-44bf-9cda-3e543ab5afcb None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:33.999845 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 188/378] 10.222.0.112 () {56 vars in 1381 bytes} [Thu May 26 16:33:33 2022] GET /identity/v3/role_assignments?group.id=7326986284c14d2885e2bbdc1db71520&scope.project.id=9dd29f6d3b974bff8206091ffee50316&role.id=0449b3526e454e9ea05258c90de6de31 => generated 261 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:34.059932 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:34.129200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4028f5-061c-4ab7-954a-8fae585be916 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:34.215815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5185f4-4fb8-4929-8040-0f7eb51997d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:34.216758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5185f4-4fb8-4929-8040-0f7eb51997d0 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:34.217225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5185f4-4fb8-4929-8040-0f7eb51997d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:34.217565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5185f4-4fb8-4929-8040-0f7eb51997d0 None admin] PATH_INFO: `/v3/groups/eb1890b8a30b432fa3de003e9c8b8011` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:34.233438 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5185f4-4fb8-4929-8040-0f7eb51997d0 None admin] RBAC: Authorizing `identity:get_group(group_id=eb1890b8a30b432fa3de003e9c8b8011)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:34.235165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5185f4-4fb8-4929-8040-0f7eb51997d0 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:34.237370 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 191/379] 10.222.0.112 () {56 vars in 1185 bytes} [Thu May 26 16:33:33 2022] GET /identity/v3/groups/eb1890b8a30b432fa3de003e9c8b8011 => generated 230 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:34.244071 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2526b40-56ef-44bf-9cda-3e543ab5afcb None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:34.314962 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:34.478564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2526b40-56ef-44bf-9cda-3e543ab5afcb None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:34.560309 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d4530-ad5a-43fb-8b63-04da7b021f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:34.561015 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d4530-ad5a-43fb-8b63-04da7b021f14 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:34.561299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d4530-ad5a-43fb-8b63-04da7b021f14 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:34.561597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d4530-ad5a-43fb-8b63-04da7b021f14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:34.562564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d4530-ad5a-43fb-8b63-04da7b021f14 None admin] RBAC: Adding query filter params (group.id=eb1890b8a30b432fa3de003e9c8b8011, role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=9dda95f8437548158ad5e83593c71483) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:34.562937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d4530-ad5a-43fb-8b63-04da7b021f14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:34.564546 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d4530-ad5a-43fb-8b63-04da7b021f14 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:34.577040 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 189/380] 10.222.0.112 () {56 vars in 1381 bytes} [Thu May 26 16:33:34 2022] GET /identity/v3/role_assignments?group.id=eb1890b8a30b432fa3de003e9c8b8011&scope.project.id=9dda95f8437548158ad5e83593c71483&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 261 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:35.313661 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea0493-f8fa-40c5-ad39-6dc31c2470c0 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:35.314175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea0493-f8fa-40c5-ad39-6dc31c2470c0 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:35.314635 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea0493-f8fa-40c5-ad39-6dc31c2470c0 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:35.317047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 192/381] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:35 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:35.323523 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5aaa1-3a78-430c-8708-60bd63e87e51 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:35.324705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5aaa1-3a78-430c-8708-60bd63e87e51 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:35.325242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5aaa1-3a78-430c-8708-60bd63e87e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:35.366458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-e3e5aaa1-3a78-430c-8708-60bd63e87e51 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:35.368567 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-e3e5aaa1-3a78-430c-8708-60bd63e87e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:35.498241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 190/382] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:35.533336 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea0493-f8fa-40c5-ad39-6dc31c2470c0 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:35.723259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea0493-f8fa-40c5-ad39-6dc31c2470c0 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:35.753061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:35.763637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138798b-c52d-4b01-a462-53cb2ba32080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:35.764988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138798b-c52d-4b01-a462-53cb2ba32080 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:35.770686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138798b-c52d-4b01-a462-53cb2ba32080 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:35.770686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138798b-c52d-4b01-a462-53cb2ba32080 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:35.786738 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138798b-c52d-4b01-a462-53cb2ba32080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-a138798b-c52d-4b01-a462-53cb2ba32080 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:35.795534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:35.796485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:35.797556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:35.797556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:35.797556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:35.797556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:35.797556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:35.797556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:35.797556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:35.797556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:35.797556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:35.797556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:35.797556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:35.797556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:35.797556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 193/383] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:35.803437 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5aaa1-3a78-430c-8708-60bd63e87e51 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:35.824370 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:35.933620 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5aaa1-3a78-430c-8708-60bd63e87e51 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:35.981750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce093d-e9f2-44b5-a342-76f5184f2750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:35.982462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce093d-e9f2-44b5-a342-76f5184f2750 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:35.982751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce093d-e9f2-44b5-a342-76f5184f2750 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:35.983031 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce093d-e9f2-44b5-a342-76f5184f2750 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:35.983786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce093d-e9f2-44b5-a342-76f5184f2750 None admin] RBAC: Adding query filter params (name=member) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:35.984096 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce093d-e9f2-44b5-a342-76f5184f2750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:35.985517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce093d-e9f2-44b5-a342-76f5184f2750 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:35.999740 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 191/384] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:35 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:36.008328 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138798b-c52d-4b01-a462-53cb2ba32080 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:36.138503 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138798b-c52d-4b01-a462-53cb2ba32080 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:36.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca2339-3578-4613-8579-f4e2cd85ddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:36.178049 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca2339-3578-4613-8579-f4e2cd85ddd9 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:36.178349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca2339-3578-4613-8579-f4e2cd85ddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:36.178641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca2339-3578-4613-8579-f4e2cd85ddd9 None admin] PATH_INFO: `/v3/groups/7326986284c14d2885e2bbdc1db71520` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:36.179850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca2339-3578-4613-8579-f4e2cd85ddd9 None admin] RBAC: Authorizing `identity:get_group(group_id=7326986284c14d2885e2bbdc1db71520)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:36.181435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca2339-3578-4613-8579-f4e2cd85ddd9 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:36.184010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 194/385] 10.222.0.112 () {56 vars in 1185 bytes} [Thu May 26 16:33:36 2022] GET /identity/v3/groups/7326986284c14d2885e2bbdc1db71520 => generated 227 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:36.189826 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce093d-e9f2-44b5-a342-76f5184f2750 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:36.328920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:36.349680 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98323c-7bb8-449d-afa6-a4bd9ffe96f9 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:36.350678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98323c-7bb8-449d-afa6-a4bd9ffe96f9 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:36.351189 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98323c-7bb8-449d-afa6-a4bd9ffe96f9 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:36.353116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 195/386] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:36.360124 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababd76c-13de-4c9c-ad9f-4bb522a3b4b5 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:36.360830 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababd76c-13de-4c9c-ad9f-4bb522a3b4b5 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:36.361315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababd76c-13de-4c9c-ad9f-4bb522a3b4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:36.365537 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce093d-e9f2-44b5-a342-76f5184f2750 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:36.402583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-ababd76c-13de-4c9c-ad9f-4bb522a3b4b5 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:36.412392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ababd76c-13de-4c9c-ad9f-4bb522a3b4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:36.447586 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3970e8b-583c-4dae-9de3-a0b9222e473c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:36.448883 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3970e8b-583c-4dae-9de3-a0b9222e473c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:36.450241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3970e8b-583c-4dae-9de3-a0b9222e473c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:36.453473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3970e8b-583c-4dae-9de3-a0b9222e473c None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:36.455964 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3970e8b-583c-4dae-9de3-a0b9222e473c None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:36.457681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3970e8b-583c-4dae-9de3-a0b9222e473c None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:36.459930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 192/387] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:36 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:36.468575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3970e8b-583c-4dae-9de3-a0b9222e473c None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:36.521290 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:36.560904 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 196/388] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:36.626188 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababd76c-13de-4c9c-ad9f-4bb522a3b4b5 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:36.657401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3970e8b-583c-4dae-9de3-a0b9222e473c None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:36.731680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451711cb-0d96-4d89-94bc-39d90a959398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:36.732595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451711cb-0d96-4d89-94bc-39d90a959398 None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:36.732882 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451711cb-0d96-4d89-94bc-39d90a959398 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:36.733161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451711cb-0d96-4d89-94bc-39d90a959398 None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01/groups/7326986284c14d2885e2bbdc1db71520/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:36.738946 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451711cb-0d96-4d89-94bc-39d90a959398 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e623ea7f63f489ba500d0b565430c01, group_id=7326986284c14d2885e2bbdc1db71520, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:36.740484 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451711cb-0d96-4d89-94bc-39d90a959398 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:36.824241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababd76c-13de-4c9c-ad9f-4bb522a3b4b5 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:36.876350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f64f2-08bb-47e3-903a-83ae9e89157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:36.877629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f64f2-08bb-47e3-903a-83ae9e89157d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:36.878080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 193/389] 10.222.0.112 () {58 vars in 1447 bytes} [Thu May 26 16:33:36 2022] PUT /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01/groups/7326986284c14d2885e2bbdc1db71520/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:33:36.878231 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f64f2-08bb-47e3-903a-83ae9e89157d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:36.879602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f64f2-08bb-47e3-903a-83ae9e89157d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:36.905316 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f64f2-08bb-47e3-903a-83ae9e89157d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-357f64f2-08bb-47e3-903a-83ae9e89157d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:36.913612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:36.916588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:36.918185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:36.918185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:36.918185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:36.918185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:36.918185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:36.918185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:36.918185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:36.918185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:36.918185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:36.918185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:36.918185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:36.918185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:36.920050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 197/390] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:33:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:33:36.926054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451711cb-0d96-4d89-94bc-39d90a959398 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:36.935834 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:37.103308 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451711cb-0d96-4d89-94bc-39d90a959398 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:37.194674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef255c53-d70f-4a38-bac3-1f0bda9fafb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:37.195538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef255c53-d70f-4a38-bac3-1f0bda9fafb2 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:37.195847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef255c53-d70f-4a38-bac3-1f0bda9fafb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:37.196169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef255c53-d70f-4a38-bac3-1f0bda9fafb2 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:37.200090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef255c53-d70f-4a38-bac3-1f0bda9fafb2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:37.200090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef255c53-d70f-4a38-bac3-1f0bda9fafb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:37.201188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef255c53-d70f-4a38-bac3-1f0bda9fafb2 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:37.217019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 194/391] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:33:36 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:37.225501 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f64f2-08bb-47e3-903a-83ae9e89157d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:37.311205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:37.322137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd88c8c-5f06-4913-8a6f-fa8ed8ab472d None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:37.322775 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd88c8c-5f06-4913-8a6f-fa8ed8ab472d None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:37.326592 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd88c8c-5f06-4913-8a6f-fa8ed8ab472d None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:37.330487 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 195/392] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:37 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:33:37.336577 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c1e09-78a3-4fb6-bce6-bc6d14d31bcc None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:37.337202 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c1e09-78a3-4fb6-bce6-bc6d14d31bcc None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:37.337805 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c1e09-78a3-4fb6-bce6-bc6d14d31bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:37.378389 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-c83c1e09-78a3-4fb6-bce6-bc6d14d31bcc None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:37.382145 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-c83c1e09-78a3-4fb6-bce6-bc6d14d31bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:37.397031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f64f2-08bb-47e3-903a-83ae9e89157d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:37.466150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c06982-9bad-4a10-9fc9-84485fcb02a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:37.467615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c06982-9bad-4a10-9fc9-84485fcb02a6 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:37.468113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c06982-9bad-4a10-9fc9-84485fcb02a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:37.468596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c06982-9bad-4a10-9fc9-84485fcb02a6 None admin] PATH_INFO: `/v3/groups/7326986284c14d2885e2bbdc1db71520` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:37.471601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c06982-9bad-4a10-9fc9-84485fcb02a6 None admin] RBAC: Authorizing `identity:get_group(group_id=7326986284c14d2885e2bbdc1db71520)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:37.477315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c06982-9bad-4a10-9fc9-84485fcb02a6 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:37.486117 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 198/393] 10.222.0.112 () {56 vars in 1185 bytes} [Thu May 26 16:33:37 2022] GET /identity/v3/groups/7326986284c14d2885e2bbdc1db71520 => generated 227 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:37.498225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c06982-9bad-4a10-9fc9-84485fcb02a6 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:37.546404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:37.562374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 196/394] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:37.586489 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c1e09-78a3-4fb6-bce6-bc6d14d31bcc None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:37.696288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c06982-9bad-4a10-9fc9-84485fcb02a6 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:37.735876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa16e37-78e8-4ab5-836f-115b6602bf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:37.737213 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa16e37-78e8-4ab5-836f-115b6602bf52 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:37.737719 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa16e37-78e8-4ab5-836f-115b6602bf52 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:37.738190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa16e37-78e8-4ab5-836f-115b6602bf52 None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:37.740026 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa16e37-78e8-4ab5-836f-115b6602bf52 None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:37.741817 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa16e37-78e8-4ab5-836f-115b6602bf52 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:37.746565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:37.749864 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 199/395] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:37 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:37.751509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66a43f-ca1c-4a20-b73f-3b035b3056fa None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:37.751901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66a43f-ca1c-4a20-b73f-3b035b3056fa None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:37.752279 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66a43f-ca1c-4a20-b73f-3b035b3056fa None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:37.753847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 200/396] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:37.754696 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66a43f-ca1c-4a20-b73f-3b035b3056fa None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:37.786732 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c1e09-78a3-4fb6-bce6-bc6d14d31bcc None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:37.845169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c06ffa-86db-46df-81f2-2c7fe00bdf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:37.846480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c06ffa-86db-46df-81f2-2c7fe00bdf74 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:37.846968 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c06ffa-86db-46df-81f2-2c7fe00bdf74 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:37.847448 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c06ffa-86db-46df-81f2-2c7fe00bdf74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:37.860813 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c06ffa-86db-46df-81f2-2c7fe00bdf74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-54c06ffa-86db-46df-81f2-2c7fe00bdf74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:37.869039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:37.870890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:37.872153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:37.872153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:37.872153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:37.872153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:37.872153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:37.872153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:37.872153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:37.872153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:37.872153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:37.872153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:37.872153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:37.872153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:37.872153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 197/397] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:37.873184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c51a1-a518-4606-8bba-e0111f115d6f None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:37.873184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c51a1-a518-4606-8bba-e0111f115d6f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:37.873400 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c51a1-a518-4606-8bba-e0111f115d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:37.893385 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-2e5c51a1-a518-4606-8bba-e0111f115d6f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:37.894637 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2e5c51a1-a518-4606-8bba-e0111f115d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:37.926359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66a43f-ca1c-4a20-b73f-3b035b3056fa None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:37.955137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:37.972113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 198/398] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:37.973380 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c51a1-a518-4606-8bba-e0111f115d6f None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:37.985829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cf6e4-1d0e-45f7-805a-777a14b404a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:37.987712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cf6e4-1d0e-45f7-805a-777a14b404a4 None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:37.988201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cf6e4-1d0e-45f7-805a-777a14b404a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:37.988813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cf6e4-1d0e-45f7-805a-777a14b404a4 None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01/groups/7326986284c14d2885e2bbdc1db71520/roles/0449b3526e454e9ea05258c90de6de31` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:37.993295 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cf6e4-1d0e-45f7-805a-777a14b404a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e623ea7f63f489ba500d0b565430c01, group_id=7326986284c14d2885e2bbdc1db71520, role_id=0449b3526e454e9ea05258c90de6de31)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:37.996756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cf6e4-1d0e-45f7-805a-777a14b404a4 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:38.089093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 201/399] 10.222.0.112 () {58 vars in 1447 bytes} [Thu May 26 16:33:37 2022] PUT /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01/groups/7326986284c14d2885e2bbdc1db71520/roles/0449b3526e454e9ea05258c90de6de31 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:33:38.092134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50b29c-e9d1-4c6d-a5b7-791d487b3bcc None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:38.092973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50b29c-e9d1-4c6d-a5b7-791d487b3bcc None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:38.093682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50b29c-e9d1-4c6d-a5b7-791d487b3bcc None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:38.102524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 202/400] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:38 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:38.107646 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50b29c-e9d1-4c6d-a5b7-791d487b3bcc None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:38.141393 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c51a1-a518-4606-8bba-e0111f115d6f None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:38.176463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:38.193500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c46df-7eef-4640-ab5c-6cc697912cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:38.239722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c46df-7eef-4640-ab5c-6cc697912cb7 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:38.239722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c46df-7eef-4640-ab5c-6cc697912cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:38.239722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c46df-7eef-4640-ab5c-6cc697912cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:38.239722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c46df-7eef-4640-ab5c-6cc697912cb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:38.239722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c46df-7eef-4640-ab5c-6cc697912cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:38.239722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c46df-7eef-4640-ab5c-6cc697912cb7 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:38.241363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 199/401] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:37 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:38.241363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37508634-2707-4b93-98b9-276a5a0ebd69 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:38.241363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37508634-2707-4b93-98b9-276a5a0ebd69 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:38.241363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37508634-2707-4b93-98b9-276a5a0ebd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:38.244166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-37508634-2707-4b93-98b9-276a5a0ebd69 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:38.246575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-37508634-2707-4b93-98b9-276a5a0ebd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:38.312299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50b29c-e9d1-4c6d-a5b7-791d487b3bcc None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:38.326132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:38.366410 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 200/402] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:38.368447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37508634-2707-4b93-98b9-276a5a0ebd69 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:38.387319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a12e6a-8c8d-41ef-903b-9696f56853f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:38.388160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a12e6a-8c8d-41ef-903b-9696f56853f9 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:38.390618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a12e6a-8c8d-41ef-903b-9696f56853f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:38.390958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a12e6a-8c8d-41ef-903b-9696f56853f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:38.414620 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a12e6a-8c8d-41ef-903b-9696f56853f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-96a12e6a-8c8d-41ef-903b-9696f56853f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:38.425550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:38.427389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:38.430424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:38.430424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:38.430424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:38.430424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:38.430424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:38.430424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:38.430424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:38.430424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:38.430424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:38.430424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:38.430424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:38.430424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:38.430424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 203/403] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:33:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:38.430424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a12e6a-8c8d-41ef-903b-9696f56853f9 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:38.563645 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37508634-2707-4b93-98b9-276a5a0ebd69 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:38.630187 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be483841-6f6d-44db-b5e0-f170c131dd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:38.631873 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be483841-6f6d-44db-b5e0-f170c131dd95 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:38.632226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be483841-6f6d-44db-b5e0-f170c131dd95 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:38.632706 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be483841-6f6d-44db-b5e0-f170c131dd95 None admin] PATH_INFO: `/v3/groups/7326986284c14d2885e2bbdc1db71520` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:38.634723 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be483841-6f6d-44db-b5e0-f170c131dd95 None admin] RBAC: Authorizing `identity:get_group(group_id=7326986284c14d2885e2bbdc1db71520)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:38.638232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be483841-6f6d-44db-b5e0-f170c131dd95 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:38.641212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 201/404] 10.222.0.112 () {56 vars in 1185 bytes} [Thu May 26 16:33:38 2022] GET /identity/v3/groups/7326986284c14d2885e2bbdc1db71520 => generated 227 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:38.642705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be483841-6f6d-44db-b5e0-f170c131dd95 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:38.643723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:38.653118 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a12e6a-8c8d-41ef-903b-9696f56853f9 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:38.727918 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b0989-f48b-4158-8da4-56de5d92eed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:38.728487 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:38.732812 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b0989-f48b-4158-8da4-56de5d92eed0 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:38.733253 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b0989-f48b-4158-8da4-56de5d92eed0 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:38.733693 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b0989-f48b-4158-8da4-56de5d92eed0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:38.751458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b0989-f48b-4158-8da4-56de5d92eed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-5f2b0989-f48b-4158-8da4-56de5d92eed0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:38.760257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:38.762101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:38.769855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:38.769855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:38.769855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:38.769855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:38.769855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:38.769855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:38.769855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:38.769855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:38.769855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:38.769855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:38.769855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:38.769855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:38.769855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 204/405] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:33:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:38.769855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b0989-f48b-4158-8da4-56de5d92eed0 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:38.837737 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be483841-6f6d-44db-b5e0-f170c131dd95 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:38.890837 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f882a27-e2c6-4348-8480-27e8c229c530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:38.891974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f882a27-e2c6-4348-8480-27e8c229c530 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:38.892534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f882a27-e2c6-4348-8480-27e8c229c530 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:38.893088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f882a27-e2c6-4348-8480-27e8c229c530 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:38.894073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f882a27-e2c6-4348-8480-27e8c229c530 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:38.894972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f882a27-e2c6-4348-8480-27e8c229c530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:38.896715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f882a27-e2c6-4348-8480-27e8c229c530 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:38.909040 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 202/406] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:33:38 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:38.910519 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f882a27-e2c6-4348-8480-27e8c229c530 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:38.967672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b0989-f48b-4158-8da4-56de5d92eed0 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:39.018358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33346cbd-c1cc-4b07-97e9-9741efb5ddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:39.019342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33346cbd-c1cc-4b07-97e9-9741efb5ddd7 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:39.019596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33346cbd-c1cc-4b07-97e9-9741efb5ddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:39.019880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33346cbd-c1cc-4b07-97e9-9741efb5ddd7 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:39.021090 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33346cbd-c1cc-4b07-97e9-9741efb5ddd7 None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:39.022587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33346cbd-c1cc-4b07-97e9-9741efb5ddd7 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:39.025210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 205/407] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:38 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:39.026253 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33346cbd-c1cc-4b07-97e9-9741efb5ddd7 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:39.066516 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f882a27-e2c6-4348-8480-27e8c229c530 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:39.068392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:39.078442 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:39.117424 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21faccf5-4c21-4393-9d06-76003bc0f5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:39.119679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21faccf5-4c21-4393-9d06-76003bc0f5ea None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:39.120435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21faccf5-4c21-4393-9d06-76003bc0f5ea None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:39.121175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21faccf5-4c21-4393-9d06-76003bc0f5ea None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:39.123150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21faccf5-4c21-4393-9d06-76003bc0f5ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:39.123885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21faccf5-4c21-4393-9d06-76003bc0f5ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:39.128341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21faccf5-4c21-4393-9d06-76003bc0f5ea None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:39.146192 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 203/408] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:38 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:39.146192 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21faccf5-4c21-4393-9d06-76003bc0f5ea None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:39.165582 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33346cbd-c1cc-4b07-97e9-9741efb5ddd7 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:39.216313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c29451-cee7-4234-800e-bf1102d24cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:39.217608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c29451-cee7-4234-800e-bf1102d24cd5 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:39.218176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c29451-cee7-4234-800e-bf1102d24cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:39.218712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c29451-cee7-4234-800e-bf1102d24cd5 None admin] PATH_INFO: `/v3/groups/7326986284c14d2885e2bbdc1db71520` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:39.220934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c29451-cee7-4234-800e-bf1102d24cd5 None admin] RBAC: Authorizing `identity:get_group(group_id=7326986284c14d2885e2bbdc1db71520)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:39.223740 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c29451-cee7-4234-800e-bf1102d24cd5 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:39.227101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 206/409] 10.222.0.112 () {56 vars in 1185 bytes} [Thu May 26 16:33:39 2022] GET /identity/v3/groups/7326986284c14d2885e2bbdc1db71520 => generated 227 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:39.235671 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c29451-cee7-4234-800e-bf1102d24cd5 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:39.278526 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21faccf5-4c21-4393-9d06-76003bc0f5ea None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:39.317362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3456897-fb2f-4a36-8706-f28c218005c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:39.318915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3456897-fb2f-4a36-8706-f28c218005c4 None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:39.319398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3456897-fb2f-4a36-8706-f28c218005c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:39.320004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3456897-fb2f-4a36-8706-f28c218005c4 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316/groups/7326986284c14d2885e2bbdc1db71520/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:39.322355 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3456897-fb2f-4a36-8706-f28c218005c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9dd29f6d3b974bff8206091ffee50316, group_id=7326986284c14d2885e2bbdc1db71520, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:39.324724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3456897-fb2f-4a36-8706-f28c218005c4 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:39.413427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:39.423542 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c29451-cee7-4234-800e-bf1102d24cd5 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:39.485376 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a2080-dc24-425f-b9f9-94bb70e11aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:39.486388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a2080-dc24-425f-b9f9-94bb70e11aa2 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:39.486683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a2080-dc24-425f-b9f9-94bb70e11aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:39.486949 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a2080-dc24-425f-b9f9-94bb70e11aa2 None admin] PATH_INFO: `/v3/groups/eb1890b8a30b432fa3de003e9c8b8011` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:39.488870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a2080-dc24-425f-b9f9-94bb70e11aa2 None admin] RBAC: Authorizing `identity:get_group(group_id=eb1890b8a30b432fa3de003e9c8b8011)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:39.489870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a2080-dc24-425f-b9f9-94bb70e11aa2 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:39.498428 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 207/410] 10.222.0.112 () {56 vars in 1185 bytes} [Thu May 26 16:33:39 2022] GET /identity/v3/groups/eb1890b8a30b432fa3de003e9c8b8011 => generated 230 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:39.498428 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a2080-dc24-425f-b9f9-94bb70e11aa2 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:39.507434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 204/411] 10.222.0.112 () {58 vars in 1447 bytes} [Thu May 26 16:33:39 2022] PUT /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316/groups/7326986284c14d2885e2bbdc1db71520/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:33:39.516617 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3456897-fb2f-4a36-8706-f28c218005c4 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:39.639408 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:39.813301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3456897-fb2f-4a36-8706-f28c218005c4 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:39.838374 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a2080-dc24-425f-b9f9-94bb70e11aa2 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:39.888330 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e676c01-04b3-4dda-9d50-f817682fa11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:39.890649 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e676c01-04b3-4dda-9d50-f817682fa11e None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:39.891478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e676c01-04b3-4dda-9d50-f817682fa11e None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:39.891656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e676c01-04b3-4dda-9d50-f817682fa11e None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:39.895196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e676c01-04b3-4dda-9d50-f817682fa11e None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:39.897113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cc1f7-d917-4440-9983-d5a0d1c20b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:39.897910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e676c01-04b3-4dda-9d50-f817682fa11e None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:39.898364 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cc1f7-d917-4440-9983-d5a0d1c20b26 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:39.898792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cc1f7-d917-4440-9983-d5a0d1c20b26 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:39.899213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cc1f7-d917-4440-9983-d5a0d1c20b26 None admin] PATH_INFO: `/v3/projects/9dda95f8437548158ad5e83593c71483` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:39.900611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cc1f7-d917-4440-9983-d5a0d1c20b26 None admin] RBAC: Authorizing `identity:get_project(project_id=9dda95f8437548158ad5e83593c71483)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:39.901088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 208/412] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:39 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:39.904401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cc1f7-d917-4440-9983-d5a0d1c20b26 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:39.906459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 205/413] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:39 2022] GET /identity/v3/projects/9dda95f8437548158ad5e83593c71483 => generated 345 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:39.915525 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cc1f7-d917-4440-9983-d5a0d1c20b26 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:39.916317 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e676c01-04b3-4dda-9d50-f817682fa11e None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:39.975169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:40.090977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e676c01-04b3-4dda-9d50-f817682fa11e None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:40.137486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:40.138508 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e2a2e-5a96-4c00-883b-cd2859106d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:40.139581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e2a2e-5a96-4c00-883b-cd2859106d95 None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:40.140034 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e2a2e-5a96-4c00-883b-cd2859106d95 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:40.140330 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e2a2e-5a96-4c00-883b-cd2859106d95 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316/groups/7326986284c14d2885e2bbdc1db71520/roles/0449b3526e454e9ea05258c90de6de31` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:40.142443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cc1f7-d917-4440-9983-d5a0d1c20b26 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:40.142879 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e2a2e-5a96-4c00-883b-cd2859106d95 None admin] RBAC: Authorizing `identity:create_grant(project_id=9dd29f6d3b974bff8206091ffee50316, group_id=7326986284c14d2885e2bbdc1db71520, role_id=0449b3526e454e9ea05258c90de6de31)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:40.144476 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e2a2e-5a96-4c00-883b-cd2859106d95 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:40.188273 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e6aad-1caf-48c3-992f-909647a83749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:40.189506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e6aad-1caf-48c3-992f-909647a83749 None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:40.190163 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e6aad-1caf-48c3-992f-909647a83749 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:40.190499 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e6aad-1caf-48c3-992f-909647a83749 None admin] PATH_INFO: `/v3/projects/9dda95f8437548158ad5e83593c71483/groups/eb1890b8a30b432fa3de003e9c8b8011/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:40.192776 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e6aad-1caf-48c3-992f-909647a83749 None admin] RBAC: Authorizing `identity:create_grant(project_id=9dda95f8437548158ad5e83593c71483, group_id=eb1890b8a30b432fa3de003e9c8b8011, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:40.194223 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e6aad-1caf-48c3-992f-909647a83749 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:40.310350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 209/414] 10.222.0.112 () {58 vars in 1447 bytes} [Thu May 26 16:33:39 2022] PUT /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316/groups/7326986284c14d2885e2bbdc1db71520/roles/0449b3526e454e9ea05258c90de6de31 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:33:40.310350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71926e-5c85-4ac7-99cd-77b0a522f1b0 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:40.310350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71926e-5c85-4ac7-99cd-77b0a522f1b0 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:40.310350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71926e-5c85-4ac7-99cd-77b0a522f1b0 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:40.310350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 210/415] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:40.320787 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b9e3b-6743-49c8-a3df-5da566657e25 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:40.321443 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b9e3b-6743-49c8-a3df-5da566657e25 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:40.322012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b9e3b-6743-49c8-a3df-5da566657e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:40.346006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-2e4b9e3b-6743-49c8-a3df-5da566657e25 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:40.348203 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-2e4b9e3b-6743-49c8-a3df-5da566657e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:40.355660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 206/416] 10.222.0.112 () {58 vars in 1447 bytes} [Thu May 26 16:33:39 2022] PUT /identity/v3/projects/9dda95f8437548158ad5e83593c71483/groups/eb1890b8a30b432fa3de003e9c8b8011/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:33:40.460274 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 211/417] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:40.507600 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e6aad-1caf-48c3-992f-909647a83749 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:40.690226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e6aad-1caf-48c3-992f-909647a83749 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:40.743193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88345b3e-c43f-45a7-bd54-42d4eae911b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:40.744089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88345b3e-c43f-45a7-bd54-42d4eae911b4 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:40.744386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88345b3e-c43f-45a7-bd54-42d4eae911b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:40.744674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88345b3e-c43f-45a7-bd54-42d4eae911b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:40.763543 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88345b3e-c43f-45a7-bd54-42d4eae911b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-88345b3e-c43f-45a7-bd54-42d4eae911b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:40.771602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:40.773704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:40.775473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:40.775473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:40.775473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:40.775473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:40.775473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:40.775473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:40.775473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:40.775473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:40.775473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:40.775473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:40.775473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:40.775473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:40.775473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 207/418] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:40.784443 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b9e3b-6743-49c8-a3df-5da566657e25 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:40.840055 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6682d26-58f1-4061-b62c-62d9d761c057 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:40.840566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6682d26-58f1-4061-b62c-62d9d761c057 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:40.841038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6682d26-58f1-4061-b62c-62d9d761c057 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:40.843707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 208/419] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:40 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:40.846236 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:40.850640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dc0b3-25ec-41d0-920f-b30cf924f1e3 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:40.850937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dc0b3-25ec-41d0-920f-b30cf924f1e3 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:40.851223 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dc0b3-25ec-41d0-920f-b30cf924f1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:40.872366 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-142dc0b3-25ec-41d0-920f-b30cf924f1e3 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:40.873583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-142dc0b3-25ec-41d0-920f-b30cf924f1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:40.903437 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:41.008424 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 209/420] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:41.018188 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b9e3b-6743-49c8-a3df-5da566657e25 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:41.057720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dc0b3-25ec-41d0-920f-b30cf924f1e3 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:41.075085 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf2e02-e3a4-400e-a358-50f9c73ba483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:41.075781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf2e02-e3a4-400e-a358-50f9c73ba483 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:41.076069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf2e02-e3a4-400e-a358-50f9c73ba483 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:41.076348 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf2e02-e3a4-400e-a358-50f9c73ba483 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:41.077122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf2e02-e3a4-400e-a358-50f9c73ba483 None admin] RBAC: Adding query filter params (name=member) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:41.077432 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf2e02-e3a4-400e-a358-50f9c73ba483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:41.078902 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf2e02-e3a4-400e-a358-50f9c73ba483 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:41.098068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 212/421] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:40 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:41.105710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf2e02-e3a4-400e-a358-50f9c73ba483 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:41.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dc0b3-25ec-41d0-920f-b30cf924f1e3 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:41.310984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:41.339550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf2e02-e3a4-400e-a358-50f9c73ba483 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:41.341691 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced5555-a04d-46b9-b4fc-5f5f5c0068c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:41.342721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced5555-a04d-46b9-b4fc-5f5f5c0068c9 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:41.343119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced5555-a04d-46b9-b4fc-5f5f5c0068c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:41.343526 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced5555-a04d-46b9-b4fc-5f5f5c0068c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:41.372225 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced5555-a04d-46b9-b4fc-5f5f5c0068c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-0ced5555-a04d-46b9-b4fc-5f5f5c0068c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:41.380745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:41.382013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:41.383003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:41.383003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:41.383003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:41.383003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:41.383003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:41.383003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:41.383003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:41.383003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:41.383003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:41.383003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:41.383003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:41.383003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:41.383003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 210/422] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:33:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:41.389746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced5555-a04d-46b9-b4fc-5f5f5c0068c9 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:41.406719 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:41.413872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93421a-1115-41bf-b46d-3185aacb0e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:41.414617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93421a-1115-41bf-b46d-3185aacb0e8d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:41.414901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93421a-1115-41bf-b46d-3185aacb0e8d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:41.415199 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93421a-1115-41bf-b46d-3185aacb0e8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:41.547423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced5555-a04d-46b9-b4fc-5f5f5c0068c9 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:41.585631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a850b-53b9-4de0-bd21-de455d01dfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:41.586705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a850b-53b9-4de0-bd21-de455d01dfa1 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:41.586992 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a850b-53b9-4de0-bd21-de455d01dfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:41.587269 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a850b-53b9-4de0-bd21-de455d01dfa1 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:41.588047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a850b-53b9-4de0-bd21-de455d01dfa1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:41.588353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a850b-53b9-4de0-bd21-de455d01dfa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:41.590306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a850b-53b9-4de0-bd21-de455d01dfa1 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:41.599331 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93421a-1115-41bf-b46d-3185aacb0e8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:41.600904 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93421a-1115-41bf-b46d-3185aacb0e8d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:41.601090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 211/423] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:33:41 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:41.610588 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a850b-53b9-4de0-bd21-de455d01dfa1 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:41.726739 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:41.766445 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a850b-53b9-4de0-bd21-de455d01dfa1 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:41.810622 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4db31-2e70-4160-be54-e11b873f9a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:41.811300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4db31-2e70-4160-be54-e11b873f9a09 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:41.811590 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4db31-2e70-4160-be54-e11b873f9a09 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:41.811875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4db31-2e70-4160-be54-e11b873f9a09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:41.869423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:41.897149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4db31-2e70-4160-be54-e11b873f9a09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:41.898676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4db31-2e70-4160-be54-e11b873f9a09 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:41.950188 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 213/424] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:41 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 845 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:33:41.960164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93421a-1115-41bf-b46d-3185aacb0e8d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:41.990731 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:42.070124 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 212/425] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:41 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:33:42.076219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4db31-2e70-4160-be54-e11b873f9a09 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:42.117440 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93421a-1115-41bf-b46d-3185aacb0e8d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:42.158927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f34689-3b14-4141-8efd-be7a2a3d75d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:42.159816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f34689-3b14-4141-8efd-be7a2a3d75d0 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:42.160097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f34689-3b14-4141-8efd-be7a2a3d75d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:42.160373 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f34689-3b14-4141-8efd-be7a2a3d75d0 None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:42.161630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f34689-3b14-4141-8efd-be7a2a3d75d0 None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:42.166359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f34689-3b14-4141-8efd-be7a2a3d75d0 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:42.166359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 214/426] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:41 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:42.172012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f34689-3b14-4141-8efd-be7a2a3d75d0 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:42.314752 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:42.410377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4db31-2e70-4160-be54-e11b873f9a09 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:42.412371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f34689-3b14-4141-8efd-be7a2a3d75d0 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:42.471163 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbeaf6-cafe-4654-a36c-f43d0433f71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:42.472624 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbeaf6-cafe-4654-a36c-f43d0433f71f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:42.473078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbeaf6-cafe-4654-a36c-f43d0433f71f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:42.473505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbeaf6-cafe-4654-a36c-f43d0433f71f None admin] PATH_INFO: `/v3/groups/7326986284c14d2885e2bbdc1db71520` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:42.475615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbeaf6-cafe-4654-a36c-f43d0433f71f None admin] RBAC: Authorizing `identity:get_group(group_id=7326986284c14d2885e2bbdc1db71520)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:42.478019 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbeaf6-cafe-4654-a36c-f43d0433f71f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:42.481472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 215/427] 10.222.0.112 () {56 vars in 1185 bytes} [Thu May 26 16:33:42 2022] GET /identity/v3/groups/7326986284c14d2885e2bbdc1db71520 => generated 227 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:42.487700 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbeaf6-cafe-4654-a36c-f43d0433f71f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:42.505626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aef5e-3eb2-4dcf-809f-bce917bcf428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:42.506572 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aef5e-3eb2-4dcf-809f-bce917bcf428 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:42.506855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aef5e-3eb2-4dcf-809f-bce917bcf428 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:42.507131 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aef5e-3eb2-4dcf-809f-bce917bcf428 None admin] PATH_INFO: `/v3/projects/9e623ea7f63f489ba500d0b565430c01` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:42.511140 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0aef5e-3eb2-4dcf-809f-bce917bcf428 None admin] RBAC: Authorizing `identity:get_project(project_id=9e623ea7f63f489ba500d0b565430c01)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:42.512604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0aef5e-3eb2-4dcf-809f-bce917bcf428 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:42.514557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 213/428] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:42 2022] GET /identity/v3/projects/9e623ea7f63f489ba500d0b565430c01 => generated 299 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:42.521058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aef5e-3eb2-4dcf-809f-bce917bcf428 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:42.607665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:42.763364 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aef5e-3eb2-4dcf-809f-bce917bcf428 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:42.780410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbeaf6-cafe-4654-a36c-f43d0433f71f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:42.842884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:42.843891 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ddfbf-7431-472f-828a-24c7bb315153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:42.845165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ddfbf-7431-472f-828a-24c7bb315153 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:42.845663 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ddfbf-7431-472f-828a-24c7bb315153 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:42.846156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ddfbf-7431-472f-828a-24c7bb315153 None admin] PATH_INFO: `/v3/groups/7326986284c14d2885e2bbdc1db71520` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:42.848412 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ddfbf-7431-472f-828a-24c7bb315153 None admin] RBAC: Authorizing `identity:get_group(group_id=7326986284c14d2885e2bbdc1db71520)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:42.851109 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ddfbf-7431-472f-828a-24c7bb315153 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:42.858811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 214/429] 10.222.0.112 () {56 vars in 1185 bytes} [Thu May 26 16:33:42 2022] GET /identity/v3/groups/7326986284c14d2885e2bbdc1db71520 => generated 227 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:42.861214 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ddfbf-7431-472f-828a-24c7bb315153 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:42.893056 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d9cc1-2f00-454b-b27c-20a77d99763a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:42.894212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d9cc1-2f00-454b-b27c-20a77d99763a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:42.894749 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d9cc1-2f00-454b-b27c-20a77d99763a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:42.895280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d9cc1-2f00-454b-b27c-20a77d99763a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:42.896683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d9cc1-2f00-454b-b27c-20a77d99763a None admin] RBAC: Adding query filter params (group.id=7326986284c14d2885e2bbdc1db71520, role.id=5a16a034a01e45b89530e8dd35d56588, scope.project.id=9e623ea7f63f489ba500d0b565430c01) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:42.897250 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d9cc1-2f00-454b-b27c-20a77d99763a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:42.898982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d9cc1-2f00-454b-b27c-20a77d99763a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:42.914874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 216/430] 10.222.0.112 () {56 vars in 1381 bytes} [Thu May 26 16:33:42 2022] GET /identity/v3/role_assignments?group.id=7326986284c14d2885e2bbdc1db71520&scope.project.id=9e623ea7f63f489ba500d0b565430c01&role.id=5a16a034a01e45b89530e8dd35d56588 => generated 613 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:42.917898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7be99-59b9-408d-b6ea-c846067ec023 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:42.918784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7be99-59b9-408d-b6ea-c846067ec023 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:42.919590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7be99-59b9-408d-b6ea-c846067ec023 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:42.930862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 217/431] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:42 2022] GET /identity => generated 271 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:42.938151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdeac2-830c-4502-ae34-dedad0118dc6 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:42.938803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdeac2-830c-4502-ae34-dedad0118dc6 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:42.939280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdeac2-830c-4502-ae34-dedad0118dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:42.969007 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-82cdeac2-830c-4502-ae34-dedad0118dc6 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:42.970535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-82cdeac2-830c-4502-ae34-dedad0118dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:43.022838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ddfbf-7431-472f-828a-24c7bb315153 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:43.033450 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:43.078151 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c7a8e-7a16-4e18-a555-8352eadfb519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:43.080252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7a8e-7a16-4e18-a555-8352eadfb519 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:43.080976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7a8e-7a16-4e18-a555-8352eadfb519 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:43.083098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7a8e-7a16-4e18-a555-8352eadfb519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:43.085264 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c7a8e-7a16-4e18-a555-8352eadfb519 None admin] RBAC: Adding query filter params (group.id=7326986284c14d2885e2bbdc1db71520, role.id=0449b3526e454e9ea05258c90de6de31, scope.project.id=9e623ea7f63f489ba500d0b565430c01) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:43.087757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c7a8e-7a16-4e18-a555-8352eadfb519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:43.089694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c7a8e-7a16-4e18-a555-8352eadfb519 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:43.102151 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 215/432] 10.222.0.112 () {56 vars in 1381 bytes} [Thu May 26 16:33:42 2022] GET /identity/v3/role_assignments?group.id=7326986284c14d2885e2bbdc1db71520&scope.project.id=9e623ea7f63f489ba500d0b565430c01&role.id=0449b3526e454e9ea05258c90de6de31 => generated 613 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:43.117675 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 218/433] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:43.148554 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c7a8e-7a16-4e18-a555-8352eadfb519 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:43.336302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c7a8e-7a16-4e18-a555-8352eadfb519 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:43.405816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498b328-93e0-447e-87fd-1964d244b347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:43.407569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498b328-93e0-447e-87fd-1964d244b347 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:43.408299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498b328-93e0-447e-87fd-1964d244b347 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:43.408951 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498b328-93e0-447e-87fd-1964d244b347 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:43.428045 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498b328-93e0-447e-87fd-1964d244b347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-8498b328-93e0-447e-87fd-1964d244b347 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:43.437574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:43.438570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:43.439392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:43.439392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:43.439392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:43.439392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:43.439392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:43.439392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:43.439392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:43.439392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:43.439392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:43.439392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:43.439392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:33:43.439392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:43.444105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 216/434] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:43.450675 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdeac2-830c-4502-ae34-dedad0118dc6 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:43.595946 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ee1d0-825c-4e39-a764-bc09e6dbcd02 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:43.596857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ee1d0-825c-4e39-a764-bc09e6dbcd02 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:43.597658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ee1d0-825c-4e39-a764-bc09e6dbcd02 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:43.603082 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 217/435] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:43 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:43.611066 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bdcfc-654a-4bf3-9a94-983f8f8a5533 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:43.612180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdeac2-830c-4502-ae34-dedad0118dc6 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:43.612465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bdcfc-654a-4bf3-9a94-983f8f8a5533 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:43.612868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bdcfc-654a-4bf3-9a94-983f8f8a5533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:43.645667 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:43.648556 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-780bdcfc-654a-4bf3-9a94-983f8f8a5533 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:43.651438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-780bdcfc-654a-4bf3-9a94-983f8f8a5533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:43.679163 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b1026-76fa-4e87-8935-dd02e303bcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:43.680730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b1026-76fa-4e87-8935-dd02e303bcfb None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:43.681219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b1026-76fa-4e87-8935-dd02e303bcfb None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:43.681691 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b1026-76fa-4e87-8935-dd02e303bcfb None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:43.683066 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b1026-76fa-4e87-8935-dd02e303bcfb None admin] RBAC: Adding query filter params (name=member) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:43.683599 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b1026-76fa-4e87-8935-dd02e303bcfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:43.685954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b1026-76fa-4e87-8935-dd02e303bcfb None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:43.700792 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 219/436] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:33:43 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:43.703496 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3ba4e-fb6a-4006-ba1e-97a6aac2927e None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:43.704054 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3ba4e-fb6a-4006-ba1e-97a6aac2927e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:43.705841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3ba4e-fb6a-4006-ba1e-97a6aac2927e None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:43.707681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 220/437] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:43 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:43.710439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:43.710659 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3ba4e-fb6a-4006-ba1e-97a6aac2927e None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:43.794204 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 218/438] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:43.796359 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95945c90-9860-4cdf-a0fe-5b8d6df8e121 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:43.796818 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95945c90-9860-4cdf-a0fe-5b8d6df8e121 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:43.797301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95945c90-9860-4cdf-a0fe-5b8d6df8e121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:43.818517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-95945c90-9860-4cdf-a0fe-5b8d6df8e121 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:43.819780 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-95945c90-9860-4cdf-a0fe-5b8d6df8e121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:43.911394 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3ba4e-fb6a-4006-ba1e-97a6aac2927e None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:43.938772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 219/439] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:43.940162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95945c90-9860-4cdf-a0fe-5b8d6df8e121 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:43.974303 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d8fe9-644f-47df-8139-0bae869843ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:43.975132 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d8fe9-644f-47df-8139-0bae869843ac None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:43.975367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d8fe9-644f-47df-8139-0bae869843ac None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:43.975648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d8fe9-644f-47df-8139-0bae869843ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:44.046913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:44.091201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d8fe9-644f-47df-8139-0bae869843ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:44.093940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d8fe9-644f-47df-8139-0bae869843ac None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:44.108762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:44.121374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95945c90-9860-4cdf-a0fe-5b8d6df8e121 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:44.169752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43130d4b-fef7-491a-9ba8-bf99d0ac567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:44.170952 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43130d4b-fef7-491a-9ba8-bf99d0ac567c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:44.171540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43130d4b-fef7-491a-9ba8-bf99d0ac567c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:44.171998 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43130d4b-fef7-491a-9ba8-bf99d0ac567c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:44.190535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43130d4b-fef7-491a-9ba8-bf99d0ac567c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-43130d4b-fef7-491a-9ba8-bf99d0ac567c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:44.204558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:44.206243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:44.208245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:44.208245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:44.208245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:44.208245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:44.208245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:44.208245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:44.208245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:44.208245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:44.208245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:44.208245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:44.208245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:44.208245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:44.208245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 220/440] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:33:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:44.208245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43130d4b-fef7-491a-9ba8-bf99d0ac567c None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:44.242399 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 221/441] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:44.243261 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d8fe9-644f-47df-8139-0bae869843ac None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:44.338073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43130d4b-fef7-491a-9ba8-bf99d0ac567c None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:44.347991 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:44.378258 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d8fe9-644f-47df-8139-0bae869843ac None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:44.399673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec66b7-4996-478f-a353-3122e2389586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:44.401422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec66b7-4996-478f-a353-3122e2389586 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:44.401903 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec66b7-4996-478f-a353-3122e2389586 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:44.402281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec66b7-4996-478f-a353-3122e2389586 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:44.423068 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec66b7-4996-478f-a353-3122e2389586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:44.425114 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabeb41-ee22-4f33-93e1-b6db033a2edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:44.425809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabeb41-ee22-4f33-93e1-b6db033a2edc None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:44.426099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabeb41-ee22-4f33-93e1-b6db033a2edc None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:44.426476 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabeb41-ee22-4f33-93e1-b6db033a2edc None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:44.429704 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabeb41-ee22-4f33-93e1-b6db033a2edc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:44.429704 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabeb41-ee22-4f33-93e1-b6db033a2edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:44.429704 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabeb41-ee22-4f33-93e1-b6db033a2edc None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-cdec66b7-4996-478f-a353-3122e2389586 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:44.433836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:44.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:44.444181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:44.444181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:44.444181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:44.444181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:44.444181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:44.444181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:44.444181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:44.444181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:44.444181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:44.444181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:44.444181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:44.444181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:44.444181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 221/442] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:33:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:44.444181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec66b7-4996-478f-a353-3122e2389586 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:44.444899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 222/443] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:44 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:44.444899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabeb41-ee22-4f33-93e1-b6db033a2edc None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:44.455557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:44.570816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec66b7-4996-478f-a353-3122e2389586 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:44.574692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabeb41-ee22-4f33-93e1-b6db033a2edc None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:44.615082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd03aa-a7ed-4c24-aad7-3891adc1a372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:44.615894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd03aa-a7ed-4c24-aad7-3891adc1a372 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:44.616302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd03aa-a7ed-4c24-aad7-3891adc1a372 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:44.616671 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd03aa-a7ed-4c24-aad7-3891adc1a372 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:44.617608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd03aa-a7ed-4c24-aad7-3891adc1a372 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:44.618063 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd03aa-a7ed-4c24-aad7-3891adc1a372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:44.618414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159229fd-6328-4202-8ffd-519037fc4bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:44.620175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159229fd-6328-4202-8ffd-519037fc4bc2 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:44.620962 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd03aa-a7ed-4c24-aad7-3891adc1a372 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:44.621432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159229fd-6328-4202-8ffd-519037fc4bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:44.621939 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159229fd-6328-4202-8ffd-519037fc4bc2 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:44.624263 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159229fd-6328-4202-8ffd-519037fc4bc2 None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:44.626740 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159229fd-6328-4202-8ffd-519037fc4bc2 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:44.627710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:44.629671 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 222/444] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:44 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:44.630941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159229fd-6328-4202-8ffd-519037fc4bc2 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:44.632326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 223/445] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:33:44 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:44.636082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd03aa-a7ed-4c24-aad7-3891adc1a372 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:44.742116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:44.773433 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd03aa-a7ed-4c24-aad7-3891adc1a372 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:44.773869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159229fd-6328-4202-8ffd-519037fc4bc2 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:44.825174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c3104-4e9e-4de4-9b5a-3cb8501c2024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:44.826050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c3104-4e9e-4de4-9b5a-3cb8501c2024 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:44.826345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c3104-4e9e-4de4-9b5a-3cb8501c2024 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:44.826640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c3104-4e9e-4de4-9b5a-3cb8501c2024 None admin] PATH_INFO: `/v3/groups/7326986284c14d2885e2bbdc1db71520` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:44.827897 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c3104-4e9e-4de4-9b5a-3cb8501c2024 None admin] RBAC: Authorizing `identity:get_group(group_id=7326986284c14d2885e2bbdc1db71520)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:44.828799 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd49c03-d87d-4c49-be2f-2413749dc12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:44.829487 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd49c03-d87d-4c49-be2f-2413749dc12e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:44.829681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c3104-4e9e-4de4-9b5a-3cb8501c2024 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:44.829831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd49c03-d87d-4c49-be2f-2413749dc12e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:44.830060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd49c03-d87d-4c49-be2f-2413749dc12e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:44.831594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 224/446] 10.222.0.112 () {56 vars in 1185 bytes} [Thu May 26 16:33:44 2022] GET /identity/v3/groups/7326986284c14d2885e2bbdc1db71520 => generated 227 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:44.832567 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c3104-4e9e-4de4-9b5a-3cb8501c2024 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:44.911721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:44.917326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd49c03-d87d-4c49-be2f-2413749dc12e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:44.918966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd49c03-d87d-4c49-be2f-2413749dc12e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:44.958525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c3104-4e9e-4de4-9b5a-3cb8501c2024 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:45.001152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97adc36-b9ef-49b3-a125-cd0ab9b0bd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:45.001816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97adc36-b9ef-49b3-a125-cd0ab9b0bd35 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:45.002132 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97adc36-b9ef-49b3-a125-cd0ab9b0bd35 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:45.002557 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97adc36-b9ef-49b3-a125-cd0ab9b0bd35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:45.019885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:45.051226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 223/447] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:44 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:45.052086 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd49c03-d87d-4c49-be2f-2413749dc12e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:45.100002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97adc36-b9ef-49b3-a125-cd0ab9b0bd35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:45.101502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97adc36-b9ef-49b3-a125-cd0ab9b0bd35 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:45.187764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:45.197564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd49c03-d87d-4c49-be2f-2413749dc12e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:45.228953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 225/448] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:44 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:45.230605 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97adc36-b9ef-49b3-a125-cd0ab9b0bd35 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:45.239051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11677004-bab1-4482-8bca-e9f578224530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:45.239733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11677004-bab1-4482-8bca-e9f578224530 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:45.240060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11677004-bab1-4482-8bca-e9f578224530 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:45.240299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11677004-bab1-4482-8bca-e9f578224530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:45.241144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11677004-bab1-4482-8bca-e9f578224530 None admin] RBAC: Adding query filter params (group.id=7326986284c14d2885e2bbdc1db71520, role.id=5a16a034a01e45b89530e8dd35d56588, scope.project.id=9dd29f6d3b974bff8206091ffee50316) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:45.241458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11677004-bab1-4482-8bca-e9f578224530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:45.243050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11677004-bab1-4482-8bca-e9f578224530 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:45.251104 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 224/449] 10.222.0.112 () {56 vars in 1381 bytes} [Thu May 26 16:33:45 2022] GET /identity/v3/role_assignments?group.id=7326986284c14d2885e2bbdc1db71520&scope.project.id=9dd29f6d3b974bff8206091ffee50316&role.id=5a16a034a01e45b89530e8dd35d56588 => generated 613 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:45.252107 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11677004-bab1-4482-8bca-e9f578224530 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:45.319222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:45.382449 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97adc36-b9ef-49b3-a125-cd0ab9b0bd35 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:45.410151 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11677004-bab1-4482-8bca-e9f578224530 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:45.433153 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2be4b-26cf-4c53-9cde-53b04fc93490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:45.434349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2be4b-26cf-4c53-9cde-53b04fc93490 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:45.434788 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2be4b-26cf-4c53-9cde-53b04fc93490 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:45.435214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2be4b-26cf-4c53-9cde-53b04fc93490 None admin] PATH_INFO: `/v3/projects/9dda95f8437548158ad5e83593c71483` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:45.439395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2be4b-26cf-4c53-9cde-53b04fc93490 None admin] RBAC: Authorizing `identity:get_project(project_id=9dda95f8437548158ad5e83593c71483)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:45.441014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2be4b-26cf-4c53-9cde-53b04fc93490 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:45.443362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 226/450] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:45 2022] GET /identity/v3/projects/9dda95f8437548158ad5e83593c71483 => generated 345 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:45.449999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2be4b-26cf-4c53-9cde-53b04fc93490 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:45.472701 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa5826-a210-43c6-843e-2dcbe3c41af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:45.473979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa5826-a210-43c6-843e-2dcbe3c41af3 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:45.474504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa5826-a210-43c6-843e-2dcbe3c41af3 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:45.475735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa5826-a210-43c6-843e-2dcbe3c41af3 None admin] PATH_INFO: `/v3/projects/9dd29f6d3b974bff8206091ffee50316` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:45.479023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa5826-a210-43c6-843e-2dcbe3c41af3 None admin] RBAC: Authorizing `identity:get_project(project_id=9dd29f6d3b974bff8206091ffee50316)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:45.482024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa5826-a210-43c6-843e-2dcbe3c41af3 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:45.487299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 225/451] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:33:45 2022] GET /identity/v3/projects/9dd29f6d3b974bff8206091ffee50316 => generated 303 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:45.496443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa5826-a210-43c6-843e-2dcbe3c41af3 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:45.511287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:45.614852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2be4b-26cf-4c53-9cde-53b04fc93490 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:45.671018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6aeaa-031f-4d7e-8905-837771e45063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:45.672086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6aeaa-031f-4d7e-8905-837771e45063 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:45.672465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6aeaa-031f-4d7e-8905-837771e45063 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:45.672828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6aeaa-031f-4d7e-8905-837771e45063 None admin] PATH_INFO: `/v3/groups/eb1890b8a30b432fa3de003e9c8b8011` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:45.674637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6aeaa-031f-4d7e-8905-837771e45063 None admin] RBAC: Authorizing `identity:get_group(group_id=eb1890b8a30b432fa3de003e9c8b8011)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:45.677536 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6aeaa-031f-4d7e-8905-837771e45063 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:45.681610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 227/452] 10.222.0.112 () {56 vars in 1185 bytes} [Thu May 26 16:33:45 2022] GET /identity/v3/groups/eb1890b8a30b432fa3de003e9c8b8011 => generated 230 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:45.683061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa5826-a210-43c6-843e-2dcbe3c41af3 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:45.690033 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6aeaa-031f-4d7e-8905-837771e45063 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:45.702923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:45.749272 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c4393-83db-45d7-aee5-e7804611a99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:45.750169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c4393-83db-45d7-aee5-e7804611a99a None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:45.750518 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c4393-83db-45d7-aee5-e7804611a99a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:45.750932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c4393-83db-45d7-aee5-e7804611a99a None admin] PATH_INFO: `/v3/groups/7326986284c14d2885e2bbdc1db71520` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:45.752269 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c4393-83db-45d7-aee5-e7804611a99a None admin] RBAC: Authorizing `identity:get_group(group_id=7326986284c14d2885e2bbdc1db71520)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:45.753811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c4393-83db-45d7-aee5-e7804611a99a None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:45.755641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 226/453] 10.222.0.112 () {56 vars in 1185 bytes} [Thu May 26 16:33:45 2022] GET /identity/v3/groups/7326986284c14d2885e2bbdc1db71520 => generated 227 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:45.762594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c4393-83db-45d7-aee5-e7804611a99a None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:45.856285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6aeaa-031f-4d7e-8905-837771e45063 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:45.859209 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:45.910829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cbf4e-be3d-4ad3-9530-5c24853b481d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:45.911874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cbf4e-be3d-4ad3-9530-5c24853b481d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:45.912788 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cbf4e-be3d-4ad3-9530-5c24853b481d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:45.912788 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cbf4e-be3d-4ad3-9530-5c24853b481d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:45.913775 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cbf4e-be3d-4ad3-9530-5c24853b481d None admin] RBAC: Adding query filter params (group.id=eb1890b8a30b432fa3de003e9c8b8011, role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=9dda95f8437548158ad5e83593c71483) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:45.914180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cbf4e-be3d-4ad3-9530-5c24853b481d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:45.916042 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cbf4e-be3d-4ad3-9530-5c24853b481d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:45.921977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c4393-83db-45d7-aee5-e7804611a99a None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:45.927282 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 228/454] 10.222.0.112 () {56 vars in 1381 bytes} [Thu May 26 16:33:45 2022] GET /identity/v3/role_assignments?group.id=eb1890b8a30b432fa3de003e9c8b8011&scope.project.id=9dda95f8437548158ad5e83593c71483&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 613 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:45.983478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4b040-9f3f-4e40-b326-221a42c31559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:45.984654 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4b040-9f3f-4e40-b326-221a42c31559 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:45.985184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4b040-9f3f-4e40-b326-221a42c31559 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:45.985620 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4b040-9f3f-4e40-b326-221a42c31559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:45.987312 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4b040-9f3f-4e40-b326-221a42c31559 None admin] RBAC: Adding query filter params (group.id=7326986284c14d2885e2bbdc1db71520, role.id=0449b3526e454e9ea05258c90de6de31, scope.project.id=9dd29f6d3b974bff8206091ffee50316) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:45.987905 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4b040-9f3f-4e40-b326-221a42c31559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:45.990944 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4b040-9f3f-4e40-b326-221a42c31559 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:46.080887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 227/455] 10.222.0.112 () {56 vars in 1381 bytes} [Thu May 26 16:33:45 2022] GET /identity/v3/role_assignments?group.id=7326986284c14d2885e2bbdc1db71520&scope.project.id=9dd29f6d3b974bff8206091ffee50316&role.id=0449b3526e454e9ea05258c90de6de31 => generated 613 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:49.884033 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1822ec-013b-4418-a265-e3794e2b078c None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:49.885717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1822ec-013b-4418-a265-e3794e2b078c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:49.886245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1822ec-013b-4418-a265-e3794e2b078c None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:49.888183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 229/456] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:49 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:49.895143 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc5209-5882-4d6a-9710-883808f95610 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:49.895646 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc5209-5882-4d6a-9710-883808f95610 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:49.896118 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc5209-5882-4d6a-9710-883808f95610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:49.939435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-48fc5209-5882-4d6a-9710-883808f95610 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:49.941484 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-48fc5209-5882-4d6a-9710-883808f95610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:50.014161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:50.039506 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5cd26-a8bb-4cb6-9afc-d7a6b09e37bd None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:50.039854 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5cd26-a8bb-4cb6-9afc-d7a6b09e37bd None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:50.040072 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5cd26-a8bb-4cb6-9afc-d7a6b09e37bd None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:50.042303 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 230/457] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:50.049401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec43cd-2e7c-4d58-822d-638b7b2f087d None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:50.049843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec43cd-2e7c-4d58-822d-638b7b2f087d None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:50.050204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec43cd-2e7c-4d58-822d-638b7b2f087d None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:50.052040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 231/458] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:33:50.053255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe5474-22ad-4902-acfb-e41a44a5a1d6 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:50.053638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe5474-22ad-4902-acfb-e41a44a5a1d6 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:50.054010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe5474-22ad-4902-acfb-e41a44a5a1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:50.069831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 228/459] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:50.069831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d517182-5ebb-45c7-bf6f-b0d28320c75a None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:50.069831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d517182-5ebb-45c7-bf6f-b0d28320c75a None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:50.069831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d517182-5ebb-45c7-bf6f-b0d28320c75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:50.091057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-22fe5474-22ad-4902-acfb-e41a44a5a1d6 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:50.099856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-22fe5474-22ad-4902-acfb-e41a44a5a1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:50.100000 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-9d517182-5ebb-45c7-bf6f-b0d28320c75a None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:50.100197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9d517182-5ebb-45c7-bf6f-b0d28320c75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:50.204543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 232/460] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:50.205833 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe5474-22ad-4902-acfb-e41a44a5a1d6 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:50.226487 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 229/461] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:50.236445 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d517182-5ebb-45c7-bf6f-b0d28320c75a None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:50.340583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:50.344366 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe5474-22ad-4902-acfb-e41a44a5a1d6 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:50.378507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d517182-5ebb-45c7-bf6f-b0d28320c75a None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:50.380806 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:50.383257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c01884-002c-49dc-81c7-23857251cf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:50.383911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c01884-002c-49dc-81c7-23857251cf80 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:50.384194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c01884-002c-49dc-81c7-23857251cf80 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:50.384466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c01884-002c-49dc-81c7-23857251cf80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:50.398575 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c01884-002c-49dc-81c7-23857251cf80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:50.402805 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c01884-002c-49dc-81c7-23857251cf80 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:50.422895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-50c01884-002c-49dc-81c7-23857251cf80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:50.422895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:50.422895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:50.422895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:50.422895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:50.422895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:50.422895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:50.422895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:50.422895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:50.422895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:50.422895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:50.422895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:50.422895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:50.422895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:50.422895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:50.424048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:50.424977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:50.424977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:50.424977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:50.424977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:50.424977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 233/462] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:50.425268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c01884-002c-49dc-81c7-23857251cf80 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:50.438005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f7c7d-4369-48a9-aad7-49453def1a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:50.438963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f7c7d-4369-48a9-aad7-49453def1a8e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:50.439321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f7c7d-4369-48a9-aad7-49453def1a8e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:50.439671 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f7c7d-4369-48a9-aad7-49453def1a8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:50.452514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f7c7d-4369-48a9-aad7-49453def1a8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:50.454027 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f7c7d-4369-48a9-aad7-49453def1a8e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:50.473241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-b35f7c7d-4369-48a9-aad7-49453def1a8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:50.473241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:50.473241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:50.473241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:50.473241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:50.473241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:50.473241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:50.473241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:50.473241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:50.473241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:50.473241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:50.473241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:50.473241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:50.473241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:50.473241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:50.474164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:50.475198 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:50.475198 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:50.475198 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:50.475198 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:50.475198 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 230/463] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:50.476302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fc143-39a6-4ee1-be77-400bcd0ad25a None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:50.476594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fc143-39a6-4ee1-be77-400bcd0ad25a None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:50.476876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fc143-39a6-4ee1-be77-400bcd0ad25a None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:50.482454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 231/464] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:50 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:50.483255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fc143-39a6-4ee1-be77-400bcd0ad25a None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:50.548721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c01884-002c-49dc-81c7-23857251cf80 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:50.591462 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3626b20-60d7-4e82-99e9-ab3a79129c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:50.592262 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3626b20-60d7-4e82-99e9-ab3a79129c81 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:50.592545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3626b20-60d7-4e82-99e9-ab3a79129c81 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:50.592819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3626b20-60d7-4e82-99e9-ab3a79129c81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:50.604737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3626b20-60d7-4e82-99e9-ab3a79129c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:50.606255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3626b20-60d7-4e82-99e9-ab3a79129c81 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:50.611981 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fc143-39a6-4ee1-be77-400bcd0ad25a None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:50.627424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-d3626b20-60d7-4e82-99e9-ab3a79129c81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:50.627424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:50.627424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:50.627424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:50.627424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:50.627424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:50.627424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:50.627424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:50.627424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:50.627424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:50.627424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:50.627424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:50.627424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:50.627424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:50.627424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:50.628498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:50.629410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:50.629410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:50.629410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:50.629410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:50.629410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 234/465] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:50.630115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3626b20-60d7-4e82-99e9-ab3a79129c81 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:50.633630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:50.657230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370be6f1-66a5-4284-ba35-5344f756ed31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:50.657889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370be6f1-66a5-4284-ba35-5344f756ed31 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:50.658171 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370be6f1-66a5-4284-ba35-5344f756ed31 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:50.658500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370be6f1-66a5-4284-ba35-5344f756ed31 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:50.659343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370be6f1-66a5-4284-ba35-5344f756ed31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:50.659653 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370be6f1-66a5-4284-ba35-5344f756ed31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:50.661089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370be6f1-66a5-4284-ba35-5344f756ed31 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:50.679193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 232/466] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:33:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:50.679193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88afee1-e70f-4d3d-9d55-05d11050ecc5 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:50.679193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88afee1-e70f-4d3d-9d55-05d11050ecc5 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:50.679193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88afee1-e70f-4d3d-9d55-05d11050ecc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:50.694689 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-a88afee1-e70f-4d3d-9d55-05d11050ecc5 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:50.695991 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a88afee1-e70f-4d3d-9d55-05d11050ecc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:50.708003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:50.762079 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3626b20-60d7-4e82-99e9-ab3a79129c81 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:50.775229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 233/467] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:50.783296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88afee1-e70f-4d3d-9d55-05d11050ecc5 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:50.804597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d9e72-e869-4503-b27a-46b1851b59d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:50.805315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d9e72-e869-4503-b27a-46b1851b59d3 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:50.805600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d9e72-e869-4503-b27a-46b1851b59d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:50.805887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d9e72-e869-4503-b27a-46b1851b59d3 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:50.807296 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d9e72-e869-4503-b27a-46b1851b59d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:50.807605 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d9e72-e869-4503-b27a-46b1851b59d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:50.809031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d9e72-e869-4503-b27a-46b1851b59d3 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:50.827637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 235/468] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:33:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:50.831580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d9e72-e869-4503-b27a-46b1851b59d3 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:50.907439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:50.920360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88afee1-e70f-4d3d-9d55-05d11050ecc5 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:50.954128 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d9e72-e869-4503-b27a-46b1851b59d3 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:50.962741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1da20b-a195-481e-8bb3-34478fe87230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:50.963338 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1da20b-a195-481e-8bb3-34478fe87230 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:50.963623 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1da20b-a195-481e-8bb3-34478fe87230 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:50.963901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1da20b-a195-481e-8bb3-34478fe87230 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:50.964681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1da20b-a195-481e-8bb3-34478fe87230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:50.964996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1da20b-a195-481e-8bb3-34478fe87230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:50.966500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1da20b-a195-481e-8bb3-34478fe87230 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:50.980729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 234/469] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:33:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:50.981413 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1da20b-a195-481e-8bb3-34478fe87230 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:50.987722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:51.006291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9b37f-85ff-42de-a31f-0beb2267c4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:51.014342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9b37f-85ff-42de-a31f-0beb2267c4d3 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:51.014342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9b37f-85ff-42de-a31f-0beb2267c4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:51.014342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9b37f-85ff-42de-a31f-0beb2267c4d3 None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:51.014342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9b37f-85ff-42de-a31f-0beb2267c4d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:51.014342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9b37f-85ff-42de-a31f-0beb2267c4d3 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:51.145521 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1da20b-a195-481e-8bb3-34478fe87230 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:51.195922 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878addc8-ddb3-4e06-910d-49a69d1dfe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:51.196755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878addc8-ddb3-4e06-910d-49a69d1dfe9d None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:51.197501 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878addc8-ddb3-4e06-910d-49a69d1dfe9d None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:51.197788 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878addc8-ddb3-4e06-910d-49a69d1dfe9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:51.216014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 236/470] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:33:50 2022] POST /identity/v3/users => generated 247 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:33:51.217522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9b37f-85ff-42de-a31f-0beb2267c4d3 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:51.225557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878addc8-ddb3-4e06-910d-49a69d1dfe9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:51.227835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878addc8-ddb3-4e06-910d-49a69d1dfe9d None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:51.260793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-878addc8-ddb3-4e06-910d-49a69d1dfe9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:51.260793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:51.260793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:51.260793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:51.260793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:51.260793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:51.260793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:51.260793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:51.260793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:51.260793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:51.260793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:51.260793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:51.260793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:51.260793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:51.260793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:51.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:51.263517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:51.263517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:51.263517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:51.263517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:51.273333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 235/471] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:51.274920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878addc8-ddb3-4e06-910d-49a69d1dfe9d None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:51.363338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9b37f-85ff-42de-a31f-0beb2267c4d3 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:51.374282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:51.395733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:51.437532 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a468f1-9dca-4727-a244-956cf2a5853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:51.438424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a468f1-9dca-4727-a244-956cf2a5853b None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:51.438948 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a468f1-9dca-4727-a244-956cf2a5853b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:51.439609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a468f1-9dca-4727-a244-956cf2a5853b None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:51.441489 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a468f1-9dca-4727-a244-956cf2a5853b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:51.445015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a468f1-9dca-4727-a244-956cf2a5853b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:51.456467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878addc8-ddb3-4e06-910d-49a69d1dfe9d None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:51.504365 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5af94-7b71-44a0-bce7-132a96ffe2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:51.505140 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5af94-7b71-44a0-bce7-132a96ffe2c1 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:51.505466 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5af94-7b71-44a0-bce7-132a96ffe2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:51.505749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5af94-7b71-44a0-bce7-132a96ffe2c1 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:51.506565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5af94-7b71-44a0-bce7-132a96ffe2c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:51.508047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5af94-7b71-44a0-bce7-132a96ffe2c1 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:51.551423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 237/472] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:33:51 2022] POST /identity/v3/users => generated 249 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:33:51.552498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a468f1-9dca-4727-a244-956cf2a5853b None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:51.638878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 236/473] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:33:51 2022] POST /identity/v3/users => generated 249 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:33:51.641304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067af16-c577-4042-a2ce-63b9024b6984 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:51.641876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067af16-c577-4042-a2ce-63b9024b6984 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:51.642584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067af16-c577-4042-a2ce-63b9024b6984 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:51.645754 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 237/474] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:51 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:51.655096 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8015f-724d-424f-a371-fb63949ff1fb None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:51.655778 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8015f-724d-424f-a371-fb63949ff1fb None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:51.656365 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8015f-724d-424f-a371-fb63949ff1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:51.727638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-70d8015f-724d-424f-a371-fb63949ff1fb None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:51.731861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-70d8015f-724d-424f-a371-fb63949ff1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:51.807803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a468f1-9dca-4727-a244-956cf2a5853b None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:51.872763 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1e580-42f8-44ee-9e96-2b769d640747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:51.873151 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 238/475] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:51.873766 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1e580-42f8-44ee-9e96-2b769d640747 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:51.874056 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1e580-42f8-44ee-9e96-2b769d640747 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:51.874374 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1e580-42f8-44ee-9e96-2b769d640747 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:51.875101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1e580-42f8-44ee-9e96-2b769d640747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:51.875411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1e580-42f8-44ee-9e96-2b769d640747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:51.876791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1e580-42f8-44ee-9e96-2b769d640747 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:51.894360 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 238/476] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:33:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:51.897982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8015f-724d-424f-a371-fb63949ff1fb None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:51.900745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1e580-42f8-44ee-9e96-2b769d640747 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:51.954536 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:51.961686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:52.026438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8015f-724d-424f-a371-fb63949ff1fb None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:52.050937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1e580-42f8-44ee-9e96-2b769d640747 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:52.063139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45a83f-c3f4-4c43-883f-c6acc02dc6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:52.063743 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45a83f-c3f4-4c43-883f-c6acc02dc6c0 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:52.064029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45a83f-c3f4-4c43-883f-c6acc02dc6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:52.064309 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45a83f-c3f4-4c43-883f-c6acc02dc6c0 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:52.065029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45a83f-c3f4-4c43-883f-c6acc02dc6c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:52.066538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45a83f-c3f4-4c43-883f-c6acc02dc6c0 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:52.091109 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda9007-f728-4b06-94a9-230513fb88d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:52.091845 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda9007-f728-4b06-94a9-230513fb88d0 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:52.092132 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda9007-f728-4b06-94a9-230513fb88d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:52.092437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda9007-f728-4b06-94a9-230513fb88d0 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:52.093191 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda9007-f728-4b06-94a9-230513fb88d0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:52.094602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda9007-f728-4b06-94a9-230513fb88d0 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:52.220744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.sql.core [None req-1dda9007-f728-4b06-94a9-230513fb88d0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 16:33:52.220744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 16:33:52.220744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [parameters: {'id': 'a4cc21fff6b84bb499e2d48ae18bf518', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 16:33:52.220744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87033) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 16:33:52.240249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-1dda9007-f728-4b06-94a9-230513fb88d0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 16:33:52.240249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:52.240249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:33:52.240249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:33:52.240249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:33:52.240249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:33:52.240249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:33:52.240249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:33:52.240249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:33:52.240249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application conn.query(q) May 26 16:33:52.240249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:33:52.240249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:33:52.240249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:33:52.240249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application result.read() May 26 16:33:52.240249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return ref.to_dict() May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:33:52.241293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application next(self.gen) May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application yield resource May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application next(self.gen) May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self.session.rollback() May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self.force_reraise() May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise self.value May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application session.commit() May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 16:33:52.242245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._prepare_impl() May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self.session.flush() May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._flush(objects) May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application compat.raise_( May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application flush_context.execute() May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rec.execute(self) May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 16:33:52.243193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:33:52.244480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application conn.query(q) May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application result.read() May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:33:52.245375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [parameters: {'id': 'a4cc21fff6b84bb499e2d48ae18bf518', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:52.246174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 16:33:52.260229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:52.261410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 239/477] 10.222.0.112 () {60 vars in 1136 bytes} [Thu May 26 16:33:51 2022] POST /identity/v3/roles => generated 144 bytes in 348 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 16:33:52.261410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda9007-f728-4b06-94a9-230513fb88d0 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:52.358018 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 239/478] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:33:51 2022] POST /identity/v3/users => generated 250 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:33:52.382777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:52.388185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda9007-f728-4b06-94a9-230513fb88d0 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:52.434380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76736a-edd4-482a-92b9-2daca036df35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:52.435230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76736a-edd4-482a-92b9-2daca036df35 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:52.435522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76736a-edd4-482a-92b9-2daca036df35 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:52.435807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76736a-edd4-482a-92b9-2daca036df35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:52.449336 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76736a-edd4-482a-92b9-2daca036df35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-cb76736a-edd4-482a-92b9-2daca036df35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:52.462173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:52.464239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:52.467148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:52.467148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:52.467148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:52.467148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:52.467148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:52.467148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:52.467148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:52.467148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:52.467148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:52.467148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:52.467148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:33:52.467148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:52.467148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 240/479] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:33:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:33:52.472385 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45a83f-c3f4-4c43-883f-c6acc02dc6c0 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:52.627641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:52.631742 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45a83f-c3f4-4c43-883f-c6acc02dc6c0 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:52.687213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba6fb9-d3ab-4376-911a-54a6a338f695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:52.687928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba6fb9-d3ab-4376-911a-54a6a338f695 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:52.688218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba6fb9-d3ab-4376-911a-54a6a338f695 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:52.688495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba6fb9-d3ab-4376-911a-54a6a338f695 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:52.689368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba6fb9-d3ab-4376-911a-54a6a338f695 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:52.689678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba6fb9-d3ab-4376-911a-54a6a338f695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:52.691168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba6fb9-d3ab-4376-911a-54a6a338f695 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:52.703281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 240/480] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:33:52 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:54.317299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1e107-0854-47ab-828e-27bc5d47f915 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:54.318313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1e107-0854-47ab-828e-27bc5d47f915 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:54.318845 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1e107-0854-47ab-828e-27bc5d47f915 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:54.320793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 241/481] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:54 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:54.327765 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf9631-0eaf-4930-a418-709224f8ea28 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:54.328664 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf9631-0eaf-4930-a418-709224f8ea28 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:54.329151 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf9631-0eaf-4930-a418-709224f8ea28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:54.347532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-9bbf9631-0eaf-4930-a418-709224f8ea28 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:54.349146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9bbf9631-0eaf-4930-a418-709224f8ea28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:54.428440 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 241/482] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:54.455269 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1e107-0854-47ab-828e-27bc5d47f915 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:54.537466 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2281d-6ff3-4af6-8faa-f278a53413e0 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:54.538180 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2281d-6ff3-4af6-8faa-f278a53413e0 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:54.538703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2281d-6ff3-4af6-8faa-f278a53413e0 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:54.540936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 242/483] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:54.546647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef29264-6737-4857-8959-26c9070d1cb7 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:54.547102 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef29264-6737-4857-8959-26c9070d1cb7 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:54.547450 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef29264-6737-4857-8959-26c9070d1cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:54.578630 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-5ef29264-6737-4857-8959-26c9070d1cb7 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:54.580668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5ef29264-6737-4857-8959-26c9070d1cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:54.615176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1e107-0854-47ab-828e-27bc5d47f915 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:54.690666 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc601d9-bfc4-4667-82d3-724d6df6533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:54.691813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc601d9-bfc4-4667-82d3-724d6df6533a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:54.692298 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc601d9-bfc4-4667-82d3-724d6df6533a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:54.692585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc601d9-bfc4-4667-82d3-724d6df6533a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:54.710444 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc601d9-bfc4-4667-82d3-724d6df6533a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-5bc601d9-bfc4-4667-82d3-724d6df6533a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:54.720687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:54.721692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:54.722625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:54.722625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:54.722625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:54.722625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:54.722625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:54.722625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:54.722625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:54.722625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:54.722625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:54.722625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:54.722625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:33:54.722625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:54.726593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 242/484] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:33:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:54.728810 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc601d9-bfc4-4667-82d3-724d6df6533a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:54.729137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 243/485] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:33:54.752071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:54.776219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef29264-6737-4857-8959-26c9070d1cb7 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:54.826608 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:54.853308 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc601d9-bfc4-4667-82d3-724d6df6533a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:54.916966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b7d3a-f243-4df4-b10c-ae5742de03ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:54.917658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b7d3a-f243-4df4-b10c-ae5742de03ca None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:54.917945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b7d3a-f243-4df4-b10c-ae5742de03ca None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:54.918362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b7d3a-f243-4df4-b10c-ae5742de03ca None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:54.919140 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b7d3a-f243-4df4-b10c-ae5742de03ca None admin] RBAC: Adding query filter params (name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:54.919453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b7d3a-f243-4df4-b10c-ae5742de03ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:54.920889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b7d3a-f243-4df4-b10c-ae5742de03ca None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:54.937296 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 243/486] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:33:54 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:54.945111 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440f280-bdb8-4158-bd09-1da34dc90788 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:54.945611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440f280-bdb8-4158-bd09-1da34dc90788 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:54.946098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440f280-bdb8-4158-bd09-1da34dc90788 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:54.949498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 244/487] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:54 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:54.955063 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440f280-bdb8-4158-bd09-1da34dc90788 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:54.970744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef29264-6737-4857-8959-26c9070d1cb7 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:55.011973 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e4c9b-c8e8-4587-ad2c-097f131a51a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:55.012795 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e4c9b-c8e8-4587-ad2c-097f131a51a1 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:55.013083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e4c9b-c8e8-4587-ad2c-097f131a51a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:55.013346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e4c9b-c8e8-4587-ad2c-097f131a51a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:55.025576 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e4c9b-c8e8-4587-ad2c-097f131a51a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-189e4c9b-c8e8-4587-ad2c-097f131a51a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:55.033475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:55.035159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:55.036610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:55.036610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:55.036610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:55.036610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:55.036610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:55.036610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:55.036610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:55.036610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:55.036610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:55.036610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:55.036610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:33:55.036610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:55.039715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 244/488] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:33:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:33:55.040903 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6784ee-61af-4a90-8ad4-2f8b76cb6c0e None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:55.041197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6784ee-61af-4a90-8ad4-2f8b76cb6c0e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:55.041480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6784ee-61af-4a90-8ad4-2f8b76cb6c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:55.122688 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-fe6784ee-61af-4a90-8ad4-2f8b76cb6c0e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:55.124083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-fe6784ee-61af-4a90-8ad4-2f8b76cb6c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:55.161316 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:55.183168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440f280-bdb8-4158-bd09-1da34dc90788 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:55.209406 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 245/489] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:55.213851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6784ee-61af-4a90-8ad4-2f8b76cb6c0e None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:55.229155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:55.232037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad8498-139a-4e94-a89b-36e2ccba9b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:55.233334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad8498-139a-4e94-a89b-36e2ccba9b3d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:55.235390 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad8498-139a-4e94-a89b-36e2ccba9b3d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:55.235390 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad8498-139a-4e94-a89b-36e2ccba9b3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:55.251685 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad8498-139a-4e94-a89b-36e2ccba9b3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:55.253618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad8498-139a-4e94-a89b-36e2ccba9b3d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:55.280349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-baad8498-139a-4e94-a89b-36e2ccba9b3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:55.280349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:55.280349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:55.280349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:55.280349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:55.280349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:55.280349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:55.280349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:55.280349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:55.280349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:55.280349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:55.280349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:55.280349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:55.280349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:55.280349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:55.282174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:55.284240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:55.284240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:55.284240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:55.284240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:55.284240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 245/490] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:55.284240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad8498-139a-4e94-a89b-36e2ccba9b3d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:55.492748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6784ee-61af-4a90-8ad4-2f8b76cb6c0e None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:55.521927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad8498-139a-4e94-a89b-36e2ccba9b3d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:55.540944 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d35fa4-a1f6-4fa7-90a3-89ec2f5438a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:55.542024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d35fa4-a1f6-4fa7-90a3-89ec2f5438a1 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:55.542681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d35fa4-a1f6-4fa7-90a3-89ec2f5438a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:55.543161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d35fa4-a1f6-4fa7-90a3-89ec2f5438a1 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:55.544636 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d35fa4-a1f6-4fa7-90a3-89ec2f5438a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:55.545193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d35fa4-a1f6-4fa7-90a3-89ec2f5438a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:55.547789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d35fa4-a1f6-4fa7-90a3-89ec2f5438a1 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:55.558419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:55.560867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 246/491] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:33:55 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:55.562237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d35fa4-a1f6-4fa7-90a3-89ec2f5438a1 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:55.563699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8276b6-2b9a-4140-86ed-6f3727d4852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:55.564504 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8276b6-2b9a-4140-86ed-6f3727d4852f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:55.564783 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8276b6-2b9a-4140-86ed-6f3727d4852f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:55.565057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8276b6-2b9a-4140-86ed-6f3727d4852f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:55.580081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8276b6-2b9a-4140-86ed-6f3727d4852f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-ec8276b6-2b9a-4140-86ed-6f3727d4852f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:55.593097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:55.594080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:55.594953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:55.594953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:55.594953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:55.594953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:55.594953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:55.594953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:55.594953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:55.594953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:55.594953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:55.594953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:55.594953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:33:55.594953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:55.598630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 246/492] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:33:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:55.599667 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8276b6-2b9a-4140-86ed-6f3727d4852f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:55.670305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:55.725756 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d35fa4-a1f6-4fa7-90a3-89ec2f5438a1 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:55.763968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8276b6-2b9a-4140-86ed-6f3727d4852f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:55.773728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc41412-ee73-498f-842e-d055c51f67fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:55.775343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41412-ee73-498f-842e-d055c51f67fe None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:55.775845 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41412-ee73-498f-842e-d055c51f67fe None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:55.776332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41412-ee73-498f-842e-d055c51f67fe None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:55.777504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc41412-ee73-498f-842e-d055c51f67fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:55.778029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc41412-ee73-498f-842e-d055c51f67fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:55.779695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc41412-ee73-498f-842e-d055c51f67fe None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:55.797972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 247/493] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:33:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:55.800965 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc41412-ee73-498f-842e-d055c51f67fe None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:55.811231 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5542b-37db-4855-aeab-0e5477b883e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:55.812031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5542b-37db-4855-aeab-0e5477b883e5 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:55.812366 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5542b-37db-4855-aeab-0e5477b883e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:55.812650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5542b-37db-4855-aeab-0e5477b883e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:55.827756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5542b-37db-4855-aeab-0e5477b883e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:55.829258 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5542b-37db-4855-aeab-0e5477b883e5 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:55.849940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-8ba5542b-37db-4855-aeab-0e5477b883e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:55.849940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:55.849940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:55.849940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:55.849940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:55.849940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:55.849940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:55.849940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:55.849940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:55.849940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:55.849940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:55.849940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:55.849940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:55.849940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:55.849940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:55.851021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:55.851874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:55.851874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:55.851874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:55.851874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:55.851874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 247/494] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:55.852923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb9c26-f8b1-44f1-80bf-71cf5d46f5e8 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:55.853336 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb9c26-f8b1-44f1-80bf-71cf5d46f5e8 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:55.853568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb9c26-f8b1-44f1-80bf-71cf5d46f5e8 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:55.854929 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 248/495] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:55.855665 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb9c26-f8b1-44f1-80bf-71cf5d46f5e8 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:55.912285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:55.947969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc41412-ee73-498f-842e-d055c51f67fe None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:55.981678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb9c26-f8b1-44f1-80bf-71cf5d46f5e8 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:55.987087 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:55.992621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691faf2-41f3-4753-9129-908f14f5df8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:55.993811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691faf2-41f3-4753-9129-908f14f5df8a None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:55.994149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691faf2-41f3-4753-9129-908f14f5df8a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:55.994462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691faf2-41f3-4753-9129-908f14f5df8a None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:55.995331 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691faf2-41f3-4753-9129-908f14f5df8a None admin] RBAC: Adding query filter params (name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:55.995661 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691faf2-41f3-4753-9129-908f14f5df8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:55.997090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691faf2-41f3-4753-9129-908f14f5df8a None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:56.008643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 248/496] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:33:55 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:56.010666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127edaf1-9732-4b81-8117-8f63e387bc7e None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:56.011091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127edaf1-9732-4b81-8117-8f63e387bc7e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:56.011409 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127edaf1-9732-4b81-8117-8f63e387bc7e None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:56.013432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 249/497] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:33:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:56.013432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127edaf1-9732-4b81-8117-8f63e387bc7e None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:56.059182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd35a03-5173-4b1b-a4d1-064da02eda66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:56.059182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35a03-5173-4b1b-a4d1-064da02eda66 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:56.059182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35a03-5173-4b1b-a4d1-064da02eda66 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:56.059182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35a03-5173-4b1b-a4d1-064da02eda66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:56.059673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd35a03-5173-4b1b-a4d1-064da02eda66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:56.059673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd35a03-5173-4b1b-a4d1-064da02eda66 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-7cd35a03-5173-4b1b-a4d1-064da02eda66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:33:56.070170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:56.072241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:56.074010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:56.074010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:56.074010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:33:56.074010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:33:56.074010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:33:56.074010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:33:56.074010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:33:56.074010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:33:56.074010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:33:56.074010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:56.074010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 249/498] 10.222.0.112 () {56 vars in 1098 bytes} [Thu May 26 16:33:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:56.074010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde39dc-2b05-430a-9d89-aafea6fec36f None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:56.074010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde39dc-2b05-430a-9d89-aafea6fec36f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:56.075287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde39dc-2b05-430a-9d89-aafea6fec36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:56.097197 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-3cde39dc-2b05-430a-9d89-aafea6fec36f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:56.098458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-3cde39dc-2b05-430a-9d89-aafea6fec36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:56.184751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127edaf1-9732-4b81-8117-8f63e387bc7e None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:56.224096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 250/499] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:56.226171 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93e54-0f28-401e-9e5f-9450428a00ab None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:56.226670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93e54-0f28-401e-9e5f-9450428a00ab None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:56.227135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93e54-0f28-401e-9e5f-9450428a00ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:56.240722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484fb5a-4d01-4cc4-8816-f0e4b126f778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:56.242064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484fb5a-4d01-4cc4-8816-f0e4b126f778 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:56.242719 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484fb5a-4d01-4cc4-8816-f0e4b126f778 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:56.243300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484fb5a-4d01-4cc4-8816-f0e4b126f778 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:56.244373 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484fb5a-4d01-4cc4-8816-f0e4b126f778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:56.244890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484fb5a-4d01-4cc4-8816-f0e4b126f778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:56.247178 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484fb5a-4d01-4cc4-8816-f0e4b126f778 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:56.257674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-08d93e54-0f28-401e-9e5f-9450428a00ab None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:56.259591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-08d93e54-0f28-401e-9e5f-9450428a00ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:56.263741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 250/500] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:33:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:56.265316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484fb5a-4d01-4cc4-8816-f0e4b126f778 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:56.303233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:56.343998 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:56.357413 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 251/501] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:33:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:33:56.358424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d93e54-0f28-401e-9e5f-9450428a00ab None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:56.414561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484fb5a-4d01-4cc4-8816-f0e4b126f778 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:56.453002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a14bdd-dbd5-46f0-a1a3-41964d8a3657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:56.454002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a14bdd-dbd5-46f0-a1a3-41964d8a3657 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:56.454283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a14bdd-dbd5-46f0-a1a3-41964d8a3657 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:56.454591 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a14bdd-dbd5-46f0-a1a3-41964d8a3657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:56.466748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a14bdd-dbd5-46f0-a1a3-41964d8a3657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:56.468545 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a14bdd-dbd5-46f0-a1a3-41964d8a3657 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:56.488746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-67a14bdd-dbd5-46f0-a1a3-41964d8a3657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:56.488746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:56.488746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:56.488746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:56.488746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:56.488746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:56.488746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:56.488746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:56.488746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:56.488746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:56.488746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:56.488746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:56.488746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:56.488746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:56.488746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:56.490177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:56.491348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:56.491348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:56.491348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:56.491348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:56.491348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 251/502] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:56.491618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a14bdd-dbd5-46f0-a1a3-41964d8a3657 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:56.518713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d93e54-0f28-401e-9e5f-9450428a00ab None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:56.561687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aef99c-8ff0-4d76-95c3-3ed094590afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:56.562793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aef99c-8ff0-4d76-95c3-3ed094590afa None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:56.562793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aef99c-8ff0-4d76-95c3-3ed094590afa None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:56.562989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aef99c-8ff0-4d76-95c3-3ed094590afa None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:56.563792 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aef99c-8ff0-4d76-95c3-3ed094590afa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:56.564100 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aef99c-8ff0-4d76-95c3-3ed094590afa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:56.565568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aef99c-8ff0-4d76-95c3-3ed094590afa None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:56.609830 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 252/503] 10.222.0.112 () {56 vars in 1138 bytes} [Thu May 26 16:33:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:56.610998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aef99c-8ff0-4d76-95c3-3ed094590afa None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:56.618363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a14bdd-dbd5-46f0-a1a3-41964d8a3657 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:56.626608 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:56.644917 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:56.657906 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2347-c9eb-481b-8eb8-b0a825daffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:56.658789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2347-c9eb-481b-8eb8-b0a825daffb1 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:56.659064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2347-c9eb-481b-8eb8-b0a825daffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:56.659345 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2347-c9eb-481b-8eb8-b0a825daffb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:56.671877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc2347-c9eb-481b-8eb8-b0a825daffb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:56.673855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc2347-c9eb-481b-8eb8-b0a825daffb1 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:56.696019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-f7dc2347-c9eb-481b-8eb8-b0a825daffb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:56.696019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:56.696019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:56.696019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:56.696019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:56.696019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:56.696019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:56.696019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:56.696019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:56.696019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:56.696019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:56.696019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:56.696019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:56.696019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:56.696019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:56.703541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:56.704958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:56.704958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:56.704958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:56.704958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:56.704958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 252/504] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:56.704958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2347-c9eb-481b-8eb8-b0a825daffb1 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:56.770537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aef99c-8ff0-4d76-95c3-3ed094590afa None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:56.824856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0e240-639b-4a5b-9a22-b515da7a5fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:56.826058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0e240-639b-4a5b-9a22-b515da7a5fec None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:56.826359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0e240-639b-4a5b-9a22-b515da7a5fec None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:56.826646 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0e240-639b-4a5b-9a22-b515da7a5fec None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:56.832395 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2347-c9eb-481b-8eb8-b0a825daffb1 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:56.837256 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0e240-639b-4a5b-9a22-b515da7a5fec None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:56.838769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0e240-639b-4a5b-9a22-b515da7a5fec None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-11b0e240-639b-4a5b-9a22-b515da7a5fec None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:33:56.855087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:56.856958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:56.858445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:56.858445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:56.858445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:33:56.858445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:33:56.858445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:33:56.858445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:33:56.858445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:33:56.858445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:33:56.858445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:33:56.858445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:56.858445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 253/505] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:56.858445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0e240-639b-4a5b-9a22-b515da7a5fec None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:56.876884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf526ea-15aa-49a6-81e7-a7742202651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:56.877588 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf526ea-15aa-49a6-81e7-a7742202651f None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:56.877871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf526ea-15aa-49a6-81e7-a7742202651f None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:56.878146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf526ea-15aa-49a6-81e7-a7742202651f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:56.891809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf526ea-15aa-49a6-81e7-a7742202651f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-bdf526ea-15aa-49a6-81e7-a7742202651f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:56.899927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:56.901250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:56.902160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:56.902160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:56.902160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:56.902160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:56.902160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:56.902160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:56.902160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:56.902160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:56.902160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:56.902160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:56.902160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:33:56.902160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:56.902160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 253/506] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:33:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:56.902160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf526ea-15aa-49a6-81e7-a7742202651f None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:56.930523 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:56.984995 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:57.010663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0e240-639b-4a5b-9a22-b515da7a5fec None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:57.042981 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf526ea-15aa-49a6-81e7-a7742202651f None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:57.058487 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3e21f-74b6-4db1-a821-570579f2589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:57.059244 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3e21f-74b6-4db1-a821-570579f2589f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:57.059701 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3e21f-74b6-4db1-a821-570579f2589f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:57.060018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3e21f-74b6-4db1-a821-570579f2589f None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:57.060899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3e21f-74b6-4db1-a821-570579f2589f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:57.061214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3e21f-74b6-4db1-a821-570579f2589f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:57.062858 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3e21f-74b6-4db1-a821-570579f2589f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:57.083502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 254/507] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:33:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:57.083502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3e21f-74b6-4db1-a821-570579f2589f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:57.092378 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553a8b5-1cec-49e4-8697-5df7f1a1b17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:57.093040 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553a8b5-1cec-49e4-8697-5df7f1a1b17f None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:57.093332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553a8b5-1cec-49e4-8697-5df7f1a1b17f None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:57.093608 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553a8b5-1cec-49e4-8697-5df7f1a1b17f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:57.175843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553a8b5-1cec-49e4-8697-5df7f1a1b17f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:57.177339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553a8b5-1cec-49e4-8697-5df7f1a1b17f None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:57.212140 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3e21f-74b6-4db1-a821-570579f2589f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:57.212881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:57.250795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5a1d9-1b33-475a-a201-eaaeb84b3e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:57.251678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5a1d9-1b33-475a-a201-eaaeb84b3e33 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:57.251971 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5a1d9-1b33-475a-a201-eaaeb84b3e33 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:57.252254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5a1d9-1b33-475a-a201-eaaeb84b3e33 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:57.253060 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5a1d9-1b33-475a-a201-eaaeb84b3e33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:57.253367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5a1d9-1b33-475a-a201-eaaeb84b3e33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:57.255071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5a1d9-1b33-475a-a201-eaaeb84b3e33 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:57.283873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 255/508] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:33:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:57.283873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5a1d9-1b33-475a-a201-eaaeb84b3e33 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:57.283873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:57.332921 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 254/509] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:57.334152 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553a8b5-1cec-49e4-8697-5df7f1a1b17f None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:57.429744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5a1d9-1b33-475a-a201-eaaeb84b3e33 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:57.466449 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553a8b5-1cec-49e4-8697-5df7f1a1b17f None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:57.487228 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40c692-3a67-4a3e-9e9c-6d28f0be5436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:57.488008 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40c692-3a67-4a3e-9e9c-6d28f0be5436 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:57.488362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40c692-3a67-4a3e-9e9c-6d28f0be5436 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:57.488741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40c692-3a67-4a3e-9e9c-6d28f0be5436 None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:57.489834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40c692-3a67-4a3e-9e9c-6d28f0be5436 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:57.490151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40c692-3a67-4a3e-9e9c-6d28f0be5436 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:57.491850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40c692-3a67-4a3e-9e9c-6d28f0be5436 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:57.496197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:57.522726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 256/510] 10.222.0.112 () {56 vars in 1142 bytes} [Thu May 26 16:33:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:57.522726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40c692-3a67-4a3e-9e9c-6d28f0be5436 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:57.523084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d569496-4a66-4d3e-ba43-e20a54784312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:57.523222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d569496-4a66-4d3e-ba43-e20a54784312 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:57.523557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d569496-4a66-4d3e-ba43-e20a54784312 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:57.523982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d569496-4a66-4d3e-ba43-e20a54784312 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:57.525374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d569496-4a66-4d3e-ba43-e20a54784312 None admin] RBAC: Adding query filter params (name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:57.525890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d569496-4a66-4d3e-ba43-e20a54784312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:57.528391 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d569496-4a66-4d3e-ba43-e20a54784312 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:57.544184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 255/511] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:33:57 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:57.545390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d569496-4a66-4d3e-ba43-e20a54784312 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:57.609322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:57.673741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d569496-4a66-4d3e-ba43-e20a54784312 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:57.675715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40c692-3a67-4a3e-9e9c-6d28f0be5436 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:57.718001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0addada-5924-476f-a54e-04f0167b141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:57.718657 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0addada-5924-476f-a54e-04f0167b141a None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:57.718936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0addada-5924-476f-a54e-04f0167b141a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:57.719217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0addada-5924-476f-a54e-04f0167b141a None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:57.719940 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0addada-5924-476f-a54e-04f0167b141a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:57.721428 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0addada-5924-476f-a54e-04f0167b141a None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:57.722279 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0857aa4-48ca-46cf-a7b7-d55a41b77745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:57.723261 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0857aa4-48ca-46cf-a7b7-d55a41b77745 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:57.723544 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0857aa4-48ca-46cf-a7b7-d55a41b77745 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:57.724009 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0857aa4-48ca-46cf-a7b7-d55a41b77745 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:57.734599 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0857aa4-48ca-46cf-a7b7-d55a41b77745 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:57.736161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0857aa4-48ca-46cf-a7b7-d55a41b77745 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-a0857aa4-48ca-46cf-a7b7-d55a41b77745 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:33:57.753777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:57.754961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:57.755942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:57.755942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:57.755942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:33:57.755942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:33:57.755942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:33:57.755942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:33:57.755942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:33:57.755942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:33:57.755942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 16:33:57.755942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:57.755942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 257/512] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:33:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:57.755942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0857aa4-48ca-46cf-a7b7-d55a41b77745 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:57.856753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 256/513] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:33:57 2022] POST /identity/v3/users => generated 248 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:33:57.858168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0addada-5924-476f-a54e-04f0167b141a None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:57.909123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0857aa4-48ca-46cf-a7b7-d55a41b77745 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:57.919732 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:57.950611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:57.973699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cf9eb-ef2d-43a5-a4ee-2c38385c63d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:57.974830 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cf9eb-ef2d-43a5-a4ee-2c38385c63d4 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:57.975272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cf9eb-ef2d-43a5-a4ee-2c38385c63d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:57.975734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cf9eb-ef2d-43a5-a4ee-2c38385c63d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:57.991415 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91cf9eb-ef2d-43a5-a4ee-2c38385c63d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:57.994272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91cf9eb-ef2d-43a5-a4ee-2c38385c63d4 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:58.017609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-d91cf9eb-ef2d-43a5-a4ee-2c38385c63d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:58.017609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:58.017609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:58.017609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:58.017609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:58.017609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:58.017609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:58.017609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:58.017609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:58.017609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:58.017609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:58.017609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:58.017609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:58.017609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:58.017609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:58.025466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:58.028211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:58.028211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:58.028211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:58.028211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:58.028211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 258/514] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:58.028211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cf9eb-ef2d-43a5-a4ee-2c38385c63d4 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:58.040561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0addada-5924-476f-a54e-04f0167b141a None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:58.114443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d4d38-3021-4e6a-b5cb-31a455095405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:58.115455 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d4d38-3021-4e6a-b5cb-31a455095405 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:58.115928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d4d38-3021-4e6a-b5cb-31a455095405 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:58.116400 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d4d38-3021-4e6a-b5cb-31a455095405 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:58.201459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cf9eb-ef2d-43a5-a4ee-2c38385c63d4 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:58.249128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d4d38-3021-4e6a-b5cb-31a455095405 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:58.251745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d4d38-3021-4e6a-b5cb-31a455095405 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:58.256346 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7a11d-d8cc-404c-b492-77861c0fecbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:58.257488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7a11d-d8cc-404c-b492-77861c0fecbd None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:58.257972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7a11d-d8cc-404c-b492-77861c0fecbd None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:58.258521 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7a11d-d8cc-404c-b492-77861c0fecbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:58.278738 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7a11d-d8cc-404c-b492-77861c0fecbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:58.281736 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7a11d-d8cc-404c-b492-77861c0fecbd None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:58.304843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:58.315927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-31b7a11d-d8cc-404c-b492-77861c0fecbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:58.315927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:58.315927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:58.315927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:58.315927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:58.315927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:58.315927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:58.315927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:58.315927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:58.315927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:58.315927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:58.315927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:58.315927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:58.315927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:58.315927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:58.317915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:58.319065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:58.319065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:58.319065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:58.319065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:58.325731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 259/515] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:58.325731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7a11d-d8cc-404c-b492-77861c0fecbd None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:58.365080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:58.415643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 257/516] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:58.417172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d4d38-3021-4e6a-b5cb-31a455095405 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:58.484373 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7a11d-d8cc-404c-b492-77861c0fecbd None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:58.539776 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c7be2-51cc-4eef-929b-b3f942cd5d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:58.540821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c7be2-51cc-4eef-929b-b3f942cd5d94 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:58.541311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c7be2-51cc-4eef-929b-b3f942cd5d94 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:58.541774 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c7be2-51cc-4eef-929b-b3f942cd5d94 None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:58.543298 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c7be2-51cc-4eef-929b-b3f942cd5d94 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:58.543832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c7be2-51cc-4eef-929b-b3f942cd5d94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:58.546695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c7be2-51cc-4eef-929b-b3f942cd5d94 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:58.575840 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 260/517] 10.222.0.112 () {56 vars in 1142 bytes} [Thu May 26 16:33:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:58.575840 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c7be2-51cc-4eef-929b-b3f942cd5d94 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:58.588615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d4d38-3021-4e6a-b5cb-31a455095405 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:58.644031 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18760655-377b-473f-bf38-b1084eaa0e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:58.644936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18760655-377b-473f-bf38-b1084eaa0e91 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:58.645440 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18760655-377b-473f-bf38-b1084eaa0e91 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:58.645668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18760655-377b-473f-bf38-b1084eaa0e91 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:58.646596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18760655-377b-473f-bf38-b1084eaa0e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:58.647071 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18760655-377b-473f-bf38-b1084eaa0e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:58.650140 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18760655-377b-473f-bf38-b1084eaa0e91 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:58.654376 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:58.673522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 258/518] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:33:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:58.673522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18760655-377b-473f-bf38-b1084eaa0e91 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:58.704042 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:58.732849 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c7be2-51cc-4eef-929b-b3f942cd5d94 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:58.798030 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361aed7d-69af-4ad5-811c-5e3aba604305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:58.798824 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aed7d-69af-4ad5-811c-5e3aba604305 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:58.799253 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aed7d-69af-4ad5-811c-5e3aba604305 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:58.799650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aed7d-69af-4ad5-811c-5e3aba604305 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:58.800786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361aed7d-69af-4ad5-811c-5e3aba604305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:58.801225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361aed7d-69af-4ad5-811c-5e3aba604305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:58.803150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361aed7d-69af-4ad5-811c-5e3aba604305 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:58.821682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 261/519] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:33:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:58.823440 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361aed7d-69af-4ad5-811c-5e3aba604305 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:58.873449 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18760655-377b-473f-bf38-b1084eaa0e91 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:58.929705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e9406-2ff0-460c-8b52-bad5214f7011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:58.930994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e9406-2ff0-460c-8b52-bad5214f7011 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:58.932434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e9406-2ff0-460c-8b52-bad5214f7011 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:58.932434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e9406-2ff0-460c-8b52-bad5214f7011 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:58.952227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e9406-2ff0-460c-8b52-bad5214f7011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:58.955863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e9406-2ff0-460c-8b52-bad5214f7011 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:58.981206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-066e9406-2ff0-460c-8b52-bad5214f7011 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:58.981206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:58.981206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:58.981206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:58.981206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:58.981206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:58.981206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:58.981206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:58.981206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:58.981206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:58.981206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:58.981206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:58.981206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:58.981206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:58.981206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:58.982966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:58.984344 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:58.984344 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:58.984344 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:58.984344 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:58.984344 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 259/520] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:58.984344 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e9406-2ff0-460c-8b52-bad5214f7011 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:58.998229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361aed7d-69af-4ad5-811c-5e3aba604305 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:59.057069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fba62-eb4e-44f2-b146-c560275630ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:59.057624 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fba62-eb4e-44f2-b146-c560275630ae None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:59.057910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fba62-eb4e-44f2-b146-c560275630ae None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:59.058190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fba62-eb4e-44f2-b146-c560275630ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:59.069458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:59.077572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:59.155266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e9406-2ff0-460c-8b52-bad5214f7011 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:59.163773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fba62-eb4e-44f2-b146-c560275630ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:59.168060 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fba62-eb4e-44f2-b146-c560275630ae None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:59.218788 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a52f3-fd6f-405f-8128-e678fa6b1f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:59.219747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a52f3-fd6f-405f-8128-e678fa6b1f2a None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:59.220114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a52f3-fd6f-405f-8128-e678fa6b1f2a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:59.220466 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a52f3-fd6f-405f-8128-e678fa6b1f2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:59.230471 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a52f3-fd6f-405f-8128-e678fa6b1f2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:59.232943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a52f3-fd6f-405f-8128-e678fa6b1f2a None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:59.251242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-953a52f3-fd6f-405f-8128-e678fa6b1f2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:33:59.251242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:59.251242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:59.251242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:59.251242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:59.251242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:59.251242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:59.251242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:59.251242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:59.251242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:59.251242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:59.251242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:59.251242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:33:59.251242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:33:59.251242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:59.252569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:59.253760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:33:59.253760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:33:59.253760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:33:59.253760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:33:59.253760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:33:59.253760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:33:59.253760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:33:59.253760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:59.253760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 260/521] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:33:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:59.254884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a52f3-fd6f-405f-8128-e678fa6b1f2a None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:59.329933 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 262/522] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:33:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:33:59.330932 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fba62-eb4e-44f2-b146-c560275630ae None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:59.403668 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:59.420923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a52f3-fd6f-405f-8128-e678fa6b1f2a None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:59.436877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:59.473992 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08103103-ab59-4765-9448-ac9bac6ce4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:59.474853 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08103103-ab59-4765-9448-ac9bac6ce4ff None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:59.475144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08103103-ab59-4765-9448-ac9bac6ce4ff None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:59.475433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08103103-ab59-4765-9448-ac9bac6ce4ff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:59.483372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fba62-eb4e-44f2-b146-c560275630ae None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:59.483677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08103103-ab59-4765-9448-ac9bac6ce4ff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:59.485177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08103103-ab59-4765-9448-ac9bac6ce4ff None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-08103103-ab59-4765-9448-ac9bac6ce4ff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:33:59.507473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:59.509274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:59.514422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:59.514422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:59.514422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:33:59.514422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:33:59.514422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:33:59.514422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:33:59.514422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:33:59.514422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:33:59.514422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:33:59.514422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:33:59.514422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 261/523] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:33:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:59.514422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08103103-ab59-4765-9448-ac9bac6ce4ff None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:59.531296 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228be2c8-5179-47a7-adff-9f4a9b3f5e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:59.531970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228be2c8-5179-47a7-adff-9f4a9b3f5e14 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:59.532259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228be2c8-5179-47a7-adff-9f4a9b3f5e14 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:59.532536 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228be2c8-5179-47a7-adff-9f4a9b3f5e14 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:59.533270 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228be2c8-5179-47a7-adff-9f4a9b3f5e14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:59.533585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228be2c8-5179-47a7-adff-9f4a9b3f5e14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:59.535174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228be2c8-5179-47a7-adff-9f4a9b3f5e14 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:59.549178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 263/524] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:33:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:59.551536 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228be2c8-5179-47a7-adff-9f4a9b3f5e14 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:59.687274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08103103-ab59-4765-9448-ac9bac6ce4ff None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:59.715744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228be2c8-5179-47a7-adff-9f4a9b3f5e14 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:59.717338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:59.750004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08d630-6abe-49bc-a628-fc4d44e181db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:59.750720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08d630-6abe-49bc-a628-fc4d44e181db None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:59.751009 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08d630-6abe-49bc-a628-fc4d44e181db None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:59.751292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08d630-6abe-49bc-a628-fc4d44e181db None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:59.752097 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08d630-6abe-49bc-a628-fc4d44e181db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:59.752415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08d630-6abe-49bc-a628-fc4d44e181db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:59.753956 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08d630-6abe-49bc-a628-fc4d44e181db None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:59.767315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5c065-7a23-49d1-bcbc-4ce3c5070e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:59.768409 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5c065-7a23-49d1-bcbc-4ce3c5070e24 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:59.768837 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5c065-7a23-49d1-bcbc-4ce3c5070e24 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:59.769252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5c065-7a23-49d1-bcbc-4ce3c5070e24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:59.773568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 262/525] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:33:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:59.774479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08d630-6abe-49bc-a628-fc4d44e181db None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:59.783737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5c065-7a23-49d1-bcbc-4ce3c5070e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:59.785397 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5c065-7a23-49d1-bcbc-4ce3c5070e24 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:59.821873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-8fc5c065-7a23-49d1-bcbc-4ce3c5070e24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:59.821873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:59.821873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:59.821873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:59.821873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:59.821873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:59.821873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:59.821873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:59.821873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:59.821873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:59.821873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:59.821873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:59.821873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:59.821873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:59.821873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:59.823120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:59.824166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:59.824166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:59.824166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:59.824166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:33:59.824166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 264/526] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:59.824811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5c065-7a23-49d1-bcbc-4ce3c5070e24 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:59.831703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:59.937084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08d630-6abe-49bc-a628-fc4d44e181db None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:59.968031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5c065-7a23-49d1-bcbc-4ce3c5070e24 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:59.979288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e611c39-fe6a-490f-8817-403e070429ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:59.979979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e611c39-fe6a-490f-8817-403e070429ad None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:59.980267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e611c39-fe6a-490f-8817-403e070429ad None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:59.980544 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e611c39-fe6a-490f-8817-403e070429ad None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:59.982233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e611c39-fe6a-490f-8817-403e070429ad None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:59.982233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e611c39-fe6a-490f-8817-403e070429ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:59.983174 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e611c39-fe6a-490f-8817-403e070429ad None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:00.010547 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c08be-2f71-4bcc-b947-2d141932e56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:00.011349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c08be-2f71-4bcc-b947-2d141932e56b None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:00.011631 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c08be-2f71-4bcc-b947-2d141932e56b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:00.011918 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c08be-2f71-4bcc-b947-2d141932e56b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:00.019999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c08be-2f71-4bcc-b947-2d141932e56b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:00.021539 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c08be-2f71-4bcc-b947-2d141932e56b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:00.030938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 263/527] 10.222.0.112 () {56 vars in 1144 bytes} [Thu May 26 16:33:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:00.030938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e611c39-fe6a-490f-8817-403e070429ad None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:00.048392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-a43c08be-2f71-4bcc-b947-2d141932e56b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:00.048392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:00.048392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:00.048392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:00.048392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:00.048392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:00.048392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:00.048392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:00.048392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:00.048392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:00.048392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:00.048392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:00.048392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:00.048392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:00.048392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:00.049307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:00.050164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:00.050164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:00.050164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:00.050164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:00.050164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:00.050164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:00.050164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:00.050164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:00.050164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 265/528] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:33:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:00.051231 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c08be-2f71-4bcc-b947-2d141932e56b None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:00.073911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:00.173481 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:00.192117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e611c39-fe6a-490f-8817-403e070429ad None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:00.194701 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c08be-2f71-4bcc-b947-2d141932e56b None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:00.247640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb7228-b4e5-4c69-acca-00ad634bda50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:00.248325 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb7228-b4e5-4c69-acca-00ad634bda50 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:00.248619 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb7228-b4e5-4c69-acca-00ad634bda50 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:00.248902 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb7228-b4e5-4c69-acca-00ad634bda50 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:00.249648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb7228-b4e5-4c69-acca-00ad634bda50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:00.249957 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb7228-b4e5-4c69-acca-00ad634bda50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:00.251507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb7228-b4e5-4c69-acca-00ad634bda50 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:00.255606 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f8234-c922-4767-8931-fa675f70a382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:00.256311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f8234-c922-4767-8931-fa675f70a382 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:00.256642 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f8234-c922-4767-8931-fa675f70a382 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:00.256924 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f8234-c922-4767-8931-fa675f70a382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:00.257851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f8234-c922-4767-8931-fa675f70a382 None admin] RBAC: Adding query filter params (role.id=64acd9118f3d4931be8ca4bfa4ae907e, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=5f2ec4c76f8f4d858bce53f30cc198fa) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:00.258170 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f8234-c922-4767-8931-fa675f70a382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:00.260888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f8234-c922-4767-8931-fa675f70a382 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:00.270781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 266/529] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:00.270781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb7228-b4e5-4c69-acca-00ad634bda50 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:00.271054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 264/530] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:00 2022] GET /identity/v3/role_assignments?user.id=5f2ec4c76f8f4d858bce53f30cc198fa&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=64acd9118f3d4931be8ca4bfa4ae907e => generated 260 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:00.271054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f8234-c922-4767-8931-fa675f70a382 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:00.424736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f8234-c922-4767-8931-fa675f70a382 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:00.427331 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:00.468776 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb7228-b4e5-4c69-acca-00ad634bda50 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:00.479808 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b72f16-ae7f-4ea9-956a-d153fecaeeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:00.483187 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b72f16-ae7f-4ea9-956a-d153fecaeeb9 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:00.483414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b72f16-ae7f-4ea9-956a-d153fecaeeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:00.483755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b72f16-ae7f-4ea9-956a-d153fecaeeb9 None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:00.485234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b72f16-ae7f-4ea9-956a-d153fecaeeb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:00.485234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b72f16-ae7f-4ea9-956a-d153fecaeeb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:00.486471 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b72f16-ae7f-4ea9-956a-d153fecaeeb9 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:00.503347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 265/531] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:00.504543 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b72f16-ae7f-4ea9-956a-d153fecaeeb9 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:00.523960 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:00.537555 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c46ca-5743-49cf-919c-0580343bd69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:00.539074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c46ca-5743-49cf-919c-0580343bd69d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:00.539603 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c46ca-5743-49cf-919c-0580343bd69d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:00.540659 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c46ca-5743-49cf-919c-0580343bd69d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:00.646630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c46ca-5743-49cf-919c-0580343bd69d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:00.649213 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c46ca-5743-49cf-919c-0580343bd69d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:00.668963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b72f16-ae7f-4ea9-956a-d153fecaeeb9 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:00.710512 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac346d53-4c1a-4bb6-97f0-90b420b72aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:00.711552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac346d53-4c1a-4bb6-97f0-90b420b72aba None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:00.712088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac346d53-4c1a-4bb6-97f0-90b420b72aba None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:00.712425 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac346d53-4c1a-4bb6-97f0-90b420b72aba None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:00.721766 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac346d53-4c1a-4bb6-97f0-90b420b72aba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:00.723282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac346d53-4c1a-4bb6-97f0-90b420b72aba None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:00.739985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-ac346d53-4c1a-4bb6-97f0-90b420b72aba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:00.739985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:00.739985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:00.739985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:00.739985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:00.739985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:00.739985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:00.739985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:00.739985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:00.739985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:00.739985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:00.739985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:00.739985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:00.739985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:00.739985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:00.740898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:00.742305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:00.742305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:00.742305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:00.742305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:00.742305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:00.742305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:00.742305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:00.742305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:00.742305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 266/532] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:00.742305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac346d53-4c1a-4bb6-97f0-90b420b72aba None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:00.756338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:00.796162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 267/533] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:34:00 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:34:00.796162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6c51a-93c5-4fe7-82a8-8c493b71ed73 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:00.796162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6c51a-93c5-4fe7-82a8-8c493b71ed73 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:00.796162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6c51a-93c5-4fe7-82a8-8c493b71ed73 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:00.796162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 268/534] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:00.796162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6c51a-93c5-4fe7-82a8-8c493b71ed73 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:00.845070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:00.894037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac346d53-4c1a-4bb6-97f0-90b420b72aba None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:00.937421 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6c51a-93c5-4fe7-82a8-8c493b71ed73 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:00.942662 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab21050-7797-4e0e-9e7c-fd4c0248f387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:00.943478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab21050-7797-4e0e-9e7c-fd4c0248f387 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:00.943797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab21050-7797-4e0e-9e7c-fd4c0248f387 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:00.944084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab21050-7797-4e0e-9e7c-fd4c0248f387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:00.944913 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab21050-7797-4e0e-9e7c-fd4c0248f387 None admin] RBAC: Adding query filter params (role.id=64acd9118f3d4931be8ca4bfa4ae907e, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=53822ebd38c94a729591cb270e0459ad) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:00.945267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab21050-7797-4e0e-9e7c-fd4c0248f387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:00.947596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab21050-7797-4e0e-9e7c-fd4c0248f387 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:00.954814 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 267/535] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:00 2022] GET /identity/v3/role_assignments?user.id=53822ebd38c94a729591cb270e0459ad&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=64acd9118f3d4931be8ca4bfa4ae907e => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:00.955479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab21050-7797-4e0e-9e7c-fd4c0248f387 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:01.006642 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008699e4-6c77-47ff-8c96-ef0ced263401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:01.008321 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008699e4-6c77-47ff-8c96-ef0ced263401 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:01.009380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008699e4-6c77-47ff-8c96-ef0ced263401 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:01.009872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008699e4-6c77-47ff-8c96-ef0ced263401 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:01.011183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008699e4-6c77-47ff-8c96-ef0ced263401 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:01.011705 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008699e4-6c77-47ff-8c96-ef0ced263401 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:01.016347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008699e4-6c77-47ff-8c96-ef0ced263401 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:01.054825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 269/536] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:01.059702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bc6c2-e515-417e-aabb-4632a84e1362 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:01.060042 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bc6c2-e515-417e-aabb-4632a84e1362 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:01.060273 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bc6c2-e515-417e-aabb-4632a84e1362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:01.084160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-2f6bc6c2-e515-417e-aabb-4632a84e1362 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:01.085488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-2f6bc6c2-e515-417e-aabb-4632a84e1362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:01.126869 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:01.142363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab21050-7797-4e0e-9e7c-fd4c0248f387 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:01.198350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 270/537] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:01.198350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bc6c2-e515-417e-aabb-4632a84e1362 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:01.199389 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321584cf-745f-4006-b2fc-4aaaba27a121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:01.202027 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321584cf-745f-4006-b2fc-4aaaba27a121 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:01.202662 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321584cf-745f-4006-b2fc-4aaaba27a121 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:01.203210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321584cf-745f-4006-b2fc-4aaaba27a121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:01.222780 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:01.234407 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321584cf-745f-4006-b2fc-4aaaba27a121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:01.235679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321584cf-745f-4006-b2fc-4aaaba27a121 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:01.257231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-321584cf-745f-4006-b2fc-4aaaba27a121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:01.257231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:01.257231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:01.257231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:01.257231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:01.257231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:01.257231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:01.257231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:01.257231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:01.257231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:01.257231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:01.257231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:01.257231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:01.257231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:01.257231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:01.258168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:01.259822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:01.259822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:01.259822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:01.259822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:01.259822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 268/538] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:01.260371 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321584cf-745f-4006-b2fc-4aaaba27a121 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:01.371732 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bc6c2-e515-417e-aabb-4632a84e1362 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:01.427947 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321584cf-745f-4006-b2fc-4aaaba27a121 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:01.432077 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543190-6822-43ef-b3de-c34121b1a46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:01.433830 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543190-6822-43ef-b3de-c34121b1a46d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:01.433830 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543190-6822-43ef-b3de-c34121b1a46d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:01.433830 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543190-6822-43ef-b3de-c34121b1a46d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:01.435257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f543190-6822-43ef-b3de-c34121b1a46d None admin] RBAC: Adding query filter params (role.id=64acd9118f3d4931be8ca4bfa4ae907e, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=adf32c811ead4fd0b69c83890a56509d) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:01.435679 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f543190-6822-43ef-b3de-c34121b1a46d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:01.437294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f543190-6822-43ef-b3de-c34121b1a46d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:01.452543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 271/539] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:01 2022] GET /identity/v3/role_assignments?user.id=adf32c811ead4fd0b69c83890a56509d&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=64acd9118f3d4931be8ca4bfa4ae907e => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:01.454409 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543190-6822-43ef-b3de-c34121b1a46d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:01.522071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:01.548960 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92abc22-d822-40c7-947d-314db9ed27a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:01.550548 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92abc22-d822-40c7-947d-314db9ed27a1 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:01.551084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92abc22-d822-40c7-947d-314db9ed27a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:01.551606 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92abc22-d822-40c7-947d-314db9ed27a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:01.588759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92abc22-d822-40c7-947d-314db9ed27a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-e92abc22-d822-40c7-947d-314db9ed27a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:01.607411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:01.608429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:01.609218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:01.609218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:01.609218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:01.609218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:01.609218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:01.609218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:01.609218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:01.609218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:01.609218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:01.609218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:01.609218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:01.609218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:01.611875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 269/540] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:01.629854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92abc22-d822-40c7-947d-314db9ed27a1 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:01.647414 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543190-6822-43ef-b3de-c34121b1a46d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:01.719925 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d21f2-e7e5-4ce1-97a2-618e33275581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:01.720944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d21f2-e7e5-4ce1-97a2-618e33275581 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:01.721439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d21f2-e7e5-4ce1-97a2-618e33275581 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:01.726359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d21f2-e7e5-4ce1-97a2-618e33275581 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:01.726359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d21f2-e7e5-4ce1-97a2-618e33275581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:01.726359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d21f2-e7e5-4ce1-97a2-618e33275581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:01.726359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d21f2-e7e5-4ce1-97a2-618e33275581 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:01.750583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 272/541] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:01.755014 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:01.760984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d21f2-e7e5-4ce1-97a2-618e33275581 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:01.893595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92abc22-d822-40c7-947d-314db9ed27a1 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:01.960656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d04bbe-a99f-4818-a20b-d5d555b746c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:01.962176 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d04bbe-a99f-4818-a20b-d5d555b746c3 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:01.962786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d04bbe-a99f-4818-a20b-d5d555b746c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:01.963207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d04bbe-a99f-4818-a20b-d5d555b746c3 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:01.964555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d04bbe-a99f-4818-a20b-d5d555b746c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:01.965098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d04bbe-a99f-4818-a20b-d5d555b746c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:01.965605 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:01.967902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d04bbe-a99f-4818-a20b-d5d555b746c3 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:01.989745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d21f2-e7e5-4ce1-97a2-618e33275581 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:01.999935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 270/542] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:34:01 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:02.010674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d04bbe-a99f-4818-a20b-d5d555b746c3 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:02.105115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a89776-bbf7-4f03-9e6f-05100f81bff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:02.107563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a89776-bbf7-4f03-9e6f-05100f81bff8 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:02.109864 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a89776-bbf7-4f03-9e6f-05100f81bff8 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:02.110417 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a89776-bbf7-4f03-9e6f-05100f81bff8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:02.127230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a89776-bbf7-4f03-9e6f-05100f81bff8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:02.132463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a89776-bbf7-4f03-9e6f-05100f81bff8 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:02.160142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-62a89776-bbf7-4f03-9e6f-05100f81bff8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:02.160142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:02.160142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:02.160142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:02.160142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:02.160142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:02.160142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:02.160142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:02.160142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:02.160142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:02.160142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:02.160142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:02.160142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:02.160142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:02.160142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:02.161245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:02.162208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:02.162208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:02.162208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:02.162208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:02.162208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:02.162208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:02.162208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:02.162208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:02.166135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 273/543] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:34:02.172732 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a89776-bbf7-4f03-9e6f-05100f81bff8 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:02.266767 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d04bbe-a99f-4818-a20b-d5d555b746c3 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:02.278912 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:02.323808 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385ebc9-b9a4-4b12-96e1-cc940eae85cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:02.325126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385ebc9-b9a4-4b12-96e1-cc940eae85cf None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:02.325671 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385ebc9-b9a4-4b12-96e1-cc940eae85cf None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:02.326345 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385ebc9-b9a4-4b12-96e1-cc940eae85cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:02.348762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385ebc9-b9a4-4b12-96e1-cc940eae85cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:02.350850 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385ebc9-b9a4-4b12-96e1-cc940eae85cf None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:02.371128 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a89776-bbf7-4f03-9e6f-05100f81bff8 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:02.391230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-a385ebc9-b9a4-4b12-96e1-cc940eae85cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:02.391230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:02.391230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:02.391230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:02.391230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:02.391230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:02.391230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:02.391230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:02.391230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:02.391230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:02.391230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:02.391230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:02.391230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:02.391230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:02.391230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:02.392678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:02.393697 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:02.393697 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:02.393697 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:02.393697 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:02.402864 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 271/544] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:02.408083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385ebc9-b9a4-4b12-96e1-cc940eae85cf None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:02.415679 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6d041-b01a-4898-9266-d6386de50bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:02.417179 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6d041-b01a-4898-9266-d6386de50bf9 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:02.417179 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6d041-b01a-4898-9266-d6386de50bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:02.417382 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6d041-b01a-4898-9266-d6386de50bf9 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:02.418070 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6d041-b01a-4898-9266-d6386de50bf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:02.418409 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6d041-b01a-4898-9266-d6386de50bf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:02.419862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6d041-b01a-4898-9266-d6386de50bf9 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:02.448752 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 274/545] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:02.454784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6d041-b01a-4898-9266-d6386de50bf9 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:02.468833 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:02.627999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6d041-b01a-4898-9266-d6386de50bf9 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:02.650052 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385ebc9-b9a4-4b12-96e1-cc940eae85cf None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:02.709469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6e234-dea5-467d-a9f8-ca8b6a03628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:02.710419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6e234-dea5-467d-a9f8-ca8b6a03628a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:02.710850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6e234-dea5-467d-a9f8-ca8b6a03628a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:02.711281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6e234-dea5-467d-a9f8-ca8b6a03628a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:02.713051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6e234-dea5-467d-a9f8-ca8b6a03628a None admin] RBAC: Adding query filter params (role.id=64acd9118f3d4931be8ca4bfa4ae907e, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=0288901db0244eab9a737af460ce1bd0) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:02.714054 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6e234-dea5-467d-a9f8-ca8b6a03628a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:02.715720 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6e234-dea5-467d-a9f8-ca8b6a03628a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:02.719738 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea644b8-6418-4c4e-ae21-d22e2cc42c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:02.720924 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea644b8-6418-4c4e-ae21-d22e2cc42c19 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:02.721469 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea644b8-6418-4c4e-ae21-d22e2cc42c19 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:02.722178 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea644b8-6418-4c4e-ae21-d22e2cc42c19 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:02.723376 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea644b8-6418-4c4e-ae21-d22e2cc42c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:02.724011 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea644b8-6418-4c4e-ae21-d22e2cc42c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:02.725621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea644b8-6418-4c4e-ae21-d22e2cc42c19 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:02.729241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 275/546] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:02 2022] GET /identity/v3/role_assignments?user.id=0288901db0244eab9a737af460ce1bd0&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=64acd9118f3d4931be8ca4bfa4ae907e => generated 260 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:02.751094 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 272/547] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:02.756392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6e234-dea5-467d-a9f8-ca8b6a03628a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:02.903482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:02.947357 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6e234-dea5-467d-a9f8-ca8b6a03628a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:02.992322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2de985-cf42-46e8-a196-12de581dd998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:02.994034 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2de985-cf42-46e8-a196-12de581dd998 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:02.994342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2de985-cf42-46e8-a196-12de581dd998 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:02.994610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2de985-cf42-46e8-a196-12de581dd998 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:03.003396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2de985-cf42-46e8-a196-12de581dd998 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:03.004845 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2de985-cf42-46e8-a196-12de581dd998 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-dc2de985-cf42-46e8-a196-12de581dd998 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:03.030955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:03.032388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:03.033794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:03.033794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:03.033794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:03.033794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:03.033794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:03.033794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:03.033794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:03.033794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:03.033794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:34:03.033794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:03.033794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 276/548] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:34:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:03.040134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea644b8-6418-4c4e-ae21-d22e2cc42c19 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:03.079523 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:03.143116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635909a-79d3-4f97-b6a2-965a51fd648f None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:03.143467 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635909a-79d3-4f97-b6a2-965a51fd648f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:03.143590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635909a-79d3-4f97-b6a2-965a51fd648f None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:03.145847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 277/549] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:03.155796 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c2d33-6062-4d9c-841e-f3b41cdf80db None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:03.156648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c2d33-6062-4d9c-841e-f3b41cdf80db None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:03.157294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c2d33-6062-4d9c-841e-f3b41cdf80db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:03.182952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-5e0c2d33-6062-4d9c-841e-f3b41cdf80db None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:03.189915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5e0c2d33-6062-4d9c-841e-f3b41cdf80db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:03.262312 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea644b8-6418-4c4e-ae21-d22e2cc42c19 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:03.308975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 278/550] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:03.343416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2609ab-1d19-4d31-8235-1a150be1bd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:03.344521 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2609ab-1d19-4d31-8235-1a150be1bd47 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:03.344962 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2609ab-1d19-4d31-8235-1a150be1bd47 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:03.345493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2609ab-1d19-4d31-8235-1a150be1bd47 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:03.346529 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2609ab-1d19-4d31-8235-1a150be1bd47 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:03.347108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2609ab-1d19-4d31-8235-1a150be1bd47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:03.348954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c2d33-6062-4d9c-841e-f3b41cdf80db None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:03.354435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2609ab-1d19-4d31-8235-1a150be1bd47 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:03.376441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 273/551] 10.222.0.112 () {56 vars in 1140 bytes} [Thu May 26 16:34:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:03.384420 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2609ab-1d19-4d31-8235-1a150be1bd47 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:03.528255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:03.566718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:03.601773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c2d33-6062-4d9c-841e-f3b41cdf80db None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:03.605759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2609ab-1d19-4d31-8235-1a150be1bd47 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:03.681568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc8f86-23e1-4b64-83e2-90fa520f80b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:03.682261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc8f86-23e1-4b64-83e2-90fa520f80b8 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:03.682588 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc8f86-23e1-4b64-83e2-90fa520f80b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:03.682864 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc8f86-23e1-4b64-83e2-90fa520f80b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:03.684314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7bd59-06c7-4088-9107-6aab2ebdf13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:03.685171 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7bd59-06c7-4088-9107-6aab2ebdf13d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:03.685457 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7bd59-06c7-4088-9107-6aab2ebdf13d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:03.685724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7bd59-06c7-4088-9107-6aab2ebdf13d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:03.731150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7bd59-06c7-4088-9107-6aab2ebdf13d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-2dc7bd59-06c7-4088-9107-6aab2ebdf13d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:03.741560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:03.742617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:03.744260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:03.744260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:03.744260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:03.744260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:03.744260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:03.744260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:03.744260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:03.744260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:03.744260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:03.744260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:03.744260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:03.744260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:03.744260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 279/552] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:03.752086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7bd59-06c7-4088-9107-6aab2ebdf13d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:03.769715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc8f86-23e1-4b64-83e2-90fa520f80b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:03.771257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc8f86-23e1-4b64-83e2-90fa520f80b8 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:03.869622 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:03.898114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 274/553] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:34:03 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:34:03.900832 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc8f86-23e1-4b64-83e2-90fa520f80b8 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:04.016923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc8f86-23e1-4b64-83e2-90fa520f80b8 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:04.034456 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7bd59-06c7-4088-9107-6aab2ebdf13d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:04.068500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81ec4c-da89-487a-bef2-d71128806009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:04.069336 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81ec4c-da89-487a-bef2-d71128806009 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:04.069627 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81ec4c-da89-487a-bef2-d71128806009 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:04.069910 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81ec4c-da89-487a-bef2-d71128806009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:04.082694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81ec4c-da89-487a-bef2-d71128806009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:04.083322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:04.084766 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81ec4c-da89-487a-bef2-d71128806009 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:04.103752 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f2293-d5f0-418d-978d-fe558669d793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:04.105085 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f2293-d5f0-418d-978d-fe558669d793 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:04.105580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f2293-d5f0-418d-978d-fe558669d793 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:04.106244 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f2293-d5f0-418d-978d-fe558669d793 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:04.107656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f2293-d5f0-418d-978d-fe558669d793 None admin] RBAC: Adding query filter params (name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:04.108260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f2293-d5f0-418d-978d-fe558669d793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:04.110591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f2293-d5f0-418d-978d-fe558669d793 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:04.113514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-fc81ec4c-da89-487a-bef2-d71128806009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:04.113514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:04.113514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:04.113514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:04.113514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:04.113514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:04.113514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:04.113514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:04.113514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:04.113514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:04.113514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:04.113514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:04.113514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:04.113514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:04.113514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:04.114862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:04.116403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:04.116403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:04.116403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:04.116403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:04.116639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 275/554] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:04.119213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bead7-632d-46ce-bc7a-0f09958e5052 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:04.119837 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bead7-632d-46ce-bc7a-0f09958e5052 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:04.120365 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bead7-632d-46ce-bc7a-0f09958e5052 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:04.128565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 276/555] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:04 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:04.128565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bead7-632d-46ce-bc7a-0f09958e5052 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:04.141098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 280/556] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:34:03 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:04.143067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ac13b-a46d-4b5b-8b03-17127ae5ed7c None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:04.143570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ac13b-a46d-4b5b-8b03-17127ae5ed7c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:04.144065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ac13b-a46d-4b5b-8b03-17127ae5ed7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:04.173790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-c74ac13b-a46d-4b5b-8b03-17127ae5ed7c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:04.176317 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c74ac13b-a46d-4b5b-8b03-17127ae5ed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:04.178921 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:04.269488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bead7-632d-46ce-bc7a-0f09958e5052 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:04.282967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 281/557] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:04.284945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ac13b-a46d-4b5b-8b03-17127ae5ed7c None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:04.313038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d52444-8f5d-49d9-834f-ee0291031f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:04.313038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d52444-8f5d-49d9-834f-ee0291031f8e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:04.313038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d52444-8f5d-49d9-834f-ee0291031f8e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:04.313038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d52444-8f5d-49d9-834f-ee0291031f8e None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:04.313478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d52444-8f5d-49d9-834f-ee0291031f8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:04.313478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d52444-8f5d-49d9-834f-ee0291031f8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:04.314030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d52444-8f5d-49d9-834f-ee0291031f8e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:04.329572 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 277/558] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:04.335333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d52444-8f5d-49d9-834f-ee0291031f8e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:04.439812 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ac13b-a46d-4b5b-8b03-17127ae5ed7c None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:04.445352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:04.458398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d52444-8f5d-49d9-834f-ee0291031f8e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:04.459831 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:04.486779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320bbce-3693-4dc7-9bdf-89322b2eb622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:04.487694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320bbce-3693-4dc7-9bdf-89322b2eb622 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:04.488025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320bbce-3693-4dc7-9bdf-89322b2eb622 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:04.488345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320bbce-3693-4dc7-9bdf-89322b2eb622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:04.501153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ed8cb-74d5-46d2-970d-588e2da7b327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:04.502127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ed8cb-74d5-46d2-970d-588e2da7b327 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:04.502519 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ed8cb-74d5-46d2-970d-588e2da7b327 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:04.502878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ed8cb-74d5-46d2-970d-588e2da7b327 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:04.502981 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320bbce-3693-4dc7-9bdf-89322b2eb622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:04.505546 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320bbce-3693-4dc7-9bdf-89322b2eb622 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:04.514658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ed8cb-74d5-46d2-970d-588e2da7b327 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:04.517257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ed8cb-74d5-46d2-970d-588e2da7b327 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:04.541781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-9320bbce-3693-4dc7-9bdf-89322b2eb622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:04.541781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:04.541781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:04.541781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:04.541781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:04.541781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:04.541781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:04.541781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:04.541781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:04.541781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:04.541781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:04.541781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:04.541781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:04.541781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:04.541781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:04.546362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:04.548299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:04.548299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:04.548299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:04.548299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:04.549149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-825ed8cb-74d5-46d2-970d-588e2da7b327 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:04.549149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:04.549149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:04.549149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:04.549149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:04.549149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:04.549149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:04.549149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:04.549149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:04.549149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:04.549149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:04.549149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:04.549149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:04.549149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:04.549149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:04.551222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:04.553510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:04.553510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:04.553510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:04.553510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:04.553510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:04.553510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:04.553510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:04.553510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:04.554592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 282/559] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:04.554592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320bbce-3693-4dc7-9bdf-89322b2eb622 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:04.556810 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 278/560] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:04.558037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ed8cb-74d5-46d2-970d-588e2da7b327 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:04.722525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320bbce-3693-4dc7-9bdf-89322b2eb622 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:04.732567 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ed8cb-74d5-46d2-970d-588e2da7b327 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:04.777165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d4040-4d26-42de-8a1e-7903be30f14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:04.778570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4040-4d26-42de-8a1e-7903be30f14c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:04.779056 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4040-4d26-42de-8a1e-7903be30f14c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:04.779438 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4040-4d26-42de-8a1e-7903be30f14c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:04.795151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d4040-4d26-42de-8a1e-7903be30f14c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:04.795903 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad96cf-0b83-4ae4-98be-e655b99bbf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:04.796671 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad96cf-0b83-4ae4-98be-e655b99bbf08 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:04.796988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad96cf-0b83-4ae4-98be-e655b99bbf08 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:04.797384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad96cf-0b83-4ae4-98be-e655b99bbf08 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:04.798458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad96cf-0b83-4ae4-98be-e655b99bbf08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:04.798814 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad96cf-0b83-4ae4-98be-e655b99bbf08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:04.800677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad96cf-0b83-4ae4-98be-e655b99bbf08 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-066d4040-4d26-42de-8a1e-7903be30f14c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:04.809541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:04.811001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:04.812294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:04.812294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:04.812294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:04.812294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:04.812294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:04.812294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:04.812294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:04.812294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:04.812294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:04.812294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:04.812294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:04.812294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:04.816841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 283/561] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:04.817837 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d4040-4d26-42de-8a1e-7903be30f14c None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:04.819245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 279/562] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:04.822569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b16656-ccf3-4f0c-bfcd-e0d2252ab6de None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:04.823117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b16656-ccf3-4f0c-bfcd-e0d2252ab6de None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:04.824886 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b16656-ccf3-4f0c-bfcd-e0d2252ab6de None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:04.826844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 280/563] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:04 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:04.827854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b16656-ccf3-4f0c-bfcd-e0d2252ab6de None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:04.846571 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:04.867174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:04.970233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d4040-4d26-42de-8a1e-7903be30f14c None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:04.976610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b16656-ccf3-4f0c-bfcd-e0d2252ab6de None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:05.012240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4564bcf-9a79-489e-a833-bc73bfbb5ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:05.013405 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4564bcf-9a79-489e-a833-bc73bfbb5ed0 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:05.013900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4564bcf-9a79-489e-a833-bc73bfbb5ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:05.014180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4564bcf-9a79-489e-a833-bc73bfbb5ed0 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:05.015152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4564bcf-9a79-489e-a833-bc73bfbb5ed0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:05.015460 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4564bcf-9a79-489e-a833-bc73bfbb5ed0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:05.017029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4564bcf-9a79-489e-a833-bc73bfbb5ed0 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:05.021299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53d559-d024-4386-848c-a1a6a536d6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:05.022375 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53d559-d024-4386-848c-a1a6a536d6ac None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:05.022375 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53d559-d024-4386-848c-a1a6a536d6ac None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:05.022609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53d559-d024-4386-848c-a1a6a536d6ac None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:05.023432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53d559-d024-4386-848c-a1a6a536d6ac None admin] RBAC: Adding query filter params (name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:05.024176 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53d559-d024-4386-848c-a1a6a536d6ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:05.025576 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53d559-d024-4386-848c-a1a6a536d6ac None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:05.041124 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 281/564] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:34:04 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:05.041124 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53d559-d024-4386-848c-a1a6a536d6ac None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:05.045351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 284/565] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:05.046948 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13dbbe-012a-4e2e-8d5c-f9da4ca93e0f None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:05.047236 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13dbbe-012a-4e2e-8d5c-f9da4ca93e0f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:05.047508 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13dbbe-012a-4e2e-8d5c-f9da4ca93e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:05.071542 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-fa13dbbe-012a-4e2e-8d5c-f9da4ca93e0f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:05.072730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-fa13dbbe-012a-4e2e-8d5c-f9da4ca93e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:05.142291 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:05.166205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 285/566] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:05.167287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13dbbe-012a-4e2e-8d5c-f9da4ca93e0f None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:05.191399 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:05.203626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53d559-d024-4386-848c-a1a6a536d6ac None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:05.251623 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46bca3-db47-490a-930f-84cd70f6f7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:05.252364 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46bca3-db47-490a-930f-84cd70f6f7fb None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:05.252655 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46bca3-db47-490a-930f-84cd70f6f7fb None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:05.252942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46bca3-db47-490a-930f-84cd70f6f7fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:05.262197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46bca3-db47-490a-930f-84cd70f6f7fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:05.263716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46bca3-db47-490a-930f-84cd70f6f7fb None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-5e46bca3-db47-490a-930f-84cd70f6f7fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:05.284797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:05.291859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:05.293084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:05.293084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:05.293084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:05.293084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:05.293084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:05.293084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:05.293084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:05.293084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:05.293084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:34:05.293084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:05.293084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 282/567] 10.222.0.112 () {56 vars in 1098 bytes} [Thu May 26 16:34:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:05.293084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46bca3-db47-490a-930f-84cd70f6f7fb None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:05.317942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13dbbe-012a-4e2e-8d5c-f9da4ca93e0f None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:05.395056 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccfda7-7105-496a-93e6-5c06ffcf19fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:05.396402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccfda7-7105-496a-93e6-5c06ffcf19fa None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:05.396744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccfda7-7105-496a-93e6-5c06ffcf19fa None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:05.397027 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccfda7-7105-496a-93e6-5c06ffcf19fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:05.411903 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccfda7-7105-496a-93e6-5c06ffcf19fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:05.414825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccfda7-7105-496a-93e6-5c06ffcf19fa None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:05.441194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46bca3-db47-490a-930f-84cd70f6f7fb None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:05.443134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-75ccfda7-7105-496a-93e6-5c06ffcf19fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:05.443134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:05.443134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:05.443134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:05.443134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:05.443134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:05.443134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:05.443134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:05.443134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:05.443134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:05.443134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:05.443134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:05.443134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:05.443134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:05.443134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:05.444801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:05.453972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:05.453972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:05.453972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:05.453972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:05.453972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 286/568] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:05.453972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccfda7-7105-496a-93e6-5c06ffcf19fa None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:05.496120 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:05.503875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210dd9d-089b-4dec-b819-fcd53592e47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:05.504460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210dd9d-089b-4dec-b819-fcd53592e47e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:05.504751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210dd9d-089b-4dec-b819-fcd53592e47e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:05.505015 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210dd9d-089b-4dec-b819-fcd53592e47e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:05.505926 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210dd9d-089b-4dec-b819-fcd53592e47e None admin] RBAC: Adding query filter params (role.id=64acd9118f3d4931be8ca4bfa4ae907e, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=465b269fc6ee415b8f5715843468d089) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:05.506414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210dd9d-089b-4dec-b819-fcd53592e47e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:05.509925 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210dd9d-089b-4dec-b819-fcd53592e47e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:05.518495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 283/569] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:05 2022] GET /identity/v3/role_assignments?user.id=465b269fc6ee415b8f5715843468d089&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=64acd9118f3d4931be8ca4bfa4ae907e => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:05.519392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210dd9d-089b-4dec-b819-fcd53592e47e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:05.572444 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:05.634279 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccfda7-7105-496a-93e6-5c06ffcf19fa None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:05.675029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210dd9d-089b-4dec-b819-fcd53592e47e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:05.689214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573532a-b34a-4b84-ad8e-3ab5869f22cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:05.690476 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573532a-b34a-4b84-ad8e-3ab5869f22cc None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:05.691247 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573532a-b34a-4b84-ad8e-3ab5869f22cc None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:05.691717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573532a-b34a-4b84-ad8e-3ab5869f22cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:05.706274 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573532a-b34a-4b84-ad8e-3ab5869f22cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-2573532a-b34a-4b84-ad8e-3ab5869f22cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:05.719485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:05.721285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:05.722230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:05.722230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:05.722230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:05.722230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:05.722230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:05.722230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:05.722230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:05.722230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:05.722230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:05.722230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:05.722230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:05.722230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:05.722230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 287/570] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:05.723045 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce512d4f-e50a-4ae9-b725-cb3a937cd12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:05.723141 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573532a-b34a-4b84-ad8e-3ab5869f22cc None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:05.723214 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce512d4f-e50a-4ae9-b725-cb3a937cd12a None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:05.724574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce512d4f-e50a-4ae9-b725-cb3a937cd12a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:05.724574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce512d4f-e50a-4ae9-b725-cb3a937cd12a None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:05.724891 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce512d4f-e50a-4ae9-b725-cb3a937cd12a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:05.725066 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce512d4f-e50a-4ae9-b725-cb3a937cd12a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:05.728006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce512d4f-e50a-4ae9-b725-cb3a937cd12a None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:05.760932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 284/571] 10.222.0.112 () {56 vars in 1138 bytes} [Thu May 26 16:34:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:05.762114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafec1fd-7275-4afd-8f88-ee74eeaa7e9c None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:05.762441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafec1fd-7275-4afd-8f88-ee74eeaa7e9c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:05.762725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafec1fd-7275-4afd-8f88-ee74eeaa7e9c None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:05.764452 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 285/572] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:05.765666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafec1fd-7275-4afd-8f88-ee74eeaa7e9c None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:05.853555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:05.862868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573532a-b34a-4b84-ad8e-3ab5869f22cc None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:05.900801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:05.909767 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff9ce9-2fee-439c-a10f-c3f393a36ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:05.910470 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff9ce9-2fee-439c-a10f-c3f393a36ef8 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:05.910758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff9ce9-2fee-439c-a10f-c3f393a36ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:05.911035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff9ce9-2fee-439c-a10f-c3f393a36ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:05.911764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff9ce9-2fee-439c-a10f-c3f393a36ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:05.912069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff9ce9-2fee-439c-a10f-c3f393a36ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:05.913441 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff9ce9-2fee-439c-a10f-c3f393a36ef8 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:05.914954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafec1fd-7275-4afd-8f88-ee74eeaa7e9c None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:05.933195 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 288/573] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:05.934010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff9ce9-2fee-439c-a10f-c3f393a36ef8 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:05.964925 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783f41e-d146-4c31-9b07-ebb3d47b0fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:05.965625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783f41e-d146-4c31-9b07-ebb3d47b0fee None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:05.965908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783f41e-d146-4c31-9b07-ebb3d47b0fee None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:05.966191 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783f41e-d146-4c31-9b07-ebb3d47b0fee None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:05.967384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783f41e-d146-4c31-9b07-ebb3d47b0fee None admin] RBAC: Adding query filter params (name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:05.967926 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783f41e-d146-4c31-9b07-ebb3d47b0fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:05.969544 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783f41e-d146-4c31-9b07-ebb3d47b0fee None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:05.988137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 286/574] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:34:05 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:05.988366 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18604e8f-55e2-40e6-8df6-8e404a300111 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:05.989226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18604e8f-55e2-40e6-8df6-8e404a300111 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:05.989226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18604e8f-55e2-40e6-8df6-8e404a300111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:06.014475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-18604e8f-55e2-40e6-8df6-8e404a300111 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:06.015952 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-18604e8f-55e2-40e6-8df6-8e404a300111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:06.090355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff9ce9-2fee-439c-a10f-c3f393a36ef8 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:06.113438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 287/575] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:06.127405 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18604e8f-55e2-40e6-8df6-8e404a300111 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:06.135713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a568480-bf3d-4fd3-9e03-a77516420a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:06.136589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a568480-bf3d-4fd3-9e03-a77516420a75 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:06.136876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a568480-bf3d-4fd3-9e03-a77516420a75 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:06.137502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a568480-bf3d-4fd3-9e03-a77516420a75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:06.149840 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a568480-bf3d-4fd3-9e03-a77516420a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:06.151322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a568480-bf3d-4fd3-9e03-a77516420a75 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:06.176148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-3a568480-bf3d-4fd3-9e03-a77516420a75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:06.176148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:06.176148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:06.176148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:06.176148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:06.176148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:06.176148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:06.176148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:06.176148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:06.176148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:06.176148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:06.176148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:06.176148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:06.176148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:06.176148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:06.177183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:06.178490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:06.178490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:06.178490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:06.178490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:06.178490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 289/576] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:06.179504 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a568480-bf3d-4fd3-9e03-a77516420a75 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:06.189823 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:06.254933 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:06.264136 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18604e8f-55e2-40e6-8df6-8e404a300111 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:06.310497 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3352759-f91e-407f-be62-926f2a034fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:06.311221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3352759-f91e-407f-be62-926f2a034fc0 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:06.311507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3352759-f91e-407f-be62-926f2a034fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:06.311790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3352759-f91e-407f-be62-926f2a034fc0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:06.322103 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3352759-f91e-407f-be62-926f2a034fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:06.324139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3352759-f91e-407f-be62-926f2a034fc0 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:06.338049 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a568480-bf3d-4fd3-9e03-a77516420a75 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-c3352759-f91e-407f-be62-926f2a034fc0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:06.344305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:06.346002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:06.348247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:06.348247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:06.348247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:06.348247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:06.348247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:06.348247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:06.348247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:06.348247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:06.348247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:34:06.348247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:06.348247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 288/577] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:34:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:06.348247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3352759-f91e-407f-be62-926f2a034fc0 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:06.387616 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff731b53-2fca-496c-ac85-51d13f6d162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:06.388425 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff731b53-2fca-496c-ac85-51d13f6d162f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:06.388704 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff731b53-2fca-496c-ac85-51d13f6d162f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:06.388976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff731b53-2fca-496c-ac85-51d13f6d162f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:06.401081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff731b53-2fca-496c-ac85-51d13f6d162f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:06.402515 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff731b53-2fca-496c-ac85-51d13f6d162f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:06.423148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-ff731b53-2fca-496c-ac85-51d13f6d162f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:06.423148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:06.423148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:06.423148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:06.423148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:06.423148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:06.423148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:06.423148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:06.423148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:06.423148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:06.423148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:06.423148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:06.423148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:06.423148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:06.423148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:06.424353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:06.425259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:06.425259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:06.425259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:06.425259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:06.425259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 290/578] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:06.425259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff731b53-2fca-496c-ac85-51d13f6d162f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:06.475924 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3352759-f91e-407f-be62-926f2a034fc0 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:06.485874 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:06.518289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef14e0-be7d-4ddb-868d-a76ddbf16b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:06.519217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef14e0-be7d-4ddb-868d-a76ddbf16b2b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:06.519509 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef14e0-be7d-4ddb-868d-a76ddbf16b2b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:06.519791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef14e0-be7d-4ddb-868d-a76ddbf16b2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:06.529859 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:06.532277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef14e0-be7d-4ddb-868d-a76ddbf16b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:06.539048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff731b53-2fca-496c-ac85-51d13f6d162f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-50ef14e0-be7d-4ddb-868d-a76ddbf16b2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:06.541854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:06.548809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:06.549830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:06.549830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:06.549830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:06.549830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:06.549830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:06.549830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:06.549830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:06.549830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:06.549830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:06.549830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:06.549830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:06.549830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:06.549830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 289/579] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:06.549830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef14e0-be7d-4ddb-868d-a76ddbf16b2b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:06.581117 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c380d6-f34a-47fa-950f-975f8a988814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:06.581849 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c380d6-f34a-47fa-950f-975f8a988814 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:06.582289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c380d6-f34a-47fa-950f-975f8a988814 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:06.582634 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c380d6-f34a-47fa-950f-975f8a988814 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:06.583456 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c380d6-f34a-47fa-950f-975f8a988814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:06.584091 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c380d6-f34a-47fa-950f-975f8a988814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:06.585852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c380d6-f34a-47fa-950f-975f8a988814 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:06.603853 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 291/580] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:06.603853 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c380d6-f34a-47fa-950f-975f8a988814 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:06.676375 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef14e0-be7d-4ddb-868d-a76ddbf16b2b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:06.720233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582a1f6-ac2e-4f2f-8953-b5c422d49843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:06.720959 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582a1f6-ac2e-4f2f-8953-b5c422d49843 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:06.721243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582a1f6-ac2e-4f2f-8953-b5c422d49843 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:06.721563 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582a1f6-ac2e-4f2f-8953-b5c422d49843 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:06.722425 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582a1f6-ac2e-4f2f-8953-b5c422d49843 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:06.722741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582a1f6-ac2e-4f2f-8953-b5c422d49843 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:06.724258 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582a1f6-ac2e-4f2f-8953-b5c422d49843 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:06.734146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c380d6-f34a-47fa-950f-975f8a988814 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:06.746290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 290/581] 10.222.0.112 () {56 vars in 1142 bytes} [Thu May 26 16:34:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:06.747154 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582a1f6-ac2e-4f2f-8953-b5c422d49843 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:06.774538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:06.781706 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b1adc-f203-4d74-a659-3ac19e3f3cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:06.781908 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b1adc-f203-4d74-a659-3ac19e3f3cd3 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:06.782151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b1adc-f203-4d74-a659-3ac19e3f3cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:06.785698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b1adc-f203-4d74-a659-3ac19e3f3cd3 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:06.785698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b1adc-f203-4d74-a659-3ac19e3f3cd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:06.785698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b1adc-f203-4d74-a659-3ac19e3f3cd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:06.785698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b1adc-f203-4d74-a659-3ac19e3f3cd3 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:06.807898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 292/582] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:06.807898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b1adc-f203-4d74-a659-3ac19e3f3cd3 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:06.825233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:06.875125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582a1f6-ac2e-4f2f-8953-b5c422d49843 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:06.921016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83735765-23b2-42be-bf9e-5a0c6c4edb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:06.921715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735765-23b2-42be-bf9e-5a0c6c4edb8d None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:06.921994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735765-23b2-42be-bf9e-5a0c6c4edb8d None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:06.922277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735765-23b2-42be-bf9e-5a0c6c4edb8d None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:06.923085 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83735765-23b2-42be-bf9e-5a0c6c4edb8d None admin] RBAC: Adding query filter params (name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:06.923431 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83735765-23b2-42be-bf9e-5a0c6c4edb8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:06.924815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83735765-23b2-42be-bf9e-5a0c6c4edb8d None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:06.931167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b1adc-f203-4d74-a659-3ac19e3f3cd3 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:06.934965 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 291/583] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:34:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:06.936160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83735765-23b2-42be-bf9e-5a0c6c4edb8d None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:07.005282 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9f734-dbcf-4f53-b1c7-5e60c992fb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:07.006127 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9f734-dbcf-4f53-b1c7-5e60c992fb00 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:07.006439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9f734-dbcf-4f53-b1c7-5e60c992fb00 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:07.006715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9f734-dbcf-4f53-b1c7-5e60c992fb00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:07.014586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9f734-dbcf-4f53-b1c7-5e60c992fb00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:07.016021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9f734-dbcf-4f53-b1c7-5e60c992fb00 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:07.031966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-52e9f734-dbcf-4f53-b1c7-5e60c992fb00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:07.031966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:07.031966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:07.031966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:07.031966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:07.031966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:07.031966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:07.031966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:07.031966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:07.031966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:07.031966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:07.031966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:07.031966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:07.031966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:07.031966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:07.033006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:07.033942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:07.033942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:07.033942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:07.033942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:07.033942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:07.033942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:07.033942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:07.033942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:07.038106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 293/584] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:07.039657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9f734-dbcf-4f53-b1c7-5e60c992fb00 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:07.051131 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:07.072184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83735765-23b2-42be-bf9e-5a0c6c4edb8d None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:07.114481 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a8fda-3d26-47ff-af6d-76a5309fd7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:07.115639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a8fda-3d26-47ff-af6d-76a5309fd7af None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:07.116205 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a8fda-3d26-47ff-af6d-76a5309fd7af None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:07.116498 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a8fda-3d26-47ff-af6d-76a5309fd7af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:07.128608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:07.132054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a8fda-3d26-47ff-af6d-76a5309fd7af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:07.134088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a8fda-3d26-47ff-af6d-76a5309fd7af None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:07.166274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-215a8fda-3d26-47ff-af6d-76a5309fd7af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:07.166274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:07.166274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:07.166274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:07.166274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:07.166274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:07.166274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:07.166274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:07.166274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:07.166274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:07.166274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:07.166274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:07.166274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:07.166274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:07.166274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:07.167303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:07.168290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:07.168290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:07.168290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:07.168290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:07.168290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 292/585] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:07.169669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a8fda-3d26-47ff-af6d-76a5309fd7af None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:07.176743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9f734-dbcf-4f53-b1c7-5e60c992fb00 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:07.233861 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6552e-c8ae-4a10-8b1b-6f10541c4098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:07.234811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6552e-c8ae-4a10-8b1b-6f10541c4098 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:07.235214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6552e-c8ae-4a10-8b1b-6f10541c4098 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:07.235697 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6552e-c8ae-4a10-8b1b-6f10541c4098 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:07.246510 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6552e-c8ae-4a10-8b1b-6f10541c4098 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:07.248076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6552e-c8ae-4a10-8b1b-6f10541c4098 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-29d6552e-c8ae-4a10-8b1b-6f10541c4098 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:07.263856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:07.265119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:07.266081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:07.266081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:07.266081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:07.266081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:07.266081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:07.266081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:07.266081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:07.266081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:07.266081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 16:34:07.266081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:07.269944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 294/586] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:34:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:07.270928 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6552e-c8ae-4a10-8b1b-6f10541c4098 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:07.339388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a8fda-3d26-47ff-af6d-76a5309fd7af None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:07.401715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52cd81-5d72-41b5-84f6-051f1d7f5c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:07.402897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52cd81-5d72-41b5-84f6-051f1d7f5c0a None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:07.403369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52cd81-5d72-41b5-84f6-051f1d7f5c0a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:07.403801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52cd81-5d72-41b5-84f6-051f1d7f5c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:07.412471 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:07.418080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52cd81-5d72-41b5-84f6-051f1d7f5c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:07.419768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52cd81-5d72-41b5-84f6-051f1d7f5c0a None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:07.442618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-2a52cd81-5d72-41b5-84f6-051f1d7f5c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:07.442618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:07.442618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:07.442618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:07.442618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:07.442618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:07.442618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:07.442618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:07.442618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:07.442618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:07.442618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:07.442618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:07.442618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:07.442618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:07.442618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:07.445144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:07.447975 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:07.447975 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:07.447975 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:07.447975 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:07.450897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 293/587] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:07.452865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52cd81-5d72-41b5-84f6-051f1d7f5c0a None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:07.465564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6552e-c8ae-4a10-8b1b-6f10541c4098 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:07.518868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:07.527973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb990859-02a2-49c5-bfd7-b9bfcd7e5046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:07.529003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb990859-02a2-49c5-bfd7-b9bfcd7e5046 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:07.529481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb990859-02a2-49c5-bfd7-b9bfcd7e5046 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:07.529935 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb990859-02a2-49c5-bfd7-b9bfcd7e5046 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:07.535734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb990859-02a2-49c5-bfd7-b9bfcd7e5046 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:07.535734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb990859-02a2-49c5-bfd7-b9bfcd7e5046 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:07.535734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb990859-02a2-49c5-bfd7-b9bfcd7e5046 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:07.558925 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 295/588] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:07.560806 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb990859-02a2-49c5-bfd7-b9bfcd7e5046 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:07.606703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52cd81-5d72-41b5-84f6-051f1d7f5c0a None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:07.663442 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d4732-c078-4289-83a1-bd1f81933012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:07.664173 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d4732-c078-4289-83a1-bd1f81933012 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:07.664472 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d4732-c078-4289-83a1-bd1f81933012 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:07.664752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d4732-c078-4289-83a1-bd1f81933012 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:07.665644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d4732-c078-4289-83a1-bd1f81933012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:07.666023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d4732-c078-4289-83a1-bd1f81933012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:07.667504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d4732-c078-4289-83a1-bd1f81933012 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:07.683533 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 294/589] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:07.684433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d4732-c078-4289-83a1-bd1f81933012 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:07.715844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb990859-02a2-49c5-bfd7-b9bfcd7e5046 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:07.766416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:07.790876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc8647-a3be-4f6b-b0c1-118b93f6b5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:07.791563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8647-a3be-4f6b-b0c1-118b93f6b5f1 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:07.791847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8647-a3be-4f6b-b0c1-118b93f6b5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:07.792134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8647-a3be-4f6b-b0c1-118b93f6b5f1 None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:07.792972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc8647-a3be-4f6b-b0c1-118b93f6b5f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:07.793276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc8647-a3be-4f6b-b0c1-118b93f6b5f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:07.794961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc8647-a3be-4f6b-b0c1-118b93f6b5f1 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:07.819605 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 296/590] 10.222.0.112 () {56 vars in 1142 bytes} [Thu May 26 16:34:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:07.823466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc8647-a3be-4f6b-b0c1-118b93f6b5f1 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:07.843458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d4732-c078-4289-83a1-bd1f81933012 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:07.890514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879aa11f-c1eb-40c6-9e20-4e2bbf43ec6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:07.891304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879aa11f-c1eb-40c6-9e20-4e2bbf43ec6c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:07.891648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879aa11f-c1eb-40c6-9e20-4e2bbf43ec6c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:07.891996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879aa11f-c1eb-40c6-9e20-4e2bbf43ec6c None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:07.892936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879aa11f-c1eb-40c6-9e20-4e2bbf43ec6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:07.893244 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879aa11f-c1eb-40c6-9e20-4e2bbf43ec6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:07.894747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879aa11f-c1eb-40c6-9e20-4e2bbf43ec6c None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:07.897483 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:07.918552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 295/591] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:07.919342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879aa11f-c1eb-40c6-9e20-4e2bbf43ec6c None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:07.977095 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc8647-a3be-4f6b-b0c1-118b93f6b5f1 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:08.017189 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200e2d8-8bfe-4796-9f7e-842d904dae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:08.018461 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200e2d8-8bfe-4796-9f7e-842d904dae2a None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:08.018759 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200e2d8-8bfe-4796-9f7e-842d904dae2a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:08.019073 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200e2d8-8bfe-4796-9f7e-842d904dae2a None admin] PATH_INFO: `/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/5f2ec4c76f8f4d858bce53f30cc198fa/roles/64acd9118f3d4931be8ca4bfa4ae907e` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:08.043271 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200e2d8-8bfe-4796-9f7e-842d904dae2a None admin] RBAC: Authorizing `identity:create_grant(project_id=9be90db8d7ee4bd0b01444d1eab83ad8, user_id=5f2ec4c76f8f4d858bce53f30cc198fa, role_id=64acd9118f3d4931be8ca4bfa4ae907e)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:08.045837 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200e2d8-8bfe-4796-9f7e-842d904dae2a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:08.049534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879aa11f-c1eb-40c6-9e20-4e2bbf43ec6c None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:08.062637 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:08.092201 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0fd0-a219-4e59-8386-487cbf45025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:08.093050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0fd0-a219-4e59-8386-487cbf45025e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:08.093343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0fd0-a219-4e59-8386-487cbf45025e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:08.093624 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0fd0-a219-4e59-8386-487cbf45025e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:08.100969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c0fd0-a219-4e59-8386-487cbf45025e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:08.103207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c0fd0-a219-4e59-8386-487cbf45025e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:08.117685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-835c0fd0-a219-4e59-8386-487cbf45025e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:08.117685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:08.117685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:08.117685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:08.117685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:08.117685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:08.117685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:08.117685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:08.117685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:08.117685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:08.117685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:08.117685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:08.117685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:08.117685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:08.117685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:08.118709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:08.119816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:08.119816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:08.119816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:08.119816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:08.119816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:08.119816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:08.119816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:08.119816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:08.119816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 296/592] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:08.119816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0fd0-a219-4e59-8386-487cbf45025e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:08.178843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 297/593] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:34:07 2022] PUT /identity/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/5f2ec4c76f8f4d858bce53f30cc198fa/roles/64acd9118f3d4931be8ca4bfa4ae907e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:34:08.179643 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200e2d8-8bfe-4796-9f7e-842d904dae2a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:08.252878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0fd0-a219-4e59-8386-487cbf45025e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:08.320386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad9df5-25bd-425a-a107-924a1ff4ee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:08.321961 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad9df5-25bd-425a-a107-924a1ff4ee20 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:08.322312 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad9df5-25bd-425a-a107-924a1ff4ee20 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:08.322667 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad9df5-25bd-425a-a107-924a1ff4ee20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:08.345057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad9df5-25bd-425a-a107-924a1ff4ee20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:08.346739 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad9df5-25bd-425a-a107-924a1ff4ee20 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:08.358161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:08.362001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200e2d8-8bfe-4796-9f7e-842d904dae2a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:08.372296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-97ad9df5-25bd-425a-a107-924a1ff4ee20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:08.372296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:08.372296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:08.372296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:08.372296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:08.372296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:08.372296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:08.372296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:08.372296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:08.372296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:08.372296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:08.372296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:08.372296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:08.372296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:08.372296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:08.380319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:08.381531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:08.381531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:08.381531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:08.381531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:08.381531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 297/594] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:08.381531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff57254-a5a7-4a59-ad36-ac1229eb2b09 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:08.381531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff57254-a5a7-4a59-ad36-ac1229eb2b09 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:08.381531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff57254-a5a7-4a59-ad36-ac1229eb2b09 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:08.381531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 298/595] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:08.382253 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff57254-a5a7-4a59-ad36-ac1229eb2b09 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:08.415646 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:08.433866 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d0d6f-0267-4389-b8a0-7a662414157c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:08.435149 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d0d6f-0267-4389-b8a0-7a662414157c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:08.435149 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d0d6f-0267-4389-b8a0-7a662414157c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:08.435524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d0d6f-0267-4389-b8a0-7a662414157c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:08.447165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d0d6f-0267-4389-b8a0-7a662414157c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:08.450098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d0d6f-0267-4389-b8a0-7a662414157c None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-420d0d6f-0267-4389-b8a0-7a662414157c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:08.467246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:08.472452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:08.473839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:08.473839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:08.473839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:08.473839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:08.473839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:08.473839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:08.473839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:08.473839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:08.473839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:34:08.473839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:08.473839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 298/596] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:08.473839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d0d6f-0267-4389-b8a0-7a662414157c None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:08.544662 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff57254-a5a7-4a59-ad36-ac1229eb2b09 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:08.589752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f439-c335-40cf-bf3e-7311b6a7a675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:08.590922 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f439-c335-40cf-bf3e-7311b6a7a675 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:08.590922 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f439-c335-40cf-bf3e-7311b6a7a675 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:08.591166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f439-c335-40cf-bf3e-7311b6a7a675 None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:08.592207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814f439-c335-40cf-bf3e-7311b6a7a675 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:08.592207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814f439-c335-40cf-bf3e-7311b6a7a675 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:08.593747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814f439-c335-40cf-bf3e-7311b6a7a675 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:08.607874 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 299/597] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:08.609059 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a048b-4c6b-4255-8406-aea2a9d3ddcc None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:08.609356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a048b-4c6b-4255-8406-aea2a9d3ddcc None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:08.609641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a048b-4c6b-4255-8406-aea2a9d3ddcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:08.631524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d0d6f-0267-4389-b8a0-7a662414157c None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:08.634828 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-876a048b-4c6b-4255-8406-aea2a9d3ddcc None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:08.636049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-876a048b-4c6b-4255-8406-aea2a9d3ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:08.686473 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49486c4d-49b5-44cc-ad9b-b9372341b3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:08.687126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49486c4d-49b5-44cc-ad9b-b9372341b3e4 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:08.687513 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49486c4d-49b5-44cc-ad9b-b9372341b3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:08.687918 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49486c4d-49b5-44cc-ad9b-b9372341b3e4 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:08.689256 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49486c4d-49b5-44cc-ad9b-b9372341b3e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:08.689731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49486c4d-49b5-44cc-ad9b-b9372341b3e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:08.691421 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49486c4d-49b5-44cc-ad9b-b9372341b3e4 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:08.707362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 299/598] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:08.707988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49486c4d-49b5-44cc-ad9b-b9372341b3e4 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:08.737139 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:08.744117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 300/599] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:08.746554 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a048b-4c6b-4255-8406-aea2a9d3ddcc None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:08.768397 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:08.879430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49486c4d-49b5-44cc-ad9b-b9372341b3e4 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:08.926480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a048b-4c6b-4255-8406-aea2a9d3ddcc None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:08.934910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21b284-3c23-4aae-a819-ec52b6240f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:08.935596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21b284-3c23-4aae-a819-ec52b6240f07 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:08.935890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21b284-3c23-4aae-a819-ec52b6240f07 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:08.936160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21b284-3c23-4aae-a819-ec52b6240f07 None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:08.937059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21b284-3c23-4aae-a819-ec52b6240f07 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:08.937582 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21b284-3c23-4aae-a819-ec52b6240f07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:08.939104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21b284-3c23-4aae-a819-ec52b6240f07 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:08.969725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 300/600] 10.222.0.112 () {56 vars in 1144 bytes} [Thu May 26 16:34:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:08.971814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21b284-3c23-4aae-a819-ec52b6240f07 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:08.991750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030eb844-ec7e-491a-a207-d5f8c0af63f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:08.993929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030eb844-ec7e-491a-a207-d5f8c0af63f0 None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:08.994568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030eb844-ec7e-491a-a207-d5f8c0af63f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:08.995021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030eb844-ec7e-491a-a207-d5f8c0af63f0 None admin] PATH_INFO: `/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/53822ebd38c94a729591cb270e0459ad/roles/64acd9118f3d4931be8ca4bfa4ae907e` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:09.016546 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030eb844-ec7e-491a-a207-d5f8c0af63f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9be90db8d7ee4bd0b01444d1eab83ad8, user_id=53822ebd38c94a729591cb270e0459ad, role_id=64acd9118f3d4931be8ca4bfa4ae907e)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:09.019250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030eb844-ec7e-491a-a207-d5f8c0af63f0 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:09.081792 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:09.118468 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 301/601] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:34:08 2022] PUT /identity/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/53822ebd38c94a729591cb270e0459ad/roles/64acd9118f3d4931be8ca4bfa4ae907e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:34:09.118468 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030eb844-ec7e-491a-a207-d5f8c0af63f0 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:09.126588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21b284-3c23-4aae-a819-ec52b6240f07 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:09.196765 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b744e-aaae-4823-8d85-fdf3b6cc6bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:09.200944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b744e-aaae-4823-8d85-fdf3b6cc6bb3 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:09.201422 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b744e-aaae-4823-8d85-fdf3b6cc6bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:09.201881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b744e-aaae-4823-8d85-fdf3b6cc6bb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:09.215109 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b744e-aaae-4823-8d85-fdf3b6cc6bb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:09.216685 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b744e-aaae-4823-8d85-fdf3b6cc6bb3 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:09.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-271b744e-aaae-4823-8d85-fdf3b6cc6bb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:09.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:09.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:09.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:09.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:09.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:09.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:09.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:09.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:09.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:09.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:09.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:09.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:09.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:09.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:09.241318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:09.243084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:09.243084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:09.243084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:09.243084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:09.243084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:09.243084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:09.243084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:09.243084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:09.247201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 301/602] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:09.248475 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b744e-aaae-4823-8d85-fdf3b6cc6bb3 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:09.251227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:09.326159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030eb844-ec7e-491a-a207-d5f8c0af63f0 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:09.396706 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b686d93-3c0d-4af9-afb8-993f81cfcadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:09.399385 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b686d93-3c0d-4af9-afb8-993f81cfcadb None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:09.400126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b686d93-3c0d-4af9-afb8-993f81cfcadb None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:09.400792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b686d93-3c0d-4af9-afb8-993f81cfcadb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:09.409454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b744e-aaae-4823-8d85-fdf3b6cc6bb3 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:09.422934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b686d93-3c0d-4af9-afb8-993f81cfcadb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-8b686d93-3c0d-4af9-afb8-993f81cfcadb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:09.436639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:09.438941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:09.441079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:09.441079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:09.441079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:09.441079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:09.441079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:09.441079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:09.441079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:09.441079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:09.441079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:09.441079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:09.441079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:09.441079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:09.445674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 302/603] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:09.447702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b686d93-3c0d-4af9-afb8-993f81cfcadb None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:09.471406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e248db-fea2-43fa-a9cc-5de927874534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:09.472608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e248db-fea2-43fa-a9cc-5de927874534 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:09.473298 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e248db-fea2-43fa-a9cc-5de927874534 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:09.473809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e248db-fea2-43fa-a9cc-5de927874534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:09.487962 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:09.497837 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e248db-fea2-43fa-a9cc-5de927874534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:09.500639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e248db-fea2-43fa-a9cc-5de927874534 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:09.535673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-13e248db-fea2-43fa-a9cc-5de927874534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:09.535673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:09.535673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:09.535673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:09.535673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:09.535673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:09.535673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:09.535673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:09.535673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:09.535673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:09.535673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:09.535673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:09.535673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:09.535673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:09.535673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:09.537694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:09.540927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:09.540927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:09.540927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:09.540927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:09.546363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 302/604] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:09.546363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e248db-fea2-43fa-a9cc-5de927874534 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:09.654887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b686d93-3c0d-4af9-afb8-993f81cfcadb None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:09.699021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:09.718137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf2a7f-7793-481d-8165-0857a213c44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:09.719656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf2a7f-7793-481d-8165-0857a213c44e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:09.720673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf2a7f-7793-481d-8165-0857a213c44e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:09.721390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf2a7f-7793-481d-8165-0857a213c44e None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:09.723326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf2a7f-7793-481d-8165-0857a213c44e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:09.724153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf2a7f-7793-481d-8165-0857a213c44e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:09.727300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf2a7f-7793-481d-8165-0857a213c44e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:09.739616 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e248db-fea2-43fa-a9cc-5de927874534 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:09.758847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 303/605] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:09.760963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf2a7f-7793-481d-8165-0857a213c44e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:09.804087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72792b-b4d1-4360-a9f2-c397c9a96770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:09.806365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72792b-b4d1-4360-a9f2-c397c9a96770 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:09.806935 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72792b-b4d1-4360-a9f2-c397c9a96770 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:09.807481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72792b-b4d1-4360-a9f2-c397c9a96770 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:09.808999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72792b-b4d1-4360-a9f2-c397c9a96770 None admin] RBAC: Adding query filter params (name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:09.809602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72792b-b4d1-4360-a9f2-c397c9a96770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:09.812199 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72792b-b4d1-4360-a9f2-c397c9a96770 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:09.829328 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 303/606] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:34:09 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:09.839073 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72792b-b4d1-4360-a9f2-c397c9a96770 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:09.944501 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:09.969010 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf2a7f-7793-481d-8165-0857a213c44e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:10.031098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ea00a-6a24-4150-8081-4e8494a03365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:10.032385 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ea00a-6a24-4150-8081-4e8494a03365 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:10.032978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ea00a-6a24-4150-8081-4e8494a03365 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:10.033554 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ea00a-6a24-4150-8081-4e8494a03365 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:10.035015 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ea00a-6a24-4150-8081-4e8494a03365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:10.035658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ea00a-6a24-4150-8081-4e8494a03365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:10.038194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ea00a-6a24-4150-8081-4e8494a03365 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:10.044728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72792b-b4d1-4360-a9f2-c397c9a96770 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:10.067375 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 304/607] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:10.072580 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ea00a-6a24-4150-8081-4e8494a03365 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:10.111304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917537e-61e1-4dc2-a786-b51f15e9378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:10.113263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917537e-61e1-4dc2-a786-b51f15e9378a None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:10.114030 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917537e-61e1-4dc2-a786-b51f15e9378a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:10.114728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917537e-61e1-4dc2-a786-b51f15e9378a None admin] PATH_INFO: `/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/adf32c811ead4fd0b69c83890a56509d/roles/64acd9118f3d4931be8ca4bfa4ae907e` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:10.139320 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917537e-61e1-4dc2-a786-b51f15e9378a None admin] RBAC: Authorizing `identity:create_grant(project_id=9be90db8d7ee4bd0b01444d1eab83ad8, user_id=adf32c811ead4fd0b69c83890a56509d, role_id=64acd9118f3d4931be8ca4bfa4ae907e)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:10.141436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917537e-61e1-4dc2-a786-b51f15e9378a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:10.144231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:10.234688 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 304/608] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:34:09 2022] PUT /identity/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/adf32c811ead4fd0b69c83890a56509d/roles/64acd9118f3d4931be8ca4bfa4ae907e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:34:10.237132 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917537e-61e1-4dc2-a786-b51f15e9378a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:10.289235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ea00a-6a24-4150-8081-4e8494a03365 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:10.382603 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26ab89-f6aa-4500-8ff8-b06f54d606bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:10.384343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26ab89-f6aa-4500-8ff8-b06f54d606bf None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:10.384846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26ab89-f6aa-4500-8ff8-b06f54d606bf None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:10.385341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26ab89-f6aa-4500-8ff8-b06f54d606bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:10.439985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26ab89-f6aa-4500-8ff8-b06f54d606bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:10.443253 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26ab89-f6aa-4500-8ff8-b06f54d606bf None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:10.444510 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917537e-61e1-4dc2-a786-b51f15e9378a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:10.449185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:10.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-7a26ab89-f6aa-4500-8ff8-b06f54d606bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:10.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:10.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:10.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:10.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:10.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:10.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:10.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:10.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:10.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:10.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:10.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:10.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:10.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:10.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:10.509019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:10.510691 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:10.510691 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:10.510691 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:10.510691 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:10.510691 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 305/609] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:10.519412 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26ab89-f6aa-4500-8ff8-b06f54d606bf None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:10.520160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97bd82-3a41-4440-8399-8244650f7d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:10.521940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97bd82-3a41-4440-8399-8244650f7d43 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:10.522728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97bd82-3a41-4440-8399-8244650f7d43 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:10.523451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97bd82-3a41-4440-8399-8244650f7d43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:10.535601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97bd82-3a41-4440-8399-8244650f7d43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:10.538788 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97bd82-3a41-4440-8399-8244650f7d43 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:10.560976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-6c97bd82-3a41-4440-8399-8244650f7d43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:10.560976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:10.560976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:10.560976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:10.560976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:10.560976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:10.560976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:10.560976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:10.560976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:10.560976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:10.560976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:10.560976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:10.560976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:10.560976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:10.560976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:10.561960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:10.562926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:10.562926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:10.562926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:10.562926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:10.562926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:10.562926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:10.562926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:10.562926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:10.566576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 305/610] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:10.577123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97bd82-3a41-4440-8399-8244650f7d43 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:10.687337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:10.701080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26ab89-f6aa-4500-8ff8-b06f54d606bf None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:10.754675 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e84fb-b3c9-47b4-8792-ea225a6bc387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:10.755792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e84fb-b3c9-47b4-8792-ea225a6bc387 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:10.756334 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e84fb-b3c9-47b4-8792-ea225a6bc387 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:10.756621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e84fb-b3c9-47b4-8792-ea225a6bc387 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:10.757993 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e84fb-b3c9-47b4-8792-ea225a6bc387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:10.758274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e84fb-b3c9-47b4-8792-ea225a6bc387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:10.759969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e84fb-b3c9-47b4-8792-ea225a6bc387 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:10.777961 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 306/611] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:10.779816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e38ac-cc45-40ce-a6ba-22353c84136d None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:10.780010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97bd82-3a41-4440-8399-8244650f7d43 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:10.780492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e38ac-cc45-40ce-a6ba-22353c84136d None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:10.780997 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e38ac-cc45-40ce-a6ba-22353c84136d None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:10.784038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 307/612] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:10 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:10.789324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e38ac-cc45-40ce-a6ba-22353c84136d None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:10.831371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa47bbc-7d9f-4ce4-8576-c7c8479210f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:10.831371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa47bbc-7d9f-4ce4-8576-c7c8479210f9 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:10.831371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa47bbc-7d9f-4ce4-8576-c7c8479210f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:10.831371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa47bbc-7d9f-4ce4-8576-c7c8479210f9 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:10.831797 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa47bbc-7d9f-4ce4-8576-c7c8479210f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:10.831797 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa47bbc-7d9f-4ce4-8576-c7c8479210f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:10.831797 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa47bbc-7d9f-4ce4-8576-c7c8479210f9 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:10.850568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 306/613] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:10.853319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6ee8b-11d7-4a6e-863c-503ebb3c1913 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:10.853542 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6ee8b-11d7-4a6e-863c-503ebb3c1913 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:10.853907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6ee8b-11d7-4a6e-863c-503ebb3c1913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:10.875855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-24c6ee8b-11d7-4a6e-863c-503ebb3c1913 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:10.877305 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-24c6ee8b-11d7-4a6e-863c-503ebb3c1913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:10.899230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:10.942134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e38ac-cc45-40ce-a6ba-22353c84136d None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:10.976921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 307/614] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:10.978465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6ee8b-11d7-4a6e-863c-503ebb3c1913 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:10.983406 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932ebb7-8c54-416a-9b19-fa602ad38fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:10.984491 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932ebb7-8c54-416a-9b19-fa602ad38fc2 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:10.984987 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932ebb7-8c54-416a-9b19-fa602ad38fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:10.985463 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932ebb7-8c54-416a-9b19-fa602ad38fc2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:10.997312 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932ebb7-8c54-416a-9b19-fa602ad38fc2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:10.999438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932ebb7-8c54-416a-9b19-fa602ad38fc2 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-a932ebb7-8c54-416a-9b19-fa602ad38fc2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:11.021628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:11.022633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:11.024321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:11.024321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:11.024321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:11.024321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:11.024321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:11.024321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:11.024321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:11.024321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:11.024321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:34:11.024321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:11.027455 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 308/615] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:34:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:11.028658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932ebb7-8c54-416a-9b19-fa602ad38fc2 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:11.073763 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:11.143699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6ee8b-11d7-4a6e-863c-503ebb3c1913 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:11.196072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932ebb7-8c54-416a-9b19-fa602ad38fc2 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:11.202740 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a3f9b-e0a4-4940-8282-b642baad5357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:11.204088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a3f9b-e0a4-4940-8282-b642baad5357 None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:11.204722 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a3f9b-e0a4-4940-8282-b642baad5357 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:11.205312 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a3f9b-e0a4-4940-8282-b642baad5357 None admin] PATH_INFO: `/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/0288901db0244eab9a737af460ce1bd0/roles/64acd9118f3d4931be8ca4bfa4ae907e` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:11.236765 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a3f9b-e0a4-4940-8282-b642baad5357 None admin] RBAC: Authorizing `identity:create_grant(project_id=9be90db8d7ee4bd0b01444d1eab83ad8, user_id=0288901db0244eab9a737af460ce1bd0, role_id=64acd9118f3d4931be8ca4bfa4ae907e)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:11.236765 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a3f9b-e0a4-4940-8282-b642baad5357 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:11.252470 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382deb49-a93c-4951-9393-4cf78225c514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:11.253285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382deb49-a93c-4951-9393-4cf78225c514 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:11.253573 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382deb49-a93c-4951-9393-4cf78225c514 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:11.253903 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382deb49-a93c-4951-9393-4cf78225c514 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:11.269731 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382deb49-a93c-4951-9393-4cf78225c514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-382deb49-a93c-4951-9393-4cf78225c514 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:11.279183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:11.280200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:11.281048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:11.281048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:11.281048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:11.281048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:11.281048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:11.281048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:11.281048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:11.281048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:11.281048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:11.281048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:11.281048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:11.281048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:11.281692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 309/616] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:11.286208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382deb49-a93c-4951-9393-4cf78225c514 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:11.334550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 308/617] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:34:10 2022] PUT /identity/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/0288901db0244eab9a737af460ce1bd0/roles/64acd9118f3d4931be8ca4bfa4ae907e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:34:11.336593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a3f9b-e0a4-4940-8282-b642baad5357 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:11.345538 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:11.406979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:11.441244 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382deb49-a93c-4951-9393-4cf78225c514 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:11.490357 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3f220-24bb-4884-b192-7becf982ee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:11.491455 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3f220-24bb-4884-b192-7becf982ee97 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:11.491998 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3f220-24bb-4884-b192-7becf982ee97 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:11.492483 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3f220-24bb-4884-b192-7becf982ee97 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:11.493552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3f220-24bb-4884-b192-7becf982ee97 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:11.494082 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3f220-24bb-4884-b192-7becf982ee97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:11.496685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3f220-24bb-4884-b192-7becf982ee97 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:11.524951 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 310/618] 10.222.0.112 () {56 vars in 1140 bytes} [Thu May 26 16:34:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:11.531334 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3f220-24bb-4884-b192-7becf982ee97 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:11.649300 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a3f9b-e0a4-4940-8282-b642baad5357 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:11.679817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3f220-24bb-4884-b192-7becf982ee97 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:11.734745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47905fc3-e4f2-49a5-bb77-d15ad97013a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:11.735711 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47905fc3-e4f2-49a5-bb77-d15ad97013a8 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:11.735991 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47905fc3-e4f2-49a5-bb77-d15ad97013a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:11.736261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47905fc3-e4f2-49a5-bb77-d15ad97013a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:11.741943 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c697ef-9dec-4c61-84d8-099d504b4989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:11.743235 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c697ef-9dec-4c61-84d8-099d504b4989 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:11.743670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c697ef-9dec-4c61-84d8-099d504b4989 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:11.744104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c697ef-9dec-4c61-84d8-099d504b4989 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:11.745296 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c697ef-9dec-4c61-84d8-099d504b4989 None admin] RBAC: Adding query filter params (name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:11.745781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c697ef-9dec-4c61-84d8-099d504b4989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:11.746695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:11.748129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c697ef-9dec-4c61-84d8-099d504b4989 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:11.750617 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47905fc3-e4f2-49a5-bb77-d15ad97013a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:11.754065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47905fc3-e4f2-49a5-bb77-d15ad97013a8 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:11.760735 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 309/619] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:34:11 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:11.769343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c697ef-9dec-4c61-84d8-099d504b4989 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:11.793100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-47905fc3-e4f2-49a5-bb77-d15ad97013a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:11.793100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:11.793100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:11.793100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:11.793100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:11.793100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:11.793100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:11.793100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:11.793100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:11.793100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:11.793100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:11.793100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:11.793100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:11.793100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:11.793100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:11.794050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:11.795029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:11.795029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:11.795029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:11.795029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:11.795029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 311/620] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:11.801699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47905fc3-e4f2-49a5-bb77-d15ad97013a8 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:11.931294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:12.020586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c697ef-9dec-4c61-84d8-099d504b4989 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:12.068704 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc3052-b74a-4af5-9767-be21cb00ca28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:12.074345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc3052-b74a-4af5-9767-be21cb00ca28 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:12.074345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc3052-b74a-4af5-9767-be21cb00ca28 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:12.074345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc3052-b74a-4af5-9767-be21cb00ca28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:12.090204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc3052-b74a-4af5-9767-be21cb00ca28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:12.091292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47905fc3-e4f2-49a5-bb77-d15ad97013a8 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:12.091919 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc3052-b74a-4af5-9767-be21cb00ca28 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:12.114745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-6ecc3052-b74a-4af5-9767-be21cb00ca28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:12.114745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:12.114745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:12.114745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:12.114745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:12.114745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:12.114745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:12.114745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:12.114745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:12.114745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:12.114745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:12.114745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:12.114745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:12.114745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:12.114745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:12.116175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:12.117816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:12.117816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:12.117816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:12.117816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:12.117816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 310/621] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:12.120592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8751458-d7b3-499e-97fb-045fb4bc747e None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:12.121251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8751458-d7b3-499e-97fb-045fb4bc747e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:12.121626 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8751458-d7b3-499e-97fb-045fb4bc747e None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:12.124799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 311/622] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:12 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:12.126024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8751458-d7b3-499e-97fb-045fb4bc747e None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:12.136793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e9a4f-d213-485e-8a32-7e8c81d87519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:12.137478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e9a4f-d213-485e-8a32-7e8c81d87519 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:12.137765 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e9a4f-d213-485e-8a32-7e8c81d87519 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:12.138046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e9a4f-d213-485e-8a32-7e8c81d87519 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:12.138836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e9a4f-d213-485e-8a32-7e8c81d87519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:12.139282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e9a4f-d213-485e-8a32-7e8c81d87519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:12.140920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e9a4f-d213-485e-8a32-7e8c81d87519 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:12.165781 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 312/623] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:12.168243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cc6d9-a83f-49aa-9125-de7c548fc1ae None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:12.168690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cc6d9-a83f-49aa-9125-de7c548fc1ae None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:12.169222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cc6d9-a83f-49aa-9125-de7c548fc1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:12.192115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-817cc6d9-a83f-49aa-9125-de7c548fc1ae None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:12.193582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-817cc6d9-a83f-49aa-9125-de7c548fc1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:12.268173 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:12.298203 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8751458-d7b3-499e-97fb-045fb4bc747e None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:12.314830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 313/624] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:12.316646 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cc6d9-a83f-49aa-9125-de7c548fc1ae None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:12.321774 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:12.348360 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94d034-f6b6-4695-ad58-55a6d8d3111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:12.349887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94d034-f6b6-4695-ad58-55a6d8d3111e None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:12.350590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94d034-f6b6-4695-ad58-55a6d8d3111e None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:12.352857 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94d034-f6b6-4695-ad58-55a6d8d3111e None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:12.353923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94d034-f6b6-4695-ad58-55a6d8d3111e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:12.354670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94d034-f6b6-4695-ad58-55a6d8d3111e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:12.356913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94d034-f6b6-4695-ad58-55a6d8d3111e None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:12.380516 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 312/625] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:12.380516 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94d034-f6b6-4695-ad58-55a6d8d3111e None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:12.454830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cc6d9-a83f-49aa-9125-de7c548fc1ae None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:12.498417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84bb71-2f14-4f21-bce4-7601521e4f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:12.499807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84bb71-2f14-4f21-bce4-7601521e4f9e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:12.499992 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84bb71-2f14-4f21-bce4-7601521e4f9e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:12.500274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84bb71-2f14-4f21-bce4-7601521e4f9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:12.508719 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84bb71-2f14-4f21-bce4-7601521e4f9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:12.510794 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84bb71-2f14-4f21-bce4-7601521e4f9e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:12.514389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94d034-f6b6-4695-ad58-55a6d8d3111e None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:12.526593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-ae84bb71-2f14-4f21-bce4-7601521e4f9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:12.526593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:12.526593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:12.526593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:12.526593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:12.526593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:12.526593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:12.526593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:12.526593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:12.526593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:12.526593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:12.526593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:12.526593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:12.526593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:12.526593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:12.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:12.529150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:12.529150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:12.529150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:12.529150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:12.529150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:12.529150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:12.529150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:12.529150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:12.529150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 314/626] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:12.529150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84bb71-2f14-4f21-bce4-7601521e4f9e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:12.561184 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a933f8d-eec1-487c-af56-c38e96e05425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:12.562676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a933f8d-eec1-487c-af56-c38e96e05425 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:12.563261 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a933f8d-eec1-487c-af56-c38e96e05425 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:12.564048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a933f8d-eec1-487c-af56-c38e96e05425 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:12.572351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:12.581465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a933f8d-eec1-487c-af56-c38e96e05425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-4a933f8d-eec1-487c-af56-c38e96e05425 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:12.602230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:12.604121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:12.605834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:12.605834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:12.605834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:12.605834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:12.605834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:12.605834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:12.605834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:12.605834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:12.605834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:12.605834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:12.605834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:12.605834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:12.610869 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 313/627] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:12.614187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a933f8d-eec1-487c-af56-c38e96e05425 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:12.681318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:12.690177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84bb71-2f14-4f21-bce4-7601521e4f9e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:12.752060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2b231-2316-41e0-ace2-7f5fc53a1a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:12.753407 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2b231-2316-41e0-ace2-7f5fc53a1a13 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:12.753895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2b231-2316-41e0-ace2-7f5fc53a1a13 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:12.754430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2b231-2316-41e0-ace2-7f5fc53a1a13 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:12.769601 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2b231-2316-41e0-ace2-7f5fc53a1a13 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:12.772233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2b231-2316-41e0-ace2-7f5fc53a1a13 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-4fd2b231-2316-41e0-ace2-7f5fc53a1a13 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:12.800678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:12.802028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:12.803673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:12.803673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:12.803673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:12.803673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:12.803673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:12.803673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:12.803673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:12.803673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:12.803673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:34:12.803673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:12.806686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 315/628] 10.222.0.112 () {56 vars in 1098 bytes} [Thu May 26 16:34:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:12.807726 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2b231-2316-41e0-ace2-7f5fc53a1a13 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:12.810054 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a933f8d-eec1-487c-af56-c38e96e05425 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:12.871272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97140b-b575-4df8-85c0-0f6637570195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:12.872415 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97140b-b575-4df8-85c0-0f6637570195 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:12.872917 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97140b-b575-4df8-85c0-0f6637570195 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:12.873397 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97140b-b575-4df8-85c0-0f6637570195 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:12.874678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97140b-b575-4df8-85c0-0f6637570195 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:12.875279 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97140b-b575-4df8-85c0-0f6637570195 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:12.877543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97140b-b575-4df8-85c0-0f6637570195 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:12.894524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 314/629] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:12.895832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97140b-b575-4df8-85c0-0f6637570195 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:12.958409 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:12.978612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2b231-2316-41e0-ace2-7f5fc53a1a13 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:13.045491 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8f103-112a-4028-b0b5-3b534743a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:13.046801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8f103-112a-4028-b0b5-3b534743a835 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:13.047205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:13.047419 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8f103-112a-4028-b0b5-3b534743a835 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:13.047891 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8f103-112a-4028-b0b5-3b534743a835 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:13.049306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8f103-112a-4028-b0b5-3b534743a835 None admin] RBAC: Adding query filter params (name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:13.049945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8f103-112a-4028-b0b5-3b534743a835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:13.052881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8f103-112a-4028-b0b5-3b534743a835 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:13.060366 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97140b-b575-4df8-85c0-0f6637570195 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:13.074806 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 316/630] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:34:12 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:13.076422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8f103-112a-4028-b0b5-3b534743a835 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:13.143423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc013fb-f760-4f3e-8b68-fc7f63975652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:13.145667 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc013fb-f760-4f3e-8b68-fc7f63975652 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:13.146125 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc013fb-f760-4f3e-8b68-fc7f63975652 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:13.146646 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc013fb-f760-4f3e-8b68-fc7f63975652 None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:13.149147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc013fb-f760-4f3e-8b68-fc7f63975652 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:13.149694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc013fb-f760-4f3e-8b68-fc7f63975652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:13.152466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc013fb-f760-4f3e-8b68-fc7f63975652 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:13.187947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 315/631] 10.222.0.112 () {56 vars in 1138 bytes} [Thu May 26 16:34:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:13.187947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc013fb-f760-4f3e-8b68-fc7f63975652 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:13.245222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8f103-112a-4028-b0b5-3b534743a835 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:13.295089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d37614-1eab-47b6-8f10-56d5f983fed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:13.297101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d37614-1eab-47b6-8f10-56d5f983fed2 None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:13.297984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d37614-1eab-47b6-8f10-56d5f983fed2 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:13.298730 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d37614-1eab-47b6-8f10-56d5f983fed2 None admin] PATH_INFO: `/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/465b269fc6ee415b8f5715843468d089/roles/64acd9118f3d4931be8ca4bfa4ae907e` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:13.320335 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d37614-1eab-47b6-8f10-56d5f983fed2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9be90db8d7ee4bd0b01444d1eab83ad8, user_id=465b269fc6ee415b8f5715843468d089, role_id=64acd9118f3d4931be8ca4bfa4ae907e)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:13.322625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d37614-1eab-47b6-8f10-56d5f983fed2 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:13.328401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc013fb-f760-4f3e-8b68-fc7f63975652 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:13.374013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1956b32-0383-45b5-b312-44cbd9693642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:13.375484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1956b32-0383-45b5-b312-44cbd9693642 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:13.375980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1956b32-0383-45b5-b312-44cbd9693642 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:13.376470 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1956b32-0383-45b5-b312-44cbd9693642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:13.394510 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1956b32-0383-45b5-b312-44cbd9693642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:13.395875 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1956b32-0383-45b5-b312-44cbd9693642 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:13.418975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-e1956b32-0383-45b5-b312-44cbd9693642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:13.418975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:13.418975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:13.418975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:13.418975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:13.418975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:13.418975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:13.418975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:13.418975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:13.418975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:13.418975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:13.418975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:13.418975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:13.418975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:13.418975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:13.420285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:13.422658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:13.422658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:13.422658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:13.422658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:13.422658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 316/632] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:13.422658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63c3cc-b96a-4c88-b69d-aa98fc34fc45 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:13.422658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63c3cc-b96a-4c88-b69d-aa98fc34fc45 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:13.422658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63c3cc-b96a-4c88-b69d-aa98fc34fc45 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:13.428868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 317/633] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:13.428868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63c3cc-b96a-4c88-b69d-aa98fc34fc45 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:13.446756 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 317/634] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:34:13 2022] PUT /identity/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/465b269fc6ee415b8f5715843468d089/roles/64acd9118f3d4931be8ca4bfa4ae907e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:34:13.446756 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d37614-1eab-47b6-8f10-56d5f983fed2 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:13.447797 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:13.462787 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:13.627278 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63c3cc-b96a-4c88-b69d-aa98fc34fc45 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:13.656377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d37614-1eab-47b6-8f10-56d5f983fed2 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:13.701250 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88dd00-5b18-43a4-9d57-face161794ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:13.702306 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88dd00-5b18-43a4-9d57-face161794ca None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:13.702794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88dd00-5b18-43a4-9d57-face161794ca None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:13.703257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88dd00-5b18-43a4-9d57-face161794ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:13.734193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004df10-6735-4d54-8c86-ba57bc120a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:13.735034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004df10-6735-4d54-8c86-ba57bc120a8c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:13.735385 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004df10-6735-4d54-8c86-ba57bc120a8c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:13.735751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004df10-6735-4d54-8c86-ba57bc120a8c None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:13.736968 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004df10-6735-4d54-8c86-ba57bc120a8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:13.737344 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004df10-6735-4d54-8c86-ba57bc120a8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:13.739067 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004df10-6735-4d54-8c86-ba57bc120a8c None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:13.768643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 318/635] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:13.770679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613064ac-4d4c-4ac7-a179-d462cc97a90b None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:13.771103 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613064ac-4d4c-4ac7-a179-d462cc97a90b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:13.771642 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613064ac-4d4c-4ac7-a179-d462cc97a90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:13.803386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-613064ac-4d4c-4ac7-a179-d462cc97a90b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:13.805454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-613064ac-4d4c-4ac7-a179-d462cc97a90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:13.851052 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88dd00-5b18-43a4-9d57-face161794ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:13.852998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88dd00-5b18-43a4-9d57-face161794ca None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:13.864619 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:13.894885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:13.904804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 319/636] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:13.906554 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613064ac-4d4c-4ac7-a179-d462cc97a90b None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:14.040572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 318/637] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:34:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:34:14.041994 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88dd00-5b18-43a4-9d57-face161794ca None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:14.130898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613064ac-4d4c-4ac7-a179-d462cc97a90b None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:14.201089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c319e3c-2292-437e-98b2-0391a1396f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:14.202365 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c319e3c-2292-437e-98b2-0391a1396f6c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:14.202656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c319e3c-2292-437e-98b2-0391a1396f6c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:14.202943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c319e3c-2292-437e-98b2-0391a1396f6c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:14.204173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88dd00-5b18-43a4-9d57-face161794ca None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:14.214367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c319e3c-2292-437e-98b2-0391a1396f6c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:14.216043 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c319e3c-2292-437e-98b2-0391a1396f6c None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:14.224584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-0c319e3c-2292-437e-98b2-0391a1396f6c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:14.243506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:14.244680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:14.245717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:14.245717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:14.245717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:14.245717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:14.245717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:14.245717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:14.245717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:14.245717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:14.245717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:34:14.245717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:14.245717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 320/638] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:34:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:14.247106 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c319e3c-2292-437e-98b2-0391a1396f6c None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:14.265842 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b68cb-6f73-4c1c-8ede-f5d5c3e23665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:14.266708 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b68cb-6f73-4c1c-8ede-f5d5c3e23665 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:14.266993 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b68cb-6f73-4c1c-8ede-f5d5c3e23665 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:14.267271 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b68cb-6f73-4c1c-8ede-f5d5c3e23665 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:14.283915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b68cb-6f73-4c1c-8ede-f5d5c3e23665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-e88b68cb-6f73-4c1c-8ede-f5d5c3e23665 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:14.297813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:14.299174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:14.300782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:14.300782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:14.300782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:14.300782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:14.300782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:14.300782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:14.300782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:14.300782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:14.300782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:14.300782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:14.300782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:14.300782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:14.300782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 319/639] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:14.302903 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9fc52-1c96-453a-93b1-0df92f4d4abf None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:14.302903 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9fc52-1c96-453a-93b1-0df92f4d4abf None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:14.303259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9fc52-1c96-453a-93b1-0df92f4d4abf None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:14.305650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 320/640] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:14 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:14.307545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9fc52-1c96-453a-93b1-0df92f4d4abf None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:14.346013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:14.416058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c319e3c-2292-437e-98b2-0391a1396f6c None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:14.469994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63349e-9afa-4519-9ac9-19b37a8bc466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:14.471314 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63349e-9afa-4519-9ac9-19b37a8bc466 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:14.472052 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63349e-9afa-4519-9ac9-19b37a8bc466 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:14.472273 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63349e-9afa-4519-9ac9-19b37a8bc466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:14.487382 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63349e-9afa-4519-9ac9-19b37a8bc466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:14.489426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63349e-9afa-4519-9ac9-19b37a8bc466 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:14.489618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9fc52-1c96-453a-93b1-0df92f4d4abf None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:14.518979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-bb63349e-9afa-4519-9ac9-19b37a8bc466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:14.518979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:14.518979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:14.518979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:14.518979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:14.518979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:14.518979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:14.518979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:14.518979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:14.518979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:14.518979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:14.518979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:14.518979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:14.518979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:14.518979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:14.520234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:14.521724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:14.521724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:14.521724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:14.521724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:14.521724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 321/641] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:14.522117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63349e-9afa-4519-9ac9-19b37a8bc466 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:14.545300 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae097aa6-323c-4199-a649-a96d9b47d596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:14.545990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae097aa6-323c-4199-a649-a96d9b47d596 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:14.546276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae097aa6-323c-4199-a649-a96d9b47d596 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:14.546587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae097aa6-323c-4199-a649-a96d9b47d596 None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:14.547437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae097aa6-323c-4199-a649-a96d9b47d596 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:14.547754 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae097aa6-323c-4199-a649-a96d9b47d596 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:14.549193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae097aa6-323c-4199-a649-a96d9b47d596 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:14.572406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 321/642] 10.222.0.112 () {56 vars in 1142 bytes} [Thu May 26 16:34:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:14.574957 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849f60-6cce-4456-9d50-6e1a41fac8e5 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:14.577610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849f60-6cce-4456-9d50-6e1a41fac8e5 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:14.577610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849f60-6cce-4456-9d50-6e1a41fac8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:14.602272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-78849f60-6cce-4456-9d50-6e1a41fac8e5 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:14.604221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-78849f60-6cce-4456-9d50-6e1a41fac8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:14.635573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:14.692069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63349e-9afa-4519-9ac9-19b37a8bc466 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:14.706248 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:14.738442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 322/643] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:14.738442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849f60-6cce-4456-9d50-6e1a41fac8e5 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:14.764171 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bc4f2-ee0b-4d81-b783-66465bb490a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:14.765328 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bc4f2-ee0b-4d81-b783-66465bb490a8 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:14.765970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bc4f2-ee0b-4d81-b783-66465bb490a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:14.767077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bc4f2-ee0b-4d81-b783-66465bb490a8 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:14.768894 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bc4f2-ee0b-4d81-b783-66465bb490a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:14.771402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bc4f2-ee0b-4d81-b783-66465bb490a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:14.774867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bc4f2-ee0b-4d81-b783-66465bb490a8 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:14.802524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 322/644] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:34:14 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:14.802524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bc4f2-ee0b-4d81-b783-66465bb490a8 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:14.938420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849f60-6cce-4456-9d50-6e1a41fac8e5 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:14.985093 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bc4f2-ee0b-4d81-b783-66465bb490a8 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:15.003065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36338240-390f-469a-af9a-f5fa39c6336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:15.004061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36338240-390f-469a-af9a-f5fa39c6336b None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:15.004591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36338240-390f-469a-af9a-f5fa39c6336b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:15.005078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36338240-390f-469a-af9a-f5fa39c6336b None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:15.006460 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36338240-390f-469a-af9a-f5fa39c6336b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:15.007048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36338240-390f-469a-af9a-f5fa39c6336b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:15.009327 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36338240-390f-469a-af9a-f5fa39c6336b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:15.026578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 323/645] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:15.027614 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36338240-390f-469a-af9a-f5fa39c6336b None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:15.052160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:15.055548 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaf686-f133-4f00-a44c-8af0664dfbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:15.056675 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaf686-f133-4f00-a44c-8af0664dfbbe None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:15.057462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaf686-f133-4f00-a44c-8af0664dfbbe None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:15.057639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaf686-f133-4f00-a44c-8af0664dfbbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:15.128728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:15.171348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbaf686-f133-4f00-a44c-8af0664dfbbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:15.173803 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbaf686-f133-4f00-a44c-8af0664dfbbe None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:15.179747 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36338240-390f-469a-af9a-f5fa39c6336b None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:15.238890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7783d9-a201-46c5-a006-051d1cdbeebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:15.240273 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7783d9-a201-46c5-a006-051d1cdbeebe None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:15.240765 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7783d9-a201-46c5-a006-051d1cdbeebe None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:15.241271 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7783d9-a201-46c5-a006-051d1cdbeebe None admin] PATH_INFO: `/v3/roles/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:15.266823 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7783d9-a201-46c5-a006-051d1cdbeebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-fd7783d9-a201-46c5-a006-051d1cdbeebe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:15.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:15.284829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:15.285999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:15.285999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:15.285999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:15.285999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:15.285999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:15.285999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:15.285999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:15.285999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:15.285999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:15.285999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:15.285999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:15.285999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:15.285999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 324/646] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:15.287307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7783d9-a201-46c5-a006-051d1cdbeebe None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:15.359166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 323/647] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:34:14 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:34:15.360318 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaf686-f133-4f00-a44c-8af0664dfbbe None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:15.427241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:15.467831 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7783d9-a201-46c5-a006-051d1cdbeebe None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:15.482908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:15.525937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb877c5-4565-4c63-bc1a-809edf7e4d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:15.526954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb877c5-4565-4c63-bc1a-809edf7e4d28 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:15.527396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb877c5-4565-4c63-bc1a-809edf7e4d28 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:15.527657 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaf686-f133-4f00-a44c-8af0664dfbbe None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:15.527816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb877c5-4565-4c63-bc1a-809edf7e4d28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:15.545361 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb877c5-4565-4c63-bc1a-809edf7e4d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:15.547821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb877c5-4565-4c63-bc1a-809edf7e4d28 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:15.575048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-bcb877c5-4565-4c63-bc1a-809edf7e4d28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:15.575048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:15.575048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:15.575048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:15.575048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:15.575048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:15.575048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:15.575048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:15.575048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:15.575048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:15.575048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:15.575048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:15.575048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:15.575048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:15.575048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:15.576748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:15.578547 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:15.578547 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:15.578547 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:15.578547 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:15.578547 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 325/648] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:15.578547 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb877c5-4565-4c63-bc1a-809edf7e4d28 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:15.593038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a305c5-b7ca-48fe-ae60-debbdba10ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:15.593862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a305c5-b7ca-48fe-ae60-debbdba10ac2 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:15.594169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a305c5-b7ca-48fe-ae60-debbdba10ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:15.594555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a305c5-b7ca-48fe-ae60-debbdba10ac2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:15.607911 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a305c5-b7ca-48fe-ae60-debbdba10ac2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:15.610642 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a305c5-b7ca-48fe-ae60-debbdba10ac2 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:15.633621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-87a305c5-b7ca-48fe-ae60-debbdba10ac2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:15.633621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:15.633621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:15.633621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:15.633621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:15.633621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:15.633621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:15.633621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:15.633621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:15.633621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:15.633621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:15.633621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:15.633621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:15.633621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:15.633621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:15.634626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:15.635708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:15.635708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:15.635708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:15.635708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:15.635708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:15.635708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:15.635708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:15.635708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:15.635708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 324/649] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:15.637278 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a305c5-b7ca-48fe-ae60-debbdba10ac2 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:15.766645 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb877c5-4565-4c63-bc1a-809edf7e4d28 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:15.800649 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a305c5-b7ca-48fe-ae60-debbdba10ac2 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:15.818770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:15.834478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34e984-0ec5-44b8-a0a2-ab20069f048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:15.836233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e984-0ec5-44b8-a0a2-ab20069f048d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:15.836698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e984-0ec5-44b8-a0a2-ab20069f048d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:15.837150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e984-0ec5-44b8-a0a2-ab20069f048d None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:15.838494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34e984-0ec5-44b8-a0a2-ab20069f048d None admin] RBAC: Adding query filter params (name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:15.839019 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34e984-0ec5-44b8-a0a2-ab20069f048d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:15.841481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34e984-0ec5-44b8-a0a2-ab20069f048d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:15.842313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:15.848962 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9c68b-4c9e-4c30-8ffd-5f38f26b6a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:15.849783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9c68b-4c9e-4c30-8ffd-5f38f26b6a5d None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:15.850181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9c68b-4c9e-4c30-8ffd-5f38f26b6a5d None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:15.850501 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9c68b-4c9e-4c30-8ffd-5f38f26b6a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:15.853223 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 326/650] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:34:15 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:15.860707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34e984-0ec5-44b8-a0a2-ab20069f048d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:15.870195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9c68b-4c9e-4c30-8ffd-5f38f26b6a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:15.871799 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9c68b-4c9e-4c30-8ffd-5f38f26b6a5d None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:15.893597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-cbe9c68b-4c9e-4c30-8ffd-5f38f26b6a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:15.893597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:15.893597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:15.893597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:15.893597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:15.893597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:15.893597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:15.893597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:15.893597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:15.893597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:15.893597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:15.893597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:15.893597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:15.893597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:15.893597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:15.901108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:15.902283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:15.902283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:15.902283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:15.902283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:15.902283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 325/651] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:15.902283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9c68b-4c9e-4c30-8ffd-5f38f26b6a5d None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:16.047902 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34e984-0ec5-44b8-a0a2-ab20069f048d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:16.072682 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9c68b-4c9e-4c30-8ffd-5f38f26b6a5d None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:16.097787 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56391a6-6102-4d05-b543-29eb722a74c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:16.098784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56391a6-6102-4d05-b543-29eb722a74c8 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:16.099241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56391a6-6102-4d05-b543-29eb722a74c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:16.099653 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56391a6-6102-4d05-b543-29eb722a74c8 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:16.100591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56391a6-6102-4d05-b543-29eb722a74c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:16.101119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56391a6-6102-4d05-b543-29eb722a74c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:16.102728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56391a6-6102-4d05-b543-29eb722a74c8 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:16.115811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 327/652] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:16.117032 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56391a6-6102-4d05-b543-29eb722a74c8 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:16.144360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a5185-4661-444b-8c1c-007bf75e8719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:16.145146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a5185-4661-444b-8c1c-007bf75e8719 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:16.145513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a5185-4661-444b-8c1c-007bf75e8719 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:16.145941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a5185-4661-444b-8c1c-007bf75e8719 None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:16.147113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a5185-4661-444b-8c1c-007bf75e8719 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:16.148077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a5185-4661-444b-8c1c-007bf75e8719 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:16.149740 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a5185-4661-444b-8c1c-007bf75e8719 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:16.163381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 326/653] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:16.164250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a5185-4661-444b-8c1c-007bf75e8719 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:16.192672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:16.223359 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:16.269660 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56391a6-6102-4d05-b543-29eb722a74c8 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:16.294110 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a5185-4661-444b-8c1c-007bf75e8719 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:16.326763 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59be413-49c2-4a01-aa3e-55c71e1618c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:16.328027 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59be413-49c2-4a01-aa3e-55c71e1618c4 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:16.328492 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59be413-49c2-4a01-aa3e-55c71e1618c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:16.328985 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59be413-49c2-4a01-aa3e-55c71e1618c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:16.357016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59be413-49c2-4a01-aa3e-55c71e1618c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:16.358533 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59be413-49c2-4a01-aa3e-55c71e1618c4 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:16.363535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c3685-11e5-4504-b530-db859b8491f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:16.364663 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c3685-11e5-4504-b530-db859b8491f4 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:16.365164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c3685-11e5-4504-b530-db859b8491f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:16.365656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c3685-11e5-4504-b530-db859b8491f4 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:16.367161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c3685-11e5-4504-b530-db859b8491f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:16.367738 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c3685-11e5-4504-b530-db859b8491f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:16.370439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c3685-11e5-4504-b530-db859b8491f4 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:16.379304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-d59be413-49c2-4a01-aa3e-55c71e1618c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:16.379304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:16.379304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:16.379304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:16.379304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:16.379304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:16.379304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:16.379304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:16.379304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:16.379304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:16.379304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:16.379304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:16.379304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:16.379304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:16.379304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:16.380924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:16.381967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:16.381967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:16.381967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:16.381967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:16.381967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 328/654] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:16.381967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9acc4a-5e24-4bb1-8ec9-5c73ed228230 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:16.382368 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9acc4a-5e24-4bb1-8ec9-5c73ed228230 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:16.382675 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9acc4a-5e24-4bb1-8ec9-5c73ed228230 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:16.384596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 329/655] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:16.385348 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9acc4a-5e24-4bb1-8ec9-5c73ed228230 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:16.394921 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 327/656] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:16.396725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c3685-11e5-4504-b530-db859b8491f4 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:16.527060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c3685-11e5-4504-b530-db859b8491f4 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:16.528905 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:16.538845 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:16.544556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9acc4a-5e24-4bb1-8ec9-5c73ed228230 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:16.589938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a1eb9-7fb7-46d7-9840-0b4b91af346b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:16.591129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a1eb9-7fb7-46d7-9840-0b4b91af346b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:16.591623 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a1eb9-7fb7-46d7-9840-0b4b91af346b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:16.592111 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a1eb9-7fb7-46d7-9840-0b4b91af346b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:16.593332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36988429-1372-4fd2-940c-8d92b6cc983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:16.593677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a1eb9-7fb7-46d7-9840-0b4b91af346b None admin] RBAC: Adding query filter params (role.id=64acd9118f3d4931be8ca4bfa4ae907e, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=5f2ec4c76f8f4d858bce53f30cc198fa) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:16.594230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a1eb9-7fb7-46d7-9840-0b4b91af346b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:16.594431 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36988429-1372-4fd2-940c-8d92b6cc983c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:16.594680 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36988429-1372-4fd2-940c-8d92b6cc983c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:16.594954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36988429-1372-4fd2-940c-8d92b6cc983c None admin] PATH_INFO: `/v3/users/glance` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:16.596944 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a1eb9-7fb7-46d7-9840-0b4b91af346b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:16.604630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36988429-1372-4fd2-940c-8d92b6cc983c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:16.606525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36988429-1372-4fd2-940c-8d92b6cc983c None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:16.619145 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 328/657] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:16 2022] GET /identity/v3/role_assignments?user.id=5f2ec4c76f8f4d858bce53f30cc198fa&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=64acd9118f3d4931be8ca4bfa4ae907e => generated 610 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:16.619145 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a1eb9-7fb7-46d7-9840-0b4b91af346b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-36988429-1372-4fd2-940c-8d92b6cc983c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:16.633618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:16.634947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:16.636377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:16.636377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:16.636377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:16.636377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:16.636377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:16.636377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:16.636377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:16.636377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:16.636377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 16:34:16.636377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:16.636377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 330/658] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:34:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:16.637952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557044b-5c79-419b-82cd-f64cb5b973fb None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:16.638209 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557044b-5c79-419b-82cd-f64cb5b973fb None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:16.638587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557044b-5c79-419b-82cd-f64cb5b973fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:16.666430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-0557044b-5c79-419b-82cd-f64cb5b973fb None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:16.668286 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0557044b-5c79-419b-82cd-f64cb5b973fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:16.791348 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 331/659] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:16.793363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557044b-5c79-419b-82cd-f64cb5b973fb None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:16.821963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a1eb9-7fb7-46d7-9840-0b4b91af346b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:16.878531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad69bf-284a-43d2-bf0e-f9c0ec52115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:16.879539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad69bf-284a-43d2-bf0e-f9c0ec52115f None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:16.880694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad69bf-284a-43d2-bf0e-f9c0ec52115f None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:16.881097 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad69bf-284a-43d2-bf0e-f9c0ec52115f None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:16.883364 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad69bf-284a-43d2-bf0e-f9c0ec52115f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:16.884429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad69bf-284a-43d2-bf0e-f9c0ec52115f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:16.886305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad69bf-284a-43d2-bf0e-f9c0ec52115f None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:16.907298 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 329/660] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:16.908782 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad69bf-284a-43d2-bf0e-f9c0ec52115f None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:16.958800 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:16.969077 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:16.989899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557044b-5c79-419b-82cd-f64cb5b973fb None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:17.042957 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19cb3e-b090-4e92-896b-5dfb04c6617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:17.044254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19cb3e-b090-4e92-896b-5dfb04c6617a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:17.044254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19cb3e-b090-4e92-896b-5dfb04c6617a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:17.044662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19cb3e-b090-4e92-896b-5dfb04c6617a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:17.052160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19cb3e-b090-4e92-896b-5dfb04c6617a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:17.054220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19cb3e-b090-4e92-896b-5dfb04c6617a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:17.071596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-8d19cb3e-b090-4e92-896b-5dfb04c6617a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:17.071596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:17.071596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:17.071596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:17.071596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:17.071596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:17.071596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:17.071596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:17.071596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:17.071596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:17.071596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:17.071596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:17.071596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:17.071596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:17.071596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:17.072621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:17.073586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:17.073586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:17.073586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:17.073586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:17.073586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:17.073586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:17.073586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:17.073586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:17.073586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 332/661] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:17.074101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19cb3e-b090-4e92-896b-5dfb04c6617a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:17.083550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad69bf-284a-43d2-bf0e-f9c0ec52115f None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:17.134708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acd0e2-4d08-4ffc-841d-09db4013dea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:17.135521 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acd0e2-4d08-4ffc-841d-09db4013dea3 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:17.136216 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acd0e2-4d08-4ffc-841d-09db4013dea3 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:17.136915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acd0e2-4d08-4ffc-841d-09db4013dea3 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:17.138241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acd0e2-4d08-4ffc-841d-09db4013dea3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:17.138585 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acd0e2-4d08-4ffc-841d-09db4013dea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:17.140347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acd0e2-4d08-4ffc-841d-09db4013dea3 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:17.173532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 330/662] 10.222.0.112 () {56 vars in 1142 bytes} [Thu May 26 16:34:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:17.174904 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acd0e2-4d08-4ffc-841d-09db4013dea3 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:17.221210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19cb3e-b090-4e92-896b-5dfb04c6617a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:17.268219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23835ad-fe48-49a9-a048-21bb7bce595d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:17.269130 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23835ad-fe48-49a9-a048-21bb7bce595d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:17.269417 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23835ad-fe48-49a9-a048-21bb7bce595d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:17.269694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23835ad-fe48-49a9-a048-21bb7bce595d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:17.284961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23835ad-fe48-49a9-a048-21bb7bce595d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-c23835ad-fe48-49a9-a048-21bb7bce595d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:17.293890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:17.295035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:17.296021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:17.296021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:17.296021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:17.296021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:17.296021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:17.296021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:17.296021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:17.296021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:17.296021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:17.296021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:17.296021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:17.296021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:17.296021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 333/663] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:17.296743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23835ad-fe48-49a9-a048-21bb7bce595d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:17.345971 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acd0e2-4d08-4ffc-841d-09db4013dea3 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:17.397979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bccf51-4673-48c1-961c-842694ba0c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:17.399959 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bccf51-4673-48c1-961c-842694ba0c7a None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:17.401313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bccf51-4673-48c1-961c-842694ba0c7a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:17.402171 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bccf51-4673-48c1-961c-842694ba0c7a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:17.407463 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:17.413870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bccf51-4673-48c1-961c-842694ba0c7a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:17.420930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bccf51-4673-48c1-961c-842694ba0c7a None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-03bccf51-4673-48c1-961c-842694ba0c7a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:17.432142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:17.433189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:17.434197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:17.434197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:17.434197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:17.434197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:17.434197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:17.434197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:17.434197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:17.434197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:17.434197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:34:17.434197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:17.438135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 331/664] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:17.438367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23835ad-fe48-49a9-a048-21bb7bce595d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:17.439019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bccf51-4673-48c1-961c-842694ba0c7a None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:17.462102 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:17.487144 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b0c51-4957-460d-9aa8-c7e394776876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:17.488235 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b0c51-4957-460d-9aa8-c7e394776876 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:17.488717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b0c51-4957-460d-9aa8-c7e394776876 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:17.489193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b0c51-4957-460d-9aa8-c7e394776876 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:17.490615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b0c51-4957-460d-9aa8-c7e394776876 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:17.491713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b0c51-4957-460d-9aa8-c7e394776876 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:17.494280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b0c51-4957-460d-9aa8-c7e394776876 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:17.513372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 334/665] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:17.514590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b0c51-4957-460d-9aa8-c7e394776876 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:17.590259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bccf51-4673-48c1-961c-842694ba0c7a None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:17.597754 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:17.638771 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57acaf-4358-4d1e-a232-7855743f5954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:17.639573 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57acaf-4358-4d1e-a232-7855743f5954 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:17.639858 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57acaf-4358-4d1e-a232-7855743f5954 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:17.640139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57acaf-4358-4d1e-a232-7855743f5954 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:17.641921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b0c51-4957-460d-9aa8-c7e394776876 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:17.661831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:17.687044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f0ce3-9c38-48e3-a574-66a0e89bbf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:17.691321 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f0ce3-9c38-48e3-a574-66a0e89bbf70 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:17.691321 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f0ce3-9c38-48e3-a574-66a0e89bbf70 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:17.691321 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f0ce3-9c38-48e3-a574-66a0e89bbf70 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:17.691321 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f0ce3-9c38-48e3-a574-66a0e89bbf70 None admin] RBAC: Adding query filter params (name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:17.691321 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f0ce3-9c38-48e3-a574-66a0e89bbf70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:17.691321 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f0ce3-9c38-48e3-a574-66a0e89bbf70 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:17.706853 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 335/666] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:34:17 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:17.707761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f0ce3-9c38-48e3-a574-66a0e89bbf70 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:17.752099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57acaf-4358-4d1e-a232-7855743f5954 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:17.754750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57acaf-4358-4d1e-a232-7855743f5954 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:17.861213 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f0ce3-9c38-48e3-a574-66a0e89bbf70 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:17.886226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 332/667] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:34:17 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:34:17.887441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57acaf-4358-4d1e-a232-7855743f5954 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:17.898454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:17.905640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07978c-a657-44b2-ba8b-949239010e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:17.914549 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07978c-a657-44b2-ba8b-949239010e88 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:17.914549 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07978c-a657-44b2-ba8b-949239010e88 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:17.914549 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07978c-a657-44b2-ba8b-949239010e88 None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:17.914549 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07978c-a657-44b2-ba8b-949239010e88 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:17.914549 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07978c-a657-44b2-ba8b-949239010e88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:17.914549 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07978c-a657-44b2-ba8b-949239010e88 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:17.942832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 336/668] 10.222.0.112 () {56 vars in 1144 bytes} [Thu May 26 16:34:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:17.944406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07978c-a657-44b2-ba8b-949239010e88 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:17.970711 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:18.058371 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57acaf-4358-4d1e-a232-7855743f5954 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:18.107022 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe46c01-d3f5-4a1d-b70a-8e8491db64fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:18.107854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe46c01-d3f5-4a1d-b70a-8e8491db64fc None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:18.108332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe46c01-d3f5-4a1d-b70a-8e8491db64fc None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:18.108915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe46c01-d3f5-4a1d-b70a-8e8491db64fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:18.110092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe46c01-d3f5-4a1d-b70a-8e8491db64fc None admin] RBAC: Adding query filter params (role.id=64acd9118f3d4931be8ca4bfa4ae907e, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=53822ebd38c94a729591cb270e0459ad) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:18.110514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe46c01-d3f5-4a1d-b70a-8e8491db64fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:18.112436 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe46c01-d3f5-4a1d-b70a-8e8491db64fc None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:18.117713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07978c-a657-44b2-ba8b-949239010e88 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:18.130370 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 333/669] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:17 2022] GET /identity/v3/role_assignments?user.id=53822ebd38c94a729591cb270e0459ad&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=64acd9118f3d4931be8ca4bfa4ae907e => generated 610 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:18.130370 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe46c01-d3f5-4a1d-b70a-8e8491db64fc None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:18.176373 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f157b-e2cd-46f0-89b5-b4e3005d5097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:18.177264 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f157b-e2cd-46f0-89b5-b4e3005d5097 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:18.177643 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f157b-e2cd-46f0-89b5-b4e3005d5097 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:18.178109 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f157b-e2cd-46f0-89b5-b4e3005d5097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:18.195101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f157b-e2cd-46f0-89b5-b4e3005d5097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:18.197250 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f157b-e2cd-46f0-89b5-b4e3005d5097 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:18.234148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-6a5f157b-e2cd-46f0-89b5-b4e3005d5097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:18.234148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:18.234148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:18.234148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:18.234148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:18.234148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:18.234148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:18.234148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:18.234148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:18.234148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:18.234148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:18.234148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:18.234148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:18.234148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:18.234148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:18.235947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:18.236941 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:18.236941 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:18.236941 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:18.236941 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:18.237324 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 337/670] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:18.239098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f157b-e2cd-46f0-89b5-b4e3005d5097 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:18.316213 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:18.323379 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe46c01-d3f5-4a1d-b70a-8e8491db64fc None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:18.337576 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:18.397945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487cbbd-5023-48e1-9220-a539ef0dc012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:18.399242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487cbbd-5023-48e1-9220-a539ef0dc012 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:18.399746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487cbbd-5023-48e1-9220-a539ef0dc012 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:18.400217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487cbbd-5023-48e1-9220-a539ef0dc012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:18.420495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487cbbd-5023-48e1-9220-a539ef0dc012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:18.421782 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487cbbd-5023-48e1-9220-a539ef0dc012 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:18.426643 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f157b-e2cd-46f0-89b5-b4e3005d5097 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:18.445356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-9487cbbd-5023-48e1-9220-a539ef0dc012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:18.445356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:18.445356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:18.445356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:18.445356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:18.445356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:18.445356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:18.445356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:18.445356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:18.445356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:18.445356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:18.445356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:18.445356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:18.445356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:18.445356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:18.446613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:18.447681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:18.447681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:18.447681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:18.447681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:18.448601 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 334/671] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:18.449666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487cbbd-5023-48e1-9220-a539ef0dc012 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:18.471228 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5d13c-0bf2-42c4-8d6b-202d347acc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:18.471888 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d13c-0bf2-42c4-8d6b-202d347acc03 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:18.472177 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d13c-0bf2-42c4-8d6b-202d347acc03 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:18.472455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d13c-0bf2-42c4-8d6b-202d347acc03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:18.577608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5d13c-0bf2-42c4-8d6b-202d347acc03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:18.579099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5d13c-0bf2-42c4-8d6b-202d347acc03 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:18.610217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487cbbd-5023-48e1-9220-a539ef0dc012 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:18.635530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:18.659831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8d4dc-85c4-4e1d-a9c3-003928bf53d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:18.662244 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8d4dc-85c4-4e1d-a9c3-003928bf53d4 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:18.663700 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8d4dc-85c4-4e1d-a9c3-003928bf53d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:18.664414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8d4dc-85c4-4e1d-a9c3-003928bf53d4 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:18.666254 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8d4dc-85c4-4e1d-a9c3-003928bf53d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:18.667906 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8d4dc-85c4-4e1d-a9c3-003928bf53d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:18.670837 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8d4dc-85c4-4e1d-a9c3-003928bf53d4 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:18.697403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 335/672] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:18.698877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8d4dc-85c4-4e1d-a9c3-003928bf53d4 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:18.727545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 338/673] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:34:18 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:34:18.729526 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5d13c-0bf2-42c4-8d6b-202d347acc03 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:18.736186 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:18.830702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8d4dc-85c4-4e1d-a9c3-003928bf53d4 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:18.844059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5d13c-0bf2-42c4-8d6b-202d347acc03 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:18.872815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709322c-d8c4-4177-bd40-5fc88bd25c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:18.873578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709322c-d8c4-4177-bd40-5fc88bd25c0a None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:18.873952 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709322c-d8c4-4177-bd40-5fc88bd25c0a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:18.874313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709322c-d8c4-4177-bd40-5fc88bd25c0a None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:18.875356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709322c-d8c4-4177-bd40-5fc88bd25c0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:18.875747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709322c-d8c4-4177-bd40-5fc88bd25c0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:18.877365 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709322c-d8c4-4177-bd40-5fc88bd25c0a None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:18.891869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 336/674] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:18.892895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709322c-d8c4-4177-bd40-5fc88bd25c0a None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:18.894580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723cdc6-fe5d-402b-b81e-016138b6aa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:18.895635 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723cdc6-fe5d-402b-b81e-016138b6aa25 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:18.896162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723cdc6-fe5d-402b-b81e-016138b6aa25 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:18.896656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723cdc6-fe5d-402b-b81e-016138b6aa25 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:18.905968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723cdc6-fe5d-402b-b81e-016138b6aa25 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:18.907895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723cdc6-fe5d-402b-b81e-016138b6aa25 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-4723cdc6-fe5d-402b-b81e-016138b6aa25 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:18.924488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:18.925612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:18.926594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:18.926594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:18.926594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:18.926594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:18.926594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:18.926594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:18.926594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:18.926594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:18.926594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:34:18.926594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:18.929487 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 339/675] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:34:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:18.930572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723cdc6-fe5d-402b-b81e-016138b6aa25 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:18.933915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:19.000650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:19.028290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709322c-d8c4-4177-bd40-5fc88bd25c0a None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:19.049737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723cdc6-fe5d-402b-b81e-016138b6aa25 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:19.075259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4476a-7138-48f6-a151-2a8a850ee51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:19.076893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4476a-7138-48f6-a151-2a8a850ee51d None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:19.077922 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4476a-7138-48f6-a151-2a8a850ee51d None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:19.078669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4476a-7138-48f6-a151-2a8a850ee51d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:19.090863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20282b63-6b94-4eca-b96c-f9cadafee938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:19.092224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20282b63-6b94-4eca-b96c-f9cadafee938 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:19.092224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20282b63-6b94-4eca-b96c-f9cadafee938 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:19.092512 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20282b63-6b94-4eca-b96c-f9cadafee938 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:19.095340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4476a-7138-48f6-a151-2a8a850ee51d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:19.098289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4476a-7138-48f6-a151-2a8a850ee51d None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:19.102168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20282b63-6b94-4eca-b96c-f9cadafee938 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:19.104288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20282b63-6b94-4eca-b96c-f9cadafee938 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:19.126208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-6ab4476a-7138-48f6-a151-2a8a850ee51d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:19.126208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:19.126208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:19.126208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:19.126208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:19.126208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:19.126208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:19.126208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:19.126208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:19.126208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:19.126208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:19.126208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:19.126208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:19.126208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:19.126208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:19.127299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:19.128539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:19.128539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:19.128539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:19.128539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:19.128773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-20282b63-6b94-4eca-b96c-f9cadafee938 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:19.128773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:19.128773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:19.128773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:19.128773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:19.128773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:19.128773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:19.128773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:19.128773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:19.128773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:19.128773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:19.128773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:19.128773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:19.128773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:19.128773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:19.130669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:19.134302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:19.134302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:19.134302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:19.134302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:19.134302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:19.134302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:19.134302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:19.134302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:19.134302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 340/676] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:19.134302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20282b63-6b94-4eca-b96c-f9cadafee938 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:19.143729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 337/677] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:19.145386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4476a-7138-48f6-a151-2a8a850ee51d None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:19.218087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:19.266934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20282b63-6b94-4eca-b96c-f9cadafee938 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:19.267807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4476a-7138-48f6-a151-2a8a850ee51d None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:19.307102 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad27c85-1d57-4cfd-ba9a-65dbd5066c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:19.307787 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad27c85-1d57-4cfd-ba9a-65dbd5066c6a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:19.308096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad27c85-1d57-4cfd-ba9a-65dbd5066c6a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:19.308371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad27c85-1d57-4cfd-ba9a-65dbd5066c6a None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:19.308507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:19.309268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad27c85-1d57-4cfd-ba9a-65dbd5066c6a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:19.309520 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad27c85-1d57-4cfd-ba9a-65dbd5066c6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:19.311012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad27c85-1d57-4cfd-ba9a-65dbd5066c6a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:19.315580 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145d754-581f-4785-a2ea-b0d404baf4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:19.316542 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145d754-581f-4785-a2ea-b0d404baf4a7 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:19.316939 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145d754-581f-4785-a2ea-b0d404baf4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:19.317340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145d754-581f-4785-a2ea-b0d404baf4a7 None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:19.323172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145d754-581f-4785-a2ea-b0d404baf4a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:19.323172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145d754-581f-4785-a2ea-b0d404baf4a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:19.323172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145d754-581f-4785-a2ea-b0d404baf4a7 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:19.339224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 341/678] 10.222.0.112 () {56 vars in 1140 bytes} [Thu May 26 16:34:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:19.339224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad27c85-1d57-4cfd-ba9a-65dbd5066c6a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:19.345093 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 338/679] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:19.348181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49de23-19fc-4893-9f28-9b945da319b1 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:19.348688 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49de23-19fc-4893-9f28-9b945da319b1 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:19.349217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49de23-19fc-4893-9f28-9b945da319b1 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:19.351943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 339/680] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:19 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:19.352885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49de23-19fc-4893-9f28-9b945da319b1 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:19.472711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad27c85-1d57-4cfd-ba9a-65dbd5066c6a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:19.500484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:19.504482 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49de23-19fc-4893-9f28-9b945da319b1 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:19.513606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc189a0-7ea7-46bd-8311-021ae91cd478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:19.515709 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc189a0-7ea7-46bd-8311-021ae91cd478 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:19.515709 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc189a0-7ea7-46bd-8311-021ae91cd478 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:19.515709 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc189a0-7ea7-46bd-8311-021ae91cd478 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:19.515709 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc189a0-7ea7-46bd-8311-021ae91cd478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:19.516064 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc189a0-7ea7-46bd-8311-021ae91cd478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:19.517418 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc189a0-7ea7-46bd-8311-021ae91cd478 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:19.544186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 342/681] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:19.545582 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc189a0-7ea7-46bd-8311-021ae91cd478 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:19.551473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68381b-5533-4a41-891d-0b87f92db27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:19.552165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68381b-5533-4a41-891d-0b87f92db27e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:19.552458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68381b-5533-4a41-891d-0b87f92db27e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:19.552740 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68381b-5533-4a41-891d-0b87f92db27e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:19.629566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:19.641152 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68381b-5533-4a41-891d-0b87f92db27e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:19.653296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68381b-5533-4a41-891d-0b87f92db27e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:19.682408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc189a0-7ea7-46bd-8311-021ae91cd478 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:19.727434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efece89-47ed-4e54-9482-b3ce404b292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:19.728502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efece89-47ed-4e54-9482-b3ce404b292d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:19.728969 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efece89-47ed-4e54-9482-b3ce404b292d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:19.729429 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efece89-47ed-4e54-9482-b3ce404b292d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:19.730525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efece89-47ed-4e54-9482-b3ce404b292d None admin] RBAC: Adding query filter params (role.id=64acd9118f3d4931be8ca4bfa4ae907e, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=adf32c811ead4fd0b69c83890a56509d) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:19.731025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efece89-47ed-4e54-9482-b3ce404b292d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:19.732959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efece89-47ed-4e54-9482-b3ce404b292d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:19.742068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 343/682] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:19 2022] GET /identity/v3/role_assignments?user.id=adf32c811ead4fd0b69c83890a56509d&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=64acd9118f3d4931be8ca4bfa4ae907e => generated 610 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:19.744498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c956a8-13f6-44c9-bb7a-9ace5732b977 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:19.745069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c956a8-13f6-44c9-bb7a-9ace5732b977 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:19.745649 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c956a8-13f6-44c9-bb7a-9ace5732b977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:19.782936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-70c956a8-13f6-44c9-bb7a-9ace5732b977 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:19.784668 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-70c956a8-13f6-44c9-bb7a-9ace5732b977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:19.789889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 340/683] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:34:19 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:34:19.791172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68381b-5533-4a41-891d-0b87f92db27e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:19.858955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:19.914363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 344/684] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:19.914363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c956a8-13f6-44c9-bb7a-9ace5732b977 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:19.926446 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:19.946471 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68381b-5533-4a41-891d-0b87f92db27e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:20.028608 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256ad2e-1b85-4238-af71-e5043a9df566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:20.029320 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256ad2e-1b85-4238-af71-e5043a9df566 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:20.029623 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256ad2e-1b85-4238-af71-e5043a9df566 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:20.029906 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256ad2e-1b85-4238-af71-e5043a9df566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:20.043339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256ad2e-1b85-4238-af71-e5043a9df566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:20.045692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256ad2e-1b85-4238-af71-e5043a9df566 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:20.059108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c956a8-13f6-44c9-bb7a-9ace5732b977 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:20.068465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-7256ad2e-1b85-4238-af71-e5043a9df566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:20.068465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:20.068465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:20.068465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:20.068465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:20.068465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:20.068465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:20.068465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:20.068465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:20.068465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:20.068465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:20.068465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:20.068465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:20.068465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:20.068465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:20.071101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:20.072069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:20.072069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:20.072069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:20.072069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:20.072069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:20.072069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:20.072069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:20.072069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:20.073032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 341/685] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:20.075605 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256ad2e-1b85-4238-af71-e5043a9df566 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:20.121097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4675e7-25e1-4b16-ad03-cc8d0336cf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:20.122096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4675e7-25e1-4b16-ad03-cc8d0336cf4b None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:20.122500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4675e7-25e1-4b16-ad03-cc8d0336cf4b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:20.122834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4675e7-25e1-4b16-ad03-cc8d0336cf4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:20.140190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4675e7-25e1-4b16-ad03-cc8d0336cf4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:20.142392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4675e7-25e1-4b16-ad03-cc8d0336cf4b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:20.170769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-9d4675e7-25e1-4b16-ad03-cc8d0336cf4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:20.170769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:20.170769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:20.170769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:20.170769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:20.170769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:20.170769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:20.170769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:20.170769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:20.170769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:20.170769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:20.170769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:20.170769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:20.170769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:20.170769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:20.172146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:20.173913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:20.173913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:20.173913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:20.173913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:20.178809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 345/686] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:20.181166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4675e7-25e1-4b16-ad03-cc8d0336cf4b None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:20.243650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:20.250515 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256ad2e-1b85-4238-af71-e5043a9df566 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:20.309800 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe149cc0-a8ce-453d-9371-462e747ae68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:20.310974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe149cc0-a8ce-453d-9371-462e747ae68b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:20.312030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe149cc0-a8ce-453d-9371-462e747ae68b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:20.312499 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe149cc0-a8ce-453d-9371-462e747ae68b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:20.328990 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe149cc0-a8ce-453d-9371-462e747ae68b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-fe149cc0-a8ce-453d-9371-462e747ae68b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:20.340702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:20.341684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:20.342615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:20.342615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:20.342615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:20.342615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:20.342615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:20.342615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:20.342615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:20.342615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:20.342615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:20.342615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:20.342615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:34:20.342615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:20.343299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4675e7-25e1-4b16-ad03-cc8d0336cf4b None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:20.346352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 342/687] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:34:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:20.347339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe149cc0-a8ce-453d-9371-462e747ae68b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:20.372175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:20.420679 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525ba10-0991-48ff-9e09-8a0f96efac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:20.421661 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525ba10-0991-48ff-9e09-8a0f96efac92 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:20.422202 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525ba10-0991-48ff-9e09-8a0f96efac92 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:20.422804 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525ba10-0991-48ff-9e09-8a0f96efac92 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:20.424601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525ba10-0991-48ff-9e09-8a0f96efac92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:20.425115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525ba10-0991-48ff-9e09-8a0f96efac92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:20.427129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525ba10-0991-48ff-9e09-8a0f96efac92 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:20.445732 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 346/688] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:20.447528 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525ba10-0991-48ff-9e09-8a0f96efac92 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:20.521936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe149cc0-a8ce-453d-9371-462e747ae68b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:20.588602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffce106-323d-42c9-828a-82963da36f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:20.589775 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffce106-323d-42c9-828a-82963da36f12 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:20.590566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffce106-323d-42c9-828a-82963da36f12 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:20.591193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffce106-323d-42c9-828a-82963da36f12 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:20.593464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffce106-323d-42c9-828a-82963da36f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:20.594082 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffce106-323d-42c9-828a-82963da36f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:20.595441 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:20.597147 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffce106-323d-42c9-828a-82963da36f12 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:20.620779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525ba10-0991-48ff-9e09-8a0f96efac92 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:20.623515 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 343/689] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:20.626271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffce106-323d-42c9-828a-82963da36f12 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:20.664440 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e3c1e-f072-46a2-a488-948ad878dc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:20.665437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e3c1e-f072-46a2-a488-948ad878dc5b None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:20.665772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e3c1e-f072-46a2-a488-948ad878dc5b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:20.666055 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e3c1e-f072-46a2-a488-948ad878dc5b None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:20.667080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e3c1e-f072-46a2-a488-948ad878dc5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:20.667449 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e3c1e-f072-46a2-a488-948ad878dc5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:20.668912 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e3c1e-f072-46a2-a488-948ad878dc5b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:20.679468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 347/690] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:34:20 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:20.680401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e3c1e-f072-46a2-a488-948ad878dc5b None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:20.737571 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:20.789165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffce106-323d-42c9-828a-82963da36f12 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:20.839570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e3c1e-f072-46a2-a488-948ad878dc5b None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:20.840110 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24144dc7-31cd-4bf7-b7a9-7c6fe6e71781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:20.840464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24144dc7-31cd-4bf7-b7a9-7c6fe6e71781 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:20.840750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24144dc7-31cd-4bf7-b7a9-7c6fe6e71781 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:20.841090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24144dc7-31cd-4bf7-b7a9-7c6fe6e71781 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:20.842537 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24144dc7-31cd-4bf7-b7a9-7c6fe6e71781 None admin] RBAC: Adding query filter params (role.id=64acd9118f3d4931be8ca4bfa4ae907e, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=0288901db0244eab9a737af460ce1bd0) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:20.842537 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24144dc7-31cd-4bf7-b7a9-7c6fe6e71781 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:20.843637 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24144dc7-31cd-4bf7-b7a9-7c6fe6e71781 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:20.858356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 344/691] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:20 2022] GET /identity/v3/role_assignments?user.id=0288901db0244eab9a737af460ce1bd0&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=64acd9118f3d4931be8ca4bfa4ae907e => generated 610 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:20.858356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24144dc7-31cd-4bf7-b7a9-7c6fe6e71781 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:20.901830 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe1105-6ad4-4981-9537-542e5c5b4ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:20.904155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe1105-6ad4-4981-9537-542e5c5b4ece None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:20.904694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe1105-6ad4-4981-9537-542e5c5b4ece None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:20.905222 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe1105-6ad4-4981-9537-542e5c5b4ece None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:20.920243 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe1105-6ad4-4981-9537-542e5c5b4ece None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:20.923518 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe1105-6ad4-4981-9537-542e5c5b4ece None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:20.958509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-4ffe1105-6ad4-4981-9537-542e5c5b4ece None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:20.958509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:20.958509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:20.958509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:20.958509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:20.958509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:20.958509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:20.958509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:20.958509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:20.958509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:20.958509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:20.958509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:20.958509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:20.958509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:20.958509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:20.961218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:20.963477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:20.963477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:20.963477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:20.963477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:20.963477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:20.963477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:20.963477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:20.963477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:20.963477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 348/692] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:20.970762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267dbd2-eeb8-485b-a790-ecf05f6266e4 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:20.970762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267dbd2-eeb8-485b-a790-ecf05f6266e4 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:20.970762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267dbd2-eeb8-485b-a790-ecf05f6266e4 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:20.970762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 349/693] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:20 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:20.980911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267dbd2-eeb8-485b-a790-ecf05f6266e4 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:20.995271 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:21.024224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24144dc7-31cd-4bf7-b7a9-7c6fe6e71781 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:21.075984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643b0f7-32ea-4dfe-a7e9-2084b0601e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:21.078573 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643b0f7-32ea-4dfe-a7e9-2084b0601e1c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:21.079137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643b0f7-32ea-4dfe-a7e9-2084b0601e1c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:21.079650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643b0f7-32ea-4dfe-a7e9-2084b0601e1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:21.086372 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:21.097078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643b0f7-32ea-4dfe-a7e9-2084b0601e1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:21.098528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643b0f7-32ea-4dfe-a7e9-2084b0601e1c None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:21.122735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-b643b0f7-32ea-4dfe-a7e9-2084b0601e1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:21.122735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:21.122735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:21.122735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:21.122735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:21.122735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:21.122735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:21.122735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:21.122735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:21.122735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:21.122735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:21.122735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:21.122735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:21.122735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:21.122735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:21.124381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:21.126089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:21.126089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:21.126089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:21.126089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:21.126089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 345/694] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:21.127272 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa651d1d-9da0-4904-b1d9-90ba87c5e70c None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:21.127272 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa651d1d-9da0-4904-b1d9-90ba87c5e70c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:21.127687 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa651d1d-9da0-4904-b1d9-90ba87c5e70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:21.152548 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-aa651d1d-9da0-4904-b1d9-90ba87c5e70c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:21.153994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-aa651d1d-9da0-4904-b1d9-90ba87c5e70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:21.212404 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267dbd2-eeb8-485b-a790-ecf05f6266e4 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:21.262126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038c6a5-1e3b-4054-bd6a-799e95d009ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:21.263098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038c6a5-1e3b-4054-bd6a-799e95d009ac None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:21.263387 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038c6a5-1e3b-4054-bd6a-799e95d009ac None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:21.263664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038c6a5-1e3b-4054-bd6a-799e95d009ac None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:21.265267 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038c6a5-1e3b-4054-bd6a-799e95d009ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:21.265626 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038c6a5-1e3b-4054-bd6a-799e95d009ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:21.267843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038c6a5-1e3b-4054-bd6a-799e95d009ac None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:21.276019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 346/695] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:21.276981 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa651d1d-9da0-4904-b1d9-90ba87c5e70c None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:21.283727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 350/696] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:21.290478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038c6a5-1e3b-4054-bd6a-799e95d009ac None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:21.402640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:21.451266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa651d1d-9da0-4904-b1d9-90ba87c5e70c None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:21.453182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038c6a5-1e3b-4054-bd6a-799e95d009ac None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:21.478487 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:21.499864 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bb3d2-39d3-4cc8-bab9-9a7bd2416546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:21.500530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bb3d2-39d3-4cc8-bab9-9a7bd2416546 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:21.500818 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bb3d2-39d3-4cc8-bab9-9a7bd2416546 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:21.501093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bb3d2-39d3-4cc8-bab9-9a7bd2416546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:21.501929 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bb3d2-39d3-4cc8-bab9-9a7bd2416546 None admin] RBAC: Adding query filter params (role.id=64acd9118f3d4931be8ca4bfa4ae907e, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=465b269fc6ee415b8f5715843468d089) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:21.502240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bb3d2-39d3-4cc8-bab9-9a7bd2416546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:21.502548 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842bf8d-65b1-4283-9c8b-7b416b51f829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:21.503377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842bf8d-65b1-4283-9c8b-7b416b51f829 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:21.503724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bb3d2-39d3-4cc8-bab9-9a7bd2416546 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:21.503987 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842bf8d-65b1-4283-9c8b-7b416b51f829 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:21.504407 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842bf8d-65b1-4283-9c8b-7b416b51f829 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:21.505280 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842bf8d-65b1-4283-9c8b-7b416b51f829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:21.505875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842bf8d-65b1-4283-9c8b-7b416b51f829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:21.507813 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842bf8d-65b1-4283-9c8b-7b416b51f829 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:21.510908 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 351/697] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:21 2022] GET /identity/v3/role_assignments?user.id=465b269fc6ee415b8f5715843468d089&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=64acd9118f3d4931be8ca4bfa4ae907e => generated 610 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:21.511827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bb3d2-39d3-4cc8-bab9-9a7bd2416546 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:21.521669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 347/698] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:21.532508 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842bf8d-65b1-4283-9c8b-7b416b51f829 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:21.657036 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bb3d2-39d3-4cc8-bab9-9a7bd2416546 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:21.703818 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:21.707109 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5b442-577e-4cd4-9c0d-01a1b4c9438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:21.708016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5b442-577e-4cd4-9c0d-01a1b4c9438a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:21.708307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5b442-577e-4cd4-9c0d-01a1b4c9438a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:21.708587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5b442-577e-4cd4-9c0d-01a1b4c9438a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:21.709291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5b442-577e-4cd4-9c0d-01a1b4c9438a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:21.711281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5b442-577e-4cd4-9c0d-01a1b4c9438a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-89b5b442-577e-4cd4-9c0d-01a1b4c9438a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:21.736061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:21.737265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:21.738224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 352/699] 10.222.0.112 () {56 vars in 1134 bytes} [Thu May 26 16:34:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:21.751847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5b442-577e-4cd4-9c0d-01a1b4c9438a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:21.777491 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842bf8d-65b1-4283-9c8b-7b416b51f829 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:21.829535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58c6ea-3bb4-4452-b038-acf9c8872dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:21.830876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58c6ea-3bb4-4452-b038-acf9c8872dea None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:21.831171 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58c6ea-3bb4-4452-b038-acf9c8872dea None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:21.831585 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58c6ea-3bb4-4452-b038-acf9c8872dea None admin] PATH_INFO: `/v3/users/nova` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:21.843472 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58c6ea-3bb4-4452-b038-acf9c8872dea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:21.845827 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58c6ea-3bb4-4452-b038-acf9c8872dea None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-6e58c6ea-3bb4-4452-b038-acf9c8872dea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:21.867167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:21.868181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:21.869123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:21.869123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:21.869123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:21.869123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:21.869123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:21.869123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:21.869123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:21.869123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:21.869123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:34:21.869123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:21.870670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 348/700] 10.222.0.112 () {56 vars in 1098 bytes} [Thu May 26 16:34:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:21.884865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58c6ea-3bb4-4452-b038-acf9c8872dea None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:21.905730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5b442-577e-4cd4-9c0d-01a1b4c9438a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:21.946789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:21.982730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ab63f-cb0a-4beb-b277-3da346380436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:21.991583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ab63f-cb0a-4beb-b277-3da346380436 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:21.991583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ab63f-cb0a-4beb-b277-3da346380436 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:21.991583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ab63f-cb0a-4beb-b277-3da346380436 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:21.991583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ab63f-cb0a-4beb-b277-3da346380436 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:21.991583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ab63f-cb0a-4beb-b277-3da346380436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:21.991583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ab63f-cb0a-4beb-b277-3da346380436 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:21.996168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 353/701] 10.222.0.112 () {56 vars in 1129 bytes} [Thu May 26 16:34:21 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:22.003408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ab63f-cb0a-4beb-b277-3da346380436 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:22.045732 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58c6ea-3bb4-4452-b038-acf9c8872dea None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:22.083032 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:22.096653 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c58b29-ddf7-4550-be7a-5e9b54c3cd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:22.097393 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c58b29-ddf7-4550-be7a-5e9b54c3cd99 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:22.097679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c58b29-ddf7-4550-be7a-5e9b54c3cd99 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:22.097958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c58b29-ddf7-4550-be7a-5e9b54c3cd99 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:22.098868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c58b29-ddf7-4550-be7a-5e9b54c3cd99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:22.099175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c58b29-ddf7-4550-be7a-5e9b54c3cd99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:22.101180 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c58b29-ddf7-4550-be7a-5e9b54c3cd99 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:22.133530 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 349/702] 10.222.0.112 () {56 vars in 1138 bytes} [Thu May 26 16:34:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:22.139987 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c58b29-ddf7-4550-be7a-5e9b54c3cd99 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:22.184089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ab63f-cb0a-4beb-b277-3da346380436 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:22.266423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1358e-b151-4f25-a04c-8a415dd72fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:22.267107 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1358e-b151-4f25-a04c-8a415dd72fd4 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:22.267394 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1358e-b151-4f25-a04c-8a415dd72fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:22.267674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1358e-b151-4f25-a04c-8a415dd72fd4 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:22.268392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1358e-b151-4f25-a04c-8a415dd72fd4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:22.268697 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1358e-b151-4f25-a04c-8a415dd72fd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:22.270104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1358e-b151-4f25-a04c-8a415dd72fd4 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:22.285043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 354/703] 10.222.0.112 () {56 vars in 1129 bytes} [Thu May 26 16:34:22 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:22.339469 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:22.345761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c58b29-ddf7-4550-be7a-5e9b54c3cd99 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:22.389113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be745e03-38c3-41c6-82a3-20ab68c2b7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:22.389795 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be745e03-38c3-41c6-82a3-20ab68c2b7e5 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:22.390080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be745e03-38c3-41c6-82a3-20ab68c2b7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:22.390390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be745e03-38c3-41c6-82a3-20ab68c2b7e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:22.486789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be745e03-38c3-41c6-82a3-20ab68c2b7e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:22.488211 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be745e03-38c3-41c6-82a3-20ab68c2b7e5 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:22.607967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98249e1-94fe-4084-a377-703f04a8335b None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:22.608381 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98249e1-94fe-4084-a377-703f04a8335b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:22.608594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98249e1-94fe-4084-a377-703f04a8335b None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:22.609899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 355/704] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:34:22.611422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:22.616304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e891dd6-3f6e-438c-8c4c-87fabef0f706 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:22.616597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e891dd6-3f6e-438c-8c4c-87fabef0f706 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:22.616965 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e891dd6-3f6e-438c-8c4c-87fabef0f706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:22.621181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 350/705] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:34:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:34:22.634101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be745e03-38c3-41c6-82a3-20ab68c2b7e5 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:22.658826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-0e891dd6-3f6e-438c-8c4c-87fabef0f706 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:22.661072 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0e891dd6-3f6e-438c-8c4c-87fabef0f706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:22.769889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be745e03-38c3-41c6-82a3-20ab68c2b7e5 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:22.815495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8dfb3-52a4-4430-b15c-29c6e925b7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:22.816819 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8dfb3-52a4-4430-b15c-29c6e925b7de None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:22.817335 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8dfb3-52a4-4430-b15c-29c6e925b7de None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:22.817845 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8dfb3-52a4-4430-b15c-29c6e925b7de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:22.837947 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8dfb3-52a4-4430-b15c-29c6e925b7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:22.839999 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8dfb3-52a4-4430-b15c-29c6e925b7de None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:22.851421 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 356/706] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:22.859500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-13b8dfb3-52a4-4430-b15c-29c6e925b7de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:22.859500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:22.859500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:22.859500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:22.859500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:22.859500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:22.859500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:22.859500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:22.859500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:22.859500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:22.859500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:22.859500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:22.859500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:22.859500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:22.859500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:22.861279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:22.862524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:22.862524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:22.862524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:22.862524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:22.863589 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 351/707] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:22.869458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e891dd6-3f6e-438c-8c4c-87fabef0f706 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:22.881930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8dfb3-52a4-4430-b15c-29c6e925b7de None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:23.031015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:23.095297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:23.122434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e891dd6-3f6e-438c-8c4c-87fabef0f706 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:23.156267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8dfb3-52a4-4430-b15c-29c6e925b7de None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:23.201973 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f692b5-2670-4bce-823a-6757769fdf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:23.203165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f692b5-2670-4bce-823a-6757769fdf84 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:23.203549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f692b5-2670-4bce-823a-6757769fdf84 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:23.203931 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f692b5-2670-4bce-823a-6757769fdf84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:23.223680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f692b5-2670-4bce-823a-6757769fdf84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:23.226881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f692b5-2670-4bce-823a-6757769fdf84 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:23.241055 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01798ec5-b571-45a3-9ae4-0b7a1e6c5829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:23.242228 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01798ec5-b571-45a3-9ae4-0b7a1e6c5829 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:23.242779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01798ec5-b571-45a3-9ae4-0b7a1e6c5829 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:23.243283 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01798ec5-b571-45a3-9ae4-0b7a1e6c5829 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:23.244701 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01798ec5-b571-45a3-9ae4-0b7a1e6c5829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:23.245150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01798ec5-b571-45a3-9ae4-0b7a1e6c5829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:23.253277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-50f692b5-2670-4bce-823a-6757769fdf84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:23.253277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:23.253277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:23.253277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:23.253277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:23.253277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:23.253277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:23.253277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:23.253277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:23.253277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:23.253277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:23.253277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:23.253277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:23.253277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:23.253277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:23.254362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:23.255702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:23.255702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:23.255702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:23.255702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:23.255702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 352/708] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:23.259148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01798ec5-b571-45a3-9ae4-0b7a1e6c5829 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:23.262901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f692b5-2670-4bce-823a-6757769fdf84 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:23.296819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 357/709] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:23.304544 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01798ec5-b571-45a3-9ae4-0b7a1e6c5829 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:23.392194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f692b5-2670-4bce-823a-6757769fdf84 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:23.406114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:23.448358 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bbc94-ba70-47dc-9d78-f64524064183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:23.449570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bbc94-ba70-47dc-9d78-f64524064183 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:23.450005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bbc94-ba70-47dc-9d78-f64524064183 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:23.450504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bbc94-ba70-47dc-9d78-f64524064183 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:23.451861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bbc94-ba70-47dc-9d78-f64524064183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:23.452521 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bbc94-ba70-47dc-9d78-f64524064183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:23.454290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bbc94-ba70-47dc-9d78-f64524064183 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:23.475700 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 353/710] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:23.482139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bbc94-ba70-47dc-9d78-f64524064183 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:23.605892 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bbc94-ba70-47dc-9d78-f64524064183 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:23.661416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721a77b-4219-4c38-a7b3-0e69d5db3457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:23.662117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721a77b-4219-4c38-a7b3-0e69d5db3457 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:23.663117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721a77b-4219-4c38-a7b3-0e69d5db3457 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:23.663522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721a77b-4219-4c38-a7b3-0e69d5db3457 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:23.664292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721a77b-4219-4c38-a7b3-0e69d5db3457 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:23.665775 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721a77b-4219-4c38-a7b3-0e69d5db3457 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:23.703861 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01798ec5-b571-45a3-9ae4-0b7a1e6c5829 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:23.723125 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:23.745587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad81fcb-55b7-445c-be38-e58e69403cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:23.746526 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad81fcb-55b7-445c-be38-e58e69403cd5 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:23.746843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad81fcb-55b7-445c-be38-e58e69403cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:23.747119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad81fcb-55b7-445c-be38-e58e69403cd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:23.754806 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad81fcb-55b7-445c-be38-e58e69403cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:23.756633 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad81fcb-55b7-445c-be38-e58e69403cd5 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:23.772574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-dad81fcb-55b7-445c-be38-e58e69403cd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:23.772574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:23.772574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:23.772574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:23.772574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:23.772574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:23.772574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:23.772574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:23.772574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:23.772574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:23.772574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:23.772574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:23.772574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:23.772574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:23.772574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:23.774430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:23.777341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:23.777341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:23.777341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:23.777341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:23.777341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:23.777341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:23.777341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:23.777341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:23.777341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 358/711] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 470 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:23.788908 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad81fcb-55b7-445c-be38-e58e69403cd5 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:23.829423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 354/712] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:34:23 2022] POST /identity/v3/users => generated 255 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:34:23.972020 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad81fcb-55b7-445c-be38-e58e69403cd5 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:24.031168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41997d-3456-42b7-981c-ac28af329924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:24.032395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41997d-3456-42b7-981c-ac28af329924 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:24.032395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41997d-3456-42b7-981c-ac28af329924 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:24.032395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41997d-3456-42b7-981c-ac28af329924 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:24.038366 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41997d-3456-42b7-981c-ac28af329924 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:24.038366 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41997d-3456-42b7-981c-ac28af329924 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:24.038366 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41997d-3456-42b7-981c-ac28af329924 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:24.053355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 359/713] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:24.063014 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721a77b-4219-4c38-a7b3-0e69d5db3457 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:24.101728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:24.240110 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db88255-a3af-45ab-a2b9-9510fd185db4 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:24.240398 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db88255-a3af-45ab-a2b9-9510fd185db4 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:24.240717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db88255-a3af-45ab-a2b9-9510fd185db4 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:24.247064 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 360/714] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:24 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:24.247368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721a77b-4219-4c38-a7b3-0e69d5db3457 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:24.255872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f883405-77bf-4b37-ab4d-b09c4bc3f15f None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:24.256896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f883405-77bf-4b37-ab4d-b09c4bc3f15f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:24.257131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f883405-77bf-4b37-ab4d-b09c4bc3f15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:24.288814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-9f883405-77bf-4b37-ab4d-b09c4bc3f15f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:24.290089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-9f883405-77bf-4b37-ab4d-b09c4bc3f15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:24.297656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3414341-acc5-40be-b8ed-7d583b28b901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:24.298381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3414341-acc5-40be-b8ed-7d583b28b901 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:24.298647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3414341-acc5-40be-b8ed-7d583b28b901 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:24.298927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3414341-acc5-40be-b8ed-7d583b28b901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:24.300321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3414341-acc5-40be-b8ed-7d583b28b901 None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=5f2ec4c76f8f4d858bce53f30cc198fa) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:24.300644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3414341-acc5-40be-b8ed-7d583b28b901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:24.302648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3414341-acc5-40be-b8ed-7d583b28b901 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:24.310992 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 355/715] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:24 2022] GET /identity/v3/role_assignments?user.id=5f2ec4c76f8f4d858bce53f30cc198fa&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:24.336980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:24.389239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 361/716] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:24.413386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3414341-acc5-40be-b8ed-7d583b28b901 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:24.532130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:24.556730 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3414341-acc5-40be-b8ed-7d583b28b901 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:24.597566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76feea4-564f-4f95-ae82-c80540deb564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:24.598973 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76feea4-564f-4f95-ae82-c80540deb564 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:24.600418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76feea4-564f-4f95-ae82-c80540deb564 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:24.600903 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76feea4-564f-4f95-ae82-c80540deb564 None admin] PATH_INFO: `/v3/services/network` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:24.601938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76feea4-564f-4f95-ae82-c80540deb564 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:24.604130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76feea4-564f-4f95-ae82-c80540deb564 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-c76feea4-564f-4f95-ae82-c80540deb564 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:24.627175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:24.628252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:24.629091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:24.629091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:24.629091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:24.629091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:24.629091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:24.629091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:24.629091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:24.629091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:24.629091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:24.629091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:24.629091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:24.629091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:24.629091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:34:24.629091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:24.629835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 356/717] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:24 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:24.642565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f883405-77bf-4b37-ab4d-b09c4bc3f15f None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:24.817112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f883405-77bf-4b37-ab4d-b09c4bc3f15f None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:24.869680 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02110d-75d9-455f-aa3c-f6b28c584411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:24.870617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02110d-75d9-455f-aa3c-f6b28c584411 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:24.870902 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02110d-75d9-455f-aa3c-f6b28c584411 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:24.871190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02110d-75d9-455f-aa3c-f6b28c584411 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:24.871912 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02110d-75d9-455f-aa3c-f6b28c584411 None admin] RBAC: Adding query filter params (name=network) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:24.872221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02110d-75d9-455f-aa3c-f6b28c584411 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:24.873598 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02110d-75d9-455f-aa3c-f6b28c584411 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:24.879169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 362/718] 10.222.0.112 () {56 vars in 1117 bytes} [Thu May 26 16:34:24 2022] GET /identity/v3/services?name=network => generated 125 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:24.887465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76feea4-564f-4f95-ae82-c80540deb564 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:24.961353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b010610-04c7-4ba9-ba83-4f1e369db6bf None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:24.961926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b010610-04c7-4ba9-ba83-4f1e369db6bf None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:24.962383 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b010610-04c7-4ba9-ba83-4f1e369db6bf None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:24.964226 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 363/719] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:34:24.972924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c605e-c128-43fe-9c83-884f071f135f None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:24.973494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c605e-c128-43fe-9c83-884f071f135f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:24.974040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c605e-c128-43fe-9c83-884f071f135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:25.007292 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-633c605e-c128-43fe-9c83-884f071f135f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:25.009172 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-633c605e-c128-43fe-9c83-884f071f135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:25.106499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:25.109336 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76feea4-564f-4f95-ae82-c80540deb564 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:25.198644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bd060-c59e-4a6c-8e6d-ec38d2e6a687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:25.201303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bd060-c59e-4a6c-8e6d-ec38d2e6a687 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:25.210976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bd060-c59e-4a6c-8e6d-ec38d2e6a687 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:25.210976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bd060-c59e-4a6c-8e6d-ec38d2e6a687 None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:25.210976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bd060-c59e-4a6c-8e6d-ec38d2e6a687 None admin] RBAC: Adding query filter params (type=network) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:25.210976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bd060-c59e-4a6c-8e6d-ec38d2e6a687 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:25.210976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bd060-c59e-4a6c-8e6d-ec38d2e6a687 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:25.230538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 357/720] 10.222.0.112 () {56 vars in 1117 bytes} [Thu May 26 16:34:24 2022] GET /identity/v3/services?type=network => generated 125 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:25.237386 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 364/721] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:34:25.285353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bd060-c59e-4a6c-8e6d-ec38d2e6a687 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:25.307970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:25.459939 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bd060-c59e-4a6c-8e6d-ec38d2e6a687 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:25.512233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02648a1f-3ec7-4095-b2e9-1a04448512b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:25.513107 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02648a1f-3ec7-4095-b2e9-1a04448512b3 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:25.513406 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02648a1f-3ec7-4095-b2e9-1a04448512b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:25.513682 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02648a1f-3ec7-4095-b2e9-1a04448512b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:25.528833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02648a1f-3ec7-4095-b2e9-1a04448512b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-02648a1f-3ec7-4095-b2e9-1a04448512b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:25.540182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:25.541184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:25.542083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:25.542083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:25.542083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:25.542083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:25.542083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:25.542083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:25.542083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:25.542083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:25.542083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:25.542083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:25.542083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:34:25.542083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:25.544613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 358/722] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:34:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:25.553505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c605e-c128-43fe-9c83-884f071f135f None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:25.732206 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c605e-c128-43fe-9c83-884f071f135f None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:25.799836 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960e768-71bc-4791-a25d-22d638f6be11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:25.800973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960e768-71bc-4791-a25d-22d638f6be11 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:25.801444 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960e768-71bc-4791-a25d-22d638f6be11 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:25.801810 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960e768-71bc-4791-a25d-22d638f6be11 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:25.803273 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960e768-71bc-4791-a25d-22d638f6be11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:25.803696 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960e768-71bc-4791-a25d-22d638f6be11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:25.805975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960e768-71bc-4791-a25d-22d638f6be11 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:25.823623 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 365/723] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:34:25 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:25.829467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02648a1f-3ec7-4095-b2e9-1a04448512b3 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:25.984696 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:26.008067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964ad48-aedf-4e74-a303-15faa9987d11 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:26.008974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964ad48-aedf-4e74-a303-15faa9987d11 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:26.009450 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964ad48-aedf-4e74-a303-15faa9987d11 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:26.011292 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 366/724] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:34:26.027612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9a87f-590a-49b3-9287-a601030d076b None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:26.028459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9a87f-590a-49b3-9287-a601030d076b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:26.028863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9a87f-590a-49b3-9287-a601030d076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:26.038359 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02648a1f-3ec7-4095-b2e9-1a04448512b3 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:26.075521 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-08f9a87f-590a-49b3-9287-a601030d076b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:26.076915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-08f9a87f-590a-49b3-9287-a601030d076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:26.092054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03536f85-2801-4782-a3fa-6b0476197846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:26.092894 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03536f85-2801-4782-a3fa-6b0476197846 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:26.093183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03536f85-2801-4782-a3fa-6b0476197846 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:26.093466 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03536f85-2801-4782-a3fa-6b0476197846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:26.119260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:26.126896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03536f85-2801-4782-a3fa-6b0476197846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:26.127903 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03536f85-2801-4782-a3fa-6b0476197846 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:26.171049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-03536f85-2801-4782-a3fa-6b0476197846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:26.171049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:26.171049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:26.171049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:26.171049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:26.171049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:26.171049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:26.171049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:26.171049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:26.171049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:26.171049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:26.171049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:26.171049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:26.171049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:26.171049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:26.172098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:26.172971 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:26.172971 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:26.172971 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:26.172971 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:26.185030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 359/725] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:34:26.203758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03536f85-2801-4782-a3fa-6b0476197846 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:26.256458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 367/726] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:26.324449 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9a87f-590a-49b3-9287-a601030d076b None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:26.417353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03536f85-2801-4782-a3fa-6b0476197846 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:26.471054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:26.507644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3313be2-19fa-4312-b5b0-a41f10b188a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:26.508875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3313be2-19fa-4312-b5b0-a41f10b188a4 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:26.509322 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3313be2-19fa-4312-b5b0-a41f10b188a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:26.509833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3313be2-19fa-4312-b5b0-a41f10b188a4 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:26.511137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3313be2-19fa-4312-b5b0-a41f10b188a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:26.511610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3313be2-19fa-4312-b5b0-a41f10b188a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:26.513414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3313be2-19fa-4312-b5b0-a41f10b188a4 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:26.548952 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 360/727] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:26.550172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3313be2-19fa-4312-b5b0-a41f10b188a4 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:26.551459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9a87f-590a-49b3-9287-a601030d076b None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:26.618036 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac1bf8-70e4-41d5-a2b0-672f3d47f7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:26.619556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac1bf8-70e4-41d5-a2b0-672f3d47f7fb None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:26.622127 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac1bf8-70e4-41d5-a2b0-672f3d47f7fb None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:26.623309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac1bf8-70e4-41d5-a2b0-672f3d47f7fb None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:26.627151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac1bf8-70e4-41d5-a2b0-672f3d47f7fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:26.628857 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac1bf8-70e4-41d5-a2b0-672f3d47f7fb None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:26.743518 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3313be2-19fa-4312-b5b0-a41f10b188a4 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:26.768607 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 368/728] 10.222.0.112 () {60 vars in 1146 bytes} [Thu May 26 16:34:26 2022] POST /identity/v3/services => generated 252 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:34:26.827365 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6af78e-655e-46ff-89f2-7bc10d07cb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:26.828957 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af78e-655e-46ff-89f2-7bc10d07cb90 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:26.829494 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af78e-655e-46ff-89f2-7bc10d07cb90 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:26.830041 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af78e-655e-46ff-89f2-7bc10d07cb90 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:26.840468 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6af78e-655e-46ff-89f2-7bc10d07cb90 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:26.842647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6af78e-655e-46ff-89f2-7bc10d07cb90 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-1b6af78e-655e-46ff-89f2-7bc10d07cb90 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:26.866676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:26.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:26.868645 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:26.868645 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:26.868645 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:26.868645 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:26.868645 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:26.868645 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:26.868645 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:26.868645 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:26.868645 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:34:26.868645 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:26.871562 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 361/729] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:34:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:34:26.877890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac1bf8-70e4-41d5-a2b0-672f3d47f7fb None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:26.913645 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:27.083576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac1bf8-70e4-41d5-a2b0-672f3d47f7fb None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:27.163155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53266265-5b45-47ae-b903-2dc8e3d2ff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:27.164653 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266265-5b45-47ae-b903-2dc8e3d2ff3e None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:27.165142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266265-5b45-47ae-b903-2dc8e3d2ff3e None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:27.165645 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266265-5b45-47ae-b903-2dc8e3d2ff3e None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:27.166730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53266265-5b45-47ae-b903-2dc8e3d2ff3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:27.167338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53266265-5b45-47ae-b903-2dc8e3d2ff3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:27.169047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53266265-5b45-47ae-b903-2dc8e3d2ff3e None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:27.202420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 369/730] 10.222.0.112 () {56 vars in 1140 bytes} [Thu May 26 16:34:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:27.216045 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6af78e-655e-46ff-89f2-7bc10d07cb90 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:27.274896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:27.307514 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5b40b-57ab-4f98-b9cc-3da8bb768db9 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:27.308516 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5b40b-57ab-4f98-b9cc-3da8bb768db9 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:27.309132 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5b40b-57ab-4f98-b9cc-3da8bb768db9 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:27.311857 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 370/731] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:27 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:27.318655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2ef04-f9d2-4aa2-ac3a-d71159390bea None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:27.319986 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2ef04-f9d2-4aa2-ac3a-d71159390bea None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:27.320616 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2ef04-f9d2-4aa2-ac3a-d71159390bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:27.338735 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-50d2ef04-f9d2-4aa2-ac3a-d71159390bea None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:27.340232 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-50d2ef04-f9d2-4aa2-ac3a-d71159390bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:27.382744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6af78e-655e-46ff-89f2-7bc10d07cb90 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:27.442464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a2b36-115d-49b0-8c93-57775c362886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:27.444468 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2b36-115d-49b0-8c93-57775c362886 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:27.444962 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2b36-115d-49b0-8c93-57775c362886 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:27.445715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2b36-115d-49b0-8c93-57775c362886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:27.447087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:27.453722 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 371/732] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:27 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:34:27.455334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8f852-db60-4ee6-8d8a-9ff849a8080c None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:27.455835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8f852-db60-4ee6-8d8a-9ff849a8080c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:27.456310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8f852-db60-4ee6-8d8a-9ff849a8080c None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:27.458102 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 372/733] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:27.463949 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4ac0f-2553-4898-8f48-2c909681718d None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:27.464484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4ac0f-2553-4898-8f48-2c909681718d None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:27.464990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4ac0f-2553-4898-8f48-2c909681718d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:27.495216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-dee4ac0f-2553-4898-8f48-2c909681718d None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:27.496972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-dee4ac0f-2553-4898-8f48-2c909681718d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:27.575192 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a2b36-115d-49b0-8c93-57775c362886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:27.577581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a2b36-115d-49b0-8c93-57775c362886 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:27.594604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 373/734] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:27 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:27.595691 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4ac0f-2553-4898-8f48-2c909681718d None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:27.620520 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:27.694895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 362/735] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:34:27 2022] GET /identity/v3/auth/tokens => generated 904 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:34:27.696152 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a2b36-115d-49b0-8c93-57775c362886 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:27.734358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4ac0f-2553-4898-8f48-2c909681718d None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:27.768133 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:27.779251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bb70b-bf3b-4f50-93c5-a0b4a5e87591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:27.780856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bb70b-bf3b-4f50-93c5-a0b4a5e87591 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:27.781539 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bb70b-bf3b-4f50-93c5-a0b4a5e87591 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:27.782198 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bb70b-bf3b-4f50-93c5-a0b4a5e87591 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:27.800260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bb70b-bf3b-4f50-93c5-a0b4a5e87591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-d88bb70b-bf3b-4f50-93c5-a0b4a5e87591 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:27.812018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:27.813947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:27.815870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:27.815870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:27.815870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:27.815870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:27.815870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:27.815870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:27.815870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:27.815870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:27.815870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:27.815870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:27.815870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:34:27.815870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:27.817107 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a2b36-115d-49b0-8c93-57775c362886 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:27.826803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 374/736] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:34:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:27.828903 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bb70b-bf3b-4f50-93c5-a0b4a5e87591 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:27.853203 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248be2e-6eb5-46fc-8c3f-04182abf9039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:27.854237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248be2e-6eb5-46fc-8c3f-04182abf9039 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:27.854237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248be2e-6eb5-46fc-8c3f-04182abf9039 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:27.854547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248be2e-6eb5-46fc-8c3f-04182abf9039 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:27.866706 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:27.867463 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248be2e-6eb5-46fc-8c3f-04182abf9039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-1248be2e-6eb5-46fc-8c3f-04182abf9039 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:27.875876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:27.882083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:27.883283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:27.883283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:27.883283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:27.883283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:27.883283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:27.883283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:27.883283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:27.883283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:27.883283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:27.883283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:27.883283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:27.883283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:27.883283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 363/737] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:27.883283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248be2e-6eb5-46fc-8c3f-04182abf9039 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:27.964954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bb70b-bf3b-4f50-93c5-a0b4a5e87591 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:27.993563 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248be2e-6eb5-46fc-8c3f-04182abf9039 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:28.009830 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150376e0-4219-4faa-aef3-2f705f9a0f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:28.011223 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150376e0-4219-4faa-aef3-2f705f9a0f3d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:28.011748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150376e0-4219-4faa-aef3-2f705f9a0f3d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:28.012283 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150376e0-4219-4faa-aef3-2f705f9a0f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:28.027790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150376e0-4219-4faa-aef3-2f705f9a0f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:28.029905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150376e0-4219-4faa-aef3-2f705f9a0f3d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:28.031300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29986bcc-0839-49ab-8de5-7b1a713189cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:28.032147 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29986bcc-0839-49ab-8de5-7b1a713189cf None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:28.032621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29986bcc-0839-49ab-8de5-7b1a713189cf None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:28.033104 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29986bcc-0839-49ab-8de5-7b1a713189cf None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:28.034039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29986bcc-0839-49ab-8de5-7b1a713189cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:28.034594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29986bcc-0839-49ab-8de5-7b1a713189cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:28.036207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29986bcc-0839-49ab-8de5-7b1a713189cf None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:28.047338 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 364/738] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:34:27 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:28.049044 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29986bcc-0839-49ab-8de5-7b1a713189cf None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:28.055319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-150376e0-4219-4faa-aef3-2f705f9a0f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:28.055319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:28.055319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:28.055319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:28.055319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:28.055319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:28.055319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:28.055319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:28.055319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:28.055319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:28.055319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:28.055319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:28.055319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:28.055319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:28.055319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:28.056391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:28.057442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:28.057442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:28.057442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:28.057442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:28.057442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 375/739] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:28.062704 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150376e0-4219-4faa-aef3-2f705f9a0f3d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:28.125832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:28.150764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:28.181187 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29986bcc-0839-49ab-8de5-7b1a713189cf None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:28.239944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150376e0-4219-4faa-aef3-2f705f9a0f3d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:28.241284 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64330789-d977-48f0-ae49-a7985457895e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:28.242611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64330789-d977-48f0-ae49-a7985457895e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:28.243125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64330789-d977-48f0-ae49-a7985457895e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:28.243615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64330789-d977-48f0-ae49-a7985457895e None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:28.244665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64330789-d977-48f0-ae49-a7985457895e None admin] RBAC: Adding query filter params (name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:28.245201 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64330789-d977-48f0-ae49-a7985457895e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:28.250675 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64330789-d977-48f0-ae49-a7985457895e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:28.267091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 365/740] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:34:28 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:28.270304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64330789-d977-48f0-ae49-a7985457895e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:28.298252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400031bd-72c0-4f64-9f75-c0df4f1da5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:28.299128 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400031bd-72c0-4f64-9f75-c0df4f1da5bc None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:28.299427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400031bd-72c0-4f64-9f75-c0df4f1da5bc None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:28.300186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400031bd-72c0-4f64-9f75-c0df4f1da5bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:28.321855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400031bd-72c0-4f64-9f75-c0df4f1da5bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:28.324649 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400031bd-72c0-4f64-9f75-c0df4f1da5bc None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:28.393839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-400031bd-72c0-4f64-9f75-c0df4f1da5bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:28.393839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:28.393839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:28.393839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:28.393839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:28.393839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:28.393839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:28.393839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:28.393839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:28.393839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:28.393839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:28.393839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:28.393839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:28.393839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:28.393839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:28.394868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:28.395979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:28.395979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:28.395979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:28.395979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:28.402514 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 376/741] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:28.405738 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400031bd-72c0-4f64-9f75-c0df4f1da5bc None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:28.445456 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64330789-d977-48f0-ae49-a7985457895e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:28.479352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:28.510811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1374eae-312d-417b-9775-478e2e22715c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:28.511493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1374eae-312d-417b-9775-478e2e22715c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:28.511777 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1374eae-312d-417b-9775-478e2e22715c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:28.512057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1374eae-312d-417b-9775-478e2e22715c None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:28.512967 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1374eae-312d-417b-9775-478e2e22715c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:28.513492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1374eae-312d-417b-9775-478e2e22715c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:28.515294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1374eae-312d-417b-9775-478e2e22715c None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:28.543673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 366/742] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:28.544640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1374eae-312d-417b-9775-478e2e22715c None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:28.572316 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:28.587084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400031bd-72c0-4f64-9f75-c0df4f1da5bc None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:28.645789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c2759-bb51-4e35-8c71-479c0798fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:28.647351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c2759-bb51-4e35-8c71-479c0798fcaa None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:28.647865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c2759-bb51-4e35-8c71-479c0798fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:28.648349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c2759-bb51-4e35-8c71-479c0798fcaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:28.670254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c2759-bb51-4e35-8c71-479c0798fcaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:28.672757 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c2759-bb51-4e35-8c71-479c0798fcaa None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:28.704789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-d98c2759-bb51-4e35-8c71-479c0798fcaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:28.704789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:28.704789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:28.704789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:28.704789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:28.704789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:28.704789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:28.704789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:28.704789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:28.704789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:28.704789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:28.704789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:28.704789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:28.704789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:28.704789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:28.705799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:28.707058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:28.707058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:28.707058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:28.707058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:28.707058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 377/743] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:28.707841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa913a5-962e-4100-acbf-60964d2791bf None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:28.708140 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa913a5-962e-4100-acbf-60964d2791bf None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:28.708417 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa913a5-962e-4100-acbf-60964d2791bf None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:28.710291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 378/744] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:28.710879 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa913a5-962e-4100-acbf-60964d2791bf None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:28.729935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1374eae-312d-417b-9775-478e2e22715c None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:28.778383 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41619d-4c6c-478a-bb91-cd5afcbfa345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:28.779504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41619d-4c6c-478a-bb91-cd5afcbfa345 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:28.779504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41619d-4c6c-478a-bb91-cd5afcbfa345 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:28.779699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41619d-4c6c-478a-bb91-cd5afcbfa345 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:28.780437 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41619d-4c6c-478a-bb91-cd5afcbfa345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:28.780801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41619d-4c6c-478a-bb91-cd5afcbfa345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:28.782133 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41619d-4c6c-478a-bb91-cd5afcbfa345 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:28.804223 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 367/745] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:28.804223 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41619d-4c6c-478a-bb91-cd5afcbfa345 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:28.871274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:28.879342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa913a5-962e-4100-acbf-60964d2791bf None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:28.939878 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97164caa-d48e-4133-b4fa-be183ac775e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:28.940979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97164caa-d48e-4133-b4fa-be183ac775e2 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:28.941313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97164caa-d48e-4133-b4fa-be183ac775e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:28.941603 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97164caa-d48e-4133-b4fa-be183ac775e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:28.952735 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97164caa-d48e-4133-b4fa-be183ac775e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:28.954196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97164caa-d48e-4133-b4fa-be183ac775e2 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:28.969728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-97164caa-d48e-4133-b4fa-be183ac775e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:28.969728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:28.969728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:28.969728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:28.969728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:28.969728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:28.969728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:28.969728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:28.969728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:28.969728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:28.969728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:28.969728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:28.969728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:28.969728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:28.969728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:28.981112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:28.982997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:28.982997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:28.982997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:28.982997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:28.982997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:28.982997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:28.982997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:28.982997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:28.982997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 379/746] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:28.982997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5dd78-a3bc-4fb9-890e-6c7d36a761bd None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:28.982997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5dd78-a3bc-4fb9-890e-6c7d36a761bd None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:28.984162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5dd78-a3bc-4fb9-890e-6c7d36a761bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:28.984162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:28.995335 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-62d5dd78-a3bc-4fb9-890e-6c7d36a761bd None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:28.995685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41619d-4c6c-478a-bb91-cd5afcbfa345 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:28.996647 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-62d5dd78-a3bc-4fb9-890e-6c7d36a761bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:29.033663 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c6f06-b902-43d0-915e-c91c2e4d9b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:29.034370 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c6f06-b902-43d0-915e-c91c2e4d9b9b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:29.034659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c6f06-b902-43d0-915e-c91c2e4d9b9b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:29.034944 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c6f06-b902-43d0-915e-c91c2e4d9b9b None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:29.035682 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c6f06-b902-43d0-915e-c91c2e4d9b9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:29.036008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c6f06-b902-43d0-915e-c91c2e4d9b9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:29.037905 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c6f06-b902-43d0-915e-c91c2e4d9b9b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:29.063805 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 368/747] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:29.063805 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c6f06-b902-43d0-915e-c91c2e4d9b9b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:29.098170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 380/748] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:28 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:34:29.099089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5dd78-a3bc-4fb9-890e-6c7d36a761bd None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:29.219343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:29.222772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c6f06-b902-43d0-915e-c91c2e4d9b9b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:29.236880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5dd78-a3bc-4fb9-890e-6c7d36a761bd None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:29.263245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c521cb8-7cec-4e1b-a7a1-21c7cd9cdefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:29.264177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c521cb8-7cec-4e1b-a7a1-21c7cd9cdefa None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:29.264421 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c521cb8-7cec-4e1b-a7a1-21c7cd9cdefa None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:29.264865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c521cb8-7cec-4e1b-a7a1-21c7cd9cdefa None admin] PATH_INFO: `/v3/users/nova` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:29.274890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c521cb8-7cec-4e1b-a7a1-21c7cd9cdefa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:29.277404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c521cb8-7cec-4e1b-a7a1-21c7cd9cdefa None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:29.283187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67482d5c-a795-493e-9b65-1517e737bc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:29.283936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67482d5c-a795-493e-9b65-1517e737bc11 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:29.284157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67482d5c-a795-493e-9b65-1517e737bc11 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:29.284447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67482d5c-a795-493e-9b65-1517e737bc11 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:29.285291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67482d5c-a795-493e-9b65-1517e737bc11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:29.285610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67482d5c-a795-493e-9b65-1517e737bc11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:29.288336 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67482d5c-a795-493e-9b65-1517e737bc11 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:29.289695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-0c521cb8-7cec-4e1b-a7a1-21c7cd9cdefa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:29.293386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:29.294340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:29.306698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:29.306698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:29.306698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:29.306698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:29.306698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:29.306698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:29.306698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:29.306698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:29.306698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:34:29.306698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:29.306698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 369/749] 10.222.0.112 () {56 vars in 1098 bytes} [Thu May 26 16:34:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:29.306698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c521cb8-7cec-4e1b-a7a1-21c7cd9cdefa None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:29.312530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 381/750] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:29.313456 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67482d5c-a795-493e-9b65-1517e737bc11 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:29.444811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c521cb8-7cec-4e1b-a7a1-21c7cd9cdefa None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:29.468562 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67482d5c-a795-493e-9b65-1517e737bc11 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:29.493860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5751f-e65f-4aa5-bf38-93509598e1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:29.494748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5751f-e65f-4aa5-bf38-93509598e1f9 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:29.495097 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5751f-e65f-4aa5-bf38-93509598e1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:29.495369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5751f-e65f-4aa5-bf38-93509598e1f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:29.504479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5751f-e65f-4aa5-bf38-93509598e1f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:29.506290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5751f-e65f-4aa5-bf38-93509598e1f9 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:29.520096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13736b-8e33-4bd5-a9b1-faf6542a615a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:29.521214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13736b-8e33-4bd5-a9b1-faf6542a615a None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:29.521920 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13736b-8e33-4bd5-a9b1-faf6542a615a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:29.522184 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13736b-8e33-4bd5-a9b1-faf6542a615a None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-9bc5751f-e65f-4aa5-bf38-93509598e1f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:29.523019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:29.524077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:29.530208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:29.530208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:29.530208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:29.530208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:29.530208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:29.530208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:29.530208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:29.530208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:29.530208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:34:29.530208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:29.530810 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13736b-8e33-4bd5-a9b1-faf6542a615a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:29.530897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 370/751] 10.222.0.112 () {56 vars in 1122 bytes} [Thu May 26 16:34:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:29.530897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5751f-e65f-4aa5-bf38-93509598e1f9 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:29.531025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13736b-8e33-4bd5-a9b1-faf6542a615a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:29.557298 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:29.645287 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5751f-e65f-4aa5-bf38-93509598e1f9 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:29.647341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 382/752] 10.222.0.112 () {60 vars in 1146 bytes} [Thu May 26 16:34:29 2022] POST /identity/v3/services => generated 241 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:34:29.648444 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13736b-8e33-4bd5-a9b1-faf6542a615a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:29.711508 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be4f5b-62e5-4435-a2aa-8b696315bedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:29.712637 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be4f5b-62e5-4435-a2aa-8b696315bedd None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:29.712884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be4f5b-62e5-4435-a2aa-8b696315bedd None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:29.713166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be4f5b-62e5-4435-a2aa-8b696315bedd None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:29.714034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be4f5b-62e5-4435-a2aa-8b696315bedd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:29.714482 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be4f5b-62e5-4435-a2aa-8b696315bedd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:29.715969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be4f5b-62e5-4435-a2aa-8b696315bedd None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:29.728873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:29.736915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 371/753] 10.222.0.112 () {56 vars in 1138 bytes} [Thu May 26 16:34:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:29.737641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be4f5b-62e5-4435-a2aa-8b696315bedd None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:29.803202 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13736b-8e33-4bd5-a9b1-faf6542a615a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:29.838105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:29.859775 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd7285-5d15-4cc4-b571-74bd3f3045d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:29.861281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd7285-5d15-4cc4-b571-74bd3f3045d0 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:29.862635 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd7285-5d15-4cc4-b571-74bd3f3045d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:29.863324 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd7285-5d15-4cc4-b571-74bd3f3045d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:29.866351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd7285-5d15-4cc4-b571-74bd3f3045d0 None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=465b269fc6ee415b8f5715843468d089) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:29.867297 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd7285-5d15-4cc4-b571-74bd3f3045d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:29.868926 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be4f5b-62e5-4435-a2aa-8b696315bedd None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:29.869264 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd7285-5d15-4cc4-b571-74bd3f3045d0 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:29.882393 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 383/754] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:29 2022] GET /identity/v3/role_assignments?user.id=465b269fc6ee415b8f5715843468d089&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:29.883977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda045e-2120-4cd8-ad6c-f30df9bc73e2 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:29.884497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda045e-2120-4cd8-ad6c-f30df9bc73e2 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:29.884893 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda045e-2120-4cd8-ad6c-f30df9bc73e2 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:29.887699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 384/755] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:29.887699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda045e-2120-4cd8-ad6c-f30df9bc73e2 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:29.933303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abfcfc-c586-4c2b-bc36-240c76175eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:29.935973 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abfcfc-c586-4c2b-bc36-240c76175eae None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:29.935973 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abfcfc-c586-4c2b-bc36-240c76175eae None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:29.935973 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abfcfc-c586-4c2b-bc36-240c76175eae None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:29.936906 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abfcfc-c586-4c2b-bc36-240c76175eae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:29.937514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abfcfc-c586-4c2b-bc36-240c76175eae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:29.940431 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abfcfc-c586-4c2b-bc36-240c76175eae None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:29.964099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 372/756] 10.222.0.112 () {56 vars in 1154 bytes} [Thu May 26 16:34:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:29.965285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38955ed-5381-4840-8833-b357fa3ed333 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:29.965575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38955ed-5381-4840-8833-b357fa3ed333 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:29.965854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38955ed-5381-4840-8833-b357fa3ed333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:29.997438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-c38955ed-5381-4840-8833-b357fa3ed333 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:29.997438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-c38955ed-5381-4840-8833-b357fa3ed333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:30.045259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda045e-2120-4cd8-ad6c-f30df9bc73e2 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:30.072077 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:30.106187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50c0ba-3f85-41f9-bcd1-ffe30769e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:30.107274 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50c0ba-3f85-41f9-bcd1-ffe30769e52c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:30.107587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50c0ba-3f85-41f9-bcd1-ffe30769e52c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:30.107859 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50c0ba-3f85-41f9-bcd1-ffe30769e52c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:30.113590 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 373/757] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:29 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:30.115094 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38955ed-5381-4840-8833-b357fa3ed333 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:30.223416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:30.279163 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50c0ba-3f85-41f9-bcd1-ffe30769e52c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:30.280644 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50c0ba-3f85-41f9-bcd1-ffe30769e52c None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:30.286256 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38955ed-5381-4840-8833-b357fa3ed333 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:30.300639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-1d50c0ba-3f85-41f9-bcd1-ffe30769e52c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:30.300639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:30.300639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:30.300639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:30.300639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:30.300639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:30.300639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:30.300639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:30.300639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:30.300639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:30.300639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:30.300639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:30.300639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:30.300639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:30.300639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:30.302098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:30.304291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:30.304291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:30.304291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:30.304291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:30.308560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 385/758] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:30.308560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50c0ba-3f85-41f9-bcd1-ffe30769e52c None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:30.330512 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f96ad-a09c-41c9-ac2e-8b46ca0ed9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:30.331190 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f96ad-a09c-41c9-ac2e-8b46ca0ed9f5 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:30.331478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f96ad-a09c-41c9-ac2e-8b46ca0ed9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:30.331761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f96ad-a09c-41c9-ac2e-8b46ca0ed9f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:30.443794 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f96ad-a09c-41c9-ac2e-8b46ca0ed9f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:30.446061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f96ad-a09c-41c9-ac2e-8b46ca0ed9f5 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:30.453009 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50c0ba-3f85-41f9-bcd1-ffe30769e52c None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:30.504226 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf76122-66b8-4c47-bbac-a93e6003f700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:30.505710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf76122-66b8-4c47-bbac-a93e6003f700 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:30.506219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf76122-66b8-4c47-bbac-a93e6003f700 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:30.507791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf76122-66b8-4c47-bbac-a93e6003f700 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:30.509091 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf76122-66b8-4c47-bbac-a93e6003f700 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:30.513421 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf76122-66b8-4c47-bbac-a93e6003f700 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:30.533727 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-ddf76122-66b8-4c47-bbac-a93e6003f700 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:30.537822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:30.538990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:30.540025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:30.540025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:30.540025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:30.540025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:30.540025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:30.540025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:30.540025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:30.540025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:30.540025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:30.540025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:30.540025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:30.540025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:30.540025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:30.540025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:34:30.540025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:30.549075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 386/759] 10.222.0.112 () {56 vars in 1134 bytes} [Thu May 26 16:34:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:30.549075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf76122-66b8-4c47-bbac-a93e6003f700 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:30.595963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 374/760] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:34:30 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:34:30.597053 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f96ad-a09c-41c9-ac2e-8b46ca0ed9f5 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:30.598382 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:30.689564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf76122-66b8-4c47-bbac-a93e6003f700 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:30.736156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72788c4-0e08-4e39-8ab5-09c5a2bd539f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:30.736992 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72788c4-0e08-4e39-8ab5-09c5a2bd539f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:30.737373 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72788c4-0e08-4e39-8ab5-09c5a2bd539f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:30.737753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72788c4-0e08-4e39-8ab5-09c5a2bd539f None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:30.738837 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72788c4-0e08-4e39-8ab5-09c5a2bd539f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:30.739015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72788c4-0e08-4e39-8ab5-09c5a2bd539f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:30.741214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72788c4-0e08-4e39-8ab5-09c5a2bd539f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:30.741977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f96ad-a09c-41c9-ac2e-8b46ca0ed9f5 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:30.760061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 387/761] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:30.760061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72788c4-0e08-4e39-8ab5-09c5a2bd539f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:30.796976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a7eae-f316-4833-9163-34ddb1062e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:30.798144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a7eae-f316-4833-9163-34ddb1062e8c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:30.799493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a7eae-f316-4833-9163-34ddb1062e8c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:30.799932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a7eae-f316-4833-9163-34ddb1062e8c None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:30.800806 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a7eae-f316-4833-9163-34ddb1062e8c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:30.801292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a7eae-f316-4833-9163-34ddb1062e8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:30.803037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a7eae-f316-4833-9163-34ddb1062e8c None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:30.814412 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 375/762] 10.222.0.112 () {56 vars in 1129 bytes} [Thu May 26 16:34:30 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:30.816299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a7eae-f316-4833-9163-34ddb1062e8c None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:30.875681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:30.900338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:30.907644 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72788c4-0e08-4e39-8ab5-09c5a2bd539f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:30.952595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9338add-ff1f-4a25-bdc2-67c44e55ae04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:30.953595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9338add-ff1f-4a25-bdc2-67c44e55ae04 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:30.954080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9338add-ff1f-4a25-bdc2-67c44e55ae04 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:30.954375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9338add-ff1f-4a25-bdc2-67c44e55ae04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:30.977278 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a7eae-f316-4833-9163-34ddb1062e8c None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:30.979382 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9338add-ff1f-4a25-bdc2-67c44e55ae04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:30.982217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9338add-ff1f-4a25-bdc2-67c44e55ae04 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:31.018971 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beee5c-e246-4467-b311-f84478a6de6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:31.019978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beee5c-e246-4467-b311-f84478a6de6b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:31.020379 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beee5c-e246-4467-b311-f84478a6de6b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:31.020755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beee5c-e246-4467-b311-f84478a6de6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:31.023621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-a9338add-ff1f-4a25-bdc2-67c44e55ae04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:31.023621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:31.023621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:31.023621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:31.023621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:31.023621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:31.023621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:31.023621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:31.023621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:31.023621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:31.023621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:31.023621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:31.023621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:31.023621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:31.023621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:31.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:31.027576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:31.027576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:31.027576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:31.027576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:31.028617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 388/763] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:31.030302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9338add-ff1f-4a25-bdc2-67c44e55ae04 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:31.038683 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3beee5c-e246-4467-b311-f84478a6de6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:31.040517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3beee5c-e246-4467-b311-f84478a6de6b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:31.060454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-c3beee5c-e246-4467-b311-f84478a6de6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:31.060454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:31.060454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:31.060454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:31.060454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:31.060454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:31.060454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:31.060454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:31.060454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:31.060454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:31.060454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:31.060454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:31.060454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:31.060454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:31.060454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:31.061387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:31.062301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:31.062301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:31.062301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:31.062301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:31.062301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:31.062301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:31.062301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:31.062301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:31.070674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 376/764] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:31.071749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beee5c-e246-4467-b311-f84478a6de6b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:31.191209 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9338add-ff1f-4a25-bdc2-67c44e55ae04 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:31.202020 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:31.235456 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beee5c-e246-4467-b311-f84478a6de6b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:31.247910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d6ab0-d01d-4589-a1e0-77330c187f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:31.249003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d6ab0-d01d-4589-a1e0-77330c187f5d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:31.249481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d6ab0-d01d-4589-a1e0-77330c187f5d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:31.249944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d6ab0-d01d-4589-a1e0-77330c187f5d None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:31.251208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d6ab0-d01d-4589-a1e0-77330c187f5d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:31.251737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d6ab0-d01d-4589-a1e0-77330c187f5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:31.254195 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d6ab0-d01d-4589-a1e0-77330c187f5d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:31.263477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 389/765] 10.222.0.112 () {56 vars in 1129 bytes} [Thu May 26 16:34:31 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:31.264792 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d6ab0-d01d-4589-a1e0-77330c187f5d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:31.287275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:31.289837 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5ed59-5a53-496e-bf12-45eafdf97b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:31.290690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5ed59-5a53-496e-bf12-45eafdf97b3b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:31.291018 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5ed59-5a53-496e-bf12-45eafdf97b3b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:31.291504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5ed59-5a53-496e-bf12-45eafdf97b3b None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:31.292256 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5ed59-5a53-496e-bf12-45eafdf97b3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:31.292665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5ed59-5a53-496e-bf12-45eafdf97b3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:31.294181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5ed59-5a53-496e-bf12-45eafdf97b3b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:31.311824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 377/766] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:31.313759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5ed59-5a53-496e-bf12-45eafdf97b3b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:31.442520 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d6ab0-d01d-4589-a1e0-77330c187f5d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:31.463823 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5ed59-5a53-496e-bf12-45eafdf97b3b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:31.487206 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd992e-bb09-4eae-b3b3-ef68bb91bb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:31.487886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd992e-bb09-4eae-b3b3-ef68bb91bb0a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:31.488173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd992e-bb09-4eae-b3b3-ef68bb91bb0a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:31.488453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd992e-bb09-4eae-b3b3-ef68bb91bb0a None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:31.490588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd992e-bb09-4eae-b3b3-ef68bb91bb0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:31.490912 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd992e-bb09-4eae-b3b3-ef68bb91bb0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:31.492358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd992e-bb09-4eae-b3b3-ef68bb91bb0a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:31.508627 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 390/767] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:31.509748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd992e-bb09-4eae-b3b3-ef68bb91bb0a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:31.520570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad8ce2-1705-4386-b5fd-af4fe2ae30f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:31.522137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad8ce2-1705-4386-b5fd-af4fe2ae30f8 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:31.522639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad8ce2-1705-4386-b5fd-af4fe2ae30f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:31.523086 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad8ce2-1705-4386-b5fd-af4fe2ae30f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:31.524064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad8ce2-1705-4386-b5fd-af4fe2ae30f8 None admin] RBAC: Adding query filter params (interface=public, service_id=c2f217d81bda4d178a8e0e25eb038f1d, region_id=RegionOne) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:31.524609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad8ce2-1705-4386-b5fd-af4fe2ae30f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:31.526200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad8ce2-1705-4386-b5fd-af4fe2ae30f8 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:31.535653 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 378/768] 10.222.0.112 () {56 vars in 1256 bytes} [Thu May 26 16:34:31 2022] GET /identity/v3/endpoints?service_id=c2f217d81bda4d178a8e0e25eb038f1d&interface=public®ion_id=RegionOne => generated 195 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:31.537812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad8ce2-1705-4386-b5fd-af4fe2ae30f8 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:31.555843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:31.595295 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:31.637604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd992e-bb09-4eae-b3b3-ef68bb91bb0a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:31.662650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad8ce2-1705-4386-b5fd-af4fe2ae30f8 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:31.680524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473082d8-beb7-488c-ba87-20532b1f8cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:31.681597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473082d8-beb7-488c-ba87-20532b1f8cb8 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:31.682109 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473082d8-beb7-488c-ba87-20532b1f8cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:31.682578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473082d8-beb7-488c-ba87-20532b1f8cb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:31.691028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473082d8-beb7-488c-ba87-20532b1f8cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:31.692737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473082d8-beb7-488c-ba87-20532b1f8cb8 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:31.708155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde73341-d24d-4fe1-9ca4-0aa325c554a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:31.708681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-473082d8-beb7-488c-ba87-20532b1f8cb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:31.708681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:31.708681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:31.708681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:31.708681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:31.708681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:31.708681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:31.708681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:31.708681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:31.708681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:31.708681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:31.708681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:31.708681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:31.708681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:31.708681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:31.709670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:31.710695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:31.710695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:31.710695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:31.710695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:31.710695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:31.710695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:31.710695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:31.710695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:31.711142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde73341-d24d-4fe1-9ca4-0aa325c554a9 None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:31.711142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde73341-d24d-4fe1-9ca4-0aa325c554a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:31.711142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde73341-d24d-4fe1-9ca4-0aa325c554a9 None admin] PATH_INFO: `/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/5f2ec4c76f8f4d858bce53f30cc198fa/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:31.712021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde73341-d24d-4fe1-9ca4-0aa325c554a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9be90db8d7ee4bd0b01444d1eab83ad8, user_id=5f2ec4c76f8f4d858bce53f30cc198fa, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:31.713249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 391/769] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:31.714206 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473082d8-beb7-488c-ba87-20532b1f8cb8 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:31.715006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde73341-d24d-4fe1-9ca4-0aa325c554a9 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:31.810586 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 379/770] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:34:31 2022] PUT /identity/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/5f2ec4c76f8f4d858bce53f30cc198fa/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:34:31.812711 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde73341-d24d-4fe1-9ca4-0aa325c554a9 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:31.865416 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473082d8-beb7-488c-ba87-20532b1f8cb8 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:31.910718 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:31.920095 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c185c95-0295-41b7-87de-9022549c55c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:31.921238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c185c95-0295-41b7-87de-9022549c55c6 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:31.921749 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c185c95-0295-41b7-87de-9022549c55c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:31.922236 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c185c95-0295-41b7-87de-9022549c55c6 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:31.926357 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c185c95-0295-41b7-87de-9022549c55c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:31.926357 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c185c95-0295-41b7-87de-9022549c55c6 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:31.935593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 392/771] 10.222.0.112 () {56 vars in 1092 bytes} [Thu May 26 16:34:31 2022] GET /identity/v3/services => generated 776 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:31.970028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:32.012807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde73341-d24d-4fe1-9ca4-0aa325c554a9 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:32.078514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77819a62-dcdf-46eb-bee2-154061f43aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:32.079208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77819a62-dcdf-46eb-bee2-154061f43aa0 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:32.079498 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77819a62-dcdf-46eb-bee2-154061f43aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:32.079781 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77819a62-dcdf-46eb-bee2-154061f43aa0 None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:32.080643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77819a62-dcdf-46eb-bee2-154061f43aa0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:32.080961 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77819a62-dcdf-46eb-bee2-154061f43aa0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:32.083105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77819a62-dcdf-46eb-bee2-154061f43aa0 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:32.098238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 380/772] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:32.106384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c185c95-0295-41b7-87de-9022549c55c6 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:32.238877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c185c95-0295-41b7-87de-9022549c55c6 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:32.276616 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3ff75-71e4-499a-a9dd-5481b6392d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:32.277922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3ff75-71e4-499a-a9dd-5481b6392d9c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:32.278436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3ff75-71e4-499a-a9dd-5481b6392d9c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:32.278892 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3ff75-71e4-499a-a9dd-5481b6392d9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:32.280285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3ff75-71e4-499a-a9dd-5481b6392d9c None admin] RBAC: Adding query filter params (role.id=64acd9118f3d4931be8ca4bfa4ae907e, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=06f2efcb8c6646658934a3ab55ab5744) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:32.280660 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3ff75-71e4-499a-a9dd-5481b6392d9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:32.282962 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3ff75-71e4-499a-a9dd-5481b6392d9c None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:32.290969 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 393/773] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:32 2022] GET /identity/v3/role_assignments?user.id=06f2efcb8c6646658934a3ab55ab5744&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=64acd9118f3d4931be8ca4bfa4ae907e => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:32.409438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048fdf9-b5ce-4ad6-bb05-a90cc181106e None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:32.409986 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048fdf9-b5ce-4ad6-bb05-a90cc181106e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:32.409986 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048fdf9-b5ce-4ad6-bb05-a90cc181106e None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:32.411970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 381/774] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:32.418055 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30b20-33c9-4d80-ab1d-f8ad655c42d6 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:32.418720 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30b20-33c9-4d80-ab1d-f8ad655c42d6 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:32.419206 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30b20-33c9-4d80-ab1d-f8ad655c42d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:32.443223 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-07f30b20-33c9-4d80-ab1d-f8ad655c42d6 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:32.445292 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-07f30b20-33c9-4d80-ab1d-f8ad655c42d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:32.533128 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:32.551824 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 394/775] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:32 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:32.579686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048fdf9-b5ce-4ad6-bb05-a90cc181106e None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:32.744224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee23be3-8a81-4366-b297-dffbb0a503ca None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:32.744522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee23be3-8a81-4366-b297-dffbb0a503ca None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:32.744862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee23be3-8a81-4366-b297-dffbb0a503ca None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:32.746447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 395/776] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:32.752430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256f9d4-2eb8-4011-9aac-992d3c35394b None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:32.752834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256f9d4-2eb8-4011-9aac-992d3c35394b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:32.752989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256f9d4-2eb8-4011-9aac-992d3c35394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:32.790733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048fdf9-b5ce-4ad6-bb05-a90cc181106e None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:32.808024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-4256f9d4-2eb8-4011-9aac-992d3c35394b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:32.810018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-4256f9d4-2eb8-4011-9aac-992d3c35394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:32.858710 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:32.870886 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b43ec5-77c5-4dd8-924b-be7115461c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:32.878467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b43ec5-77c5-4dd8-924b-be7115461c24 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:32.878467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b43ec5-77c5-4dd8-924b-be7115461c24 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:32.878467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b43ec5-77c5-4dd8-924b-be7115461c24 None admin] PATH_INFO: `/v3/services/network` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:32.878467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b43ec5-77c5-4dd8-924b-be7115461c24 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:32.878467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b43ec5-77c5-4dd8-924b-be7115461c24 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-80b43ec5-77c5-4dd8-924b-be7115461c24 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:32.911025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:32.913092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:32.913942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:32.913942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:32.913942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:32.913942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:32.913942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:32.913942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:32.913942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:32.913942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:32.913942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:32.913942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:32.913942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:32.913942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:32.913942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:34:32.913942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:32.913942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 382/777] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:32 2022] GET /identity/v3/services/network => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:32.921686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b43ec5-77c5-4dd8-924b-be7115461c24 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:32.954668 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 396/778] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:32 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:34:32.991886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256f9d4-2eb8-4011-9aac-992d3c35394b None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:33.098250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b43ec5-77c5-4dd8-924b-be7115461c24 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:33.165976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb68101-dcc7-4949-b4b9-fd86595485fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:33.167166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb68101-dcc7-4949-b4b9-fd86595485fd None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:33.167674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb68101-dcc7-4949-b4b9-fd86595485fd None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:33.168159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb68101-dcc7-4949-b4b9-fd86595485fd None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:33.169198 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb68101-dcc7-4949-b4b9-fd86595485fd None admin] RBAC: Adding query filter params (name=network) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:33.169948 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb68101-dcc7-4949-b4b9-fd86595485fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:33.172443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb68101-dcc7-4949-b4b9-fd86595485fd None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:33.188220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 383/779] 10.222.0.112 () {56 vars in 1117 bytes} [Thu May 26 16:34:32 2022] GET /identity/v3/services?name=network => generated 125 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:33.197253 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb68101-dcc7-4949-b4b9-fd86595485fd None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:33.220959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256f9d4-2eb8-4011-9aac-992d3c35394b None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:33.243805 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:33.268382 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15279f9e-912c-4cd9-b500-5989a5b7b392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:33.269201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15279f9e-912c-4cd9-b500-5989a5b7b392 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:33.269479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15279f9e-912c-4cd9-b500-5989a5b7b392 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:33.269753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15279f9e-912c-4cd9-b500-5989a5b7b392 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:33.310252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15279f9e-912c-4cd9-b500-5989a5b7b392 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-15279f9e-912c-4cd9-b500-5989a5b7b392 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:33.324011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:33.325037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:33.325899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:33.325899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:33.325899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:33.325899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:33.325899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:33.325899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:33.325899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:33.325899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:33.325899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:33.325899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:33.325899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:34:33.325899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:33.326689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 397/780] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:34:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:34:33.339275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15279f9e-912c-4cd9-b500-5989a5b7b392 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:33.358956 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:33.427479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb68101-dcc7-4949-b4b9-fd86595485fd None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:33.487714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354a984-8fc0-45cc-9397-c3391d5b5428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:33.488405 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354a984-8fc0-45cc-9397-c3391d5b5428 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:33.488692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354a984-8fc0-45cc-9397-c3391d5b5428 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:33.488976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354a984-8fc0-45cc-9397-c3391d5b5428 None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:33.490596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354a984-8fc0-45cc-9397-c3391d5b5428 None admin] RBAC: Adding query filter params (type=network) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:33.490926 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354a984-8fc0-45cc-9397-c3391d5b5428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:33.492348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354a984-8fc0-45cc-9397-c3391d5b5428 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:33.506988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 384/781] 10.222.0.112 () {56 vars in 1117 bytes} [Thu May 26 16:34:33 2022] GET /identity/v3/services?type=network => generated 352 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:33.513565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354a984-8fc0-45cc-9397-c3391d5b5428 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:33.617606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15279f9e-912c-4cd9-b500-5989a5b7b392 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:33.658694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354a984-8fc0-45cc-9397-c3391d5b5428 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:33.696581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:33.699337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb219143-e3b1-43d7-a001-3029d0b2b8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:33.700023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb219143-e3b1-43d7-a001-3029d0b2b8f0 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:33.700314 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb219143-e3b1-43d7-a001-3029d0b2b8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:33.700601 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb219143-e3b1-43d7-a001-3029d0b2b8f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:33.701462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb219143-e3b1-43d7-a001-3029d0b2b8f0 None admin] RBAC: Adding query filter params (interface=public, service_id=dc828561daa348c8a2421159457fe4af, region_id=RegionOne) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:33.701785 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb219143-e3b1-43d7-a001-3029d0b2b8f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:33.703497 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb219143-e3b1-43d7-a001-3029d0b2b8f0 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:33.710490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 385/782] 10.222.0.112 () {56 vars in 1256 bytes} [Thu May 26 16:34:33 2022] GET /identity/v3/endpoints?service_id=dc828561daa348c8a2421159457fe4af&interface=public®ion_id=RegionOne => generated 195 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:33.716722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb219143-e3b1-43d7-a001-3029d0b2b8f0 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:33.739969 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727e2a7-5fec-4347-9129-cfc464238f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:33.740664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727e2a7-5fec-4347-9129-cfc464238f2a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:33.741012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727e2a7-5fec-4347-9129-cfc464238f2a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:33.741228 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727e2a7-5fec-4347-9129-cfc464238f2a None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:33.741991 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727e2a7-5fec-4347-9129-cfc464238f2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:33.742301 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727e2a7-5fec-4347-9129-cfc464238f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:33.743710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727e2a7-5fec-4347-9129-cfc464238f2a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:33.764505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 398/783] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:34:33 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:33.775987 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727e2a7-5fec-4347-9129-cfc464238f2a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:33.881610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb219143-e3b1-43d7-a001-3029d0b2b8f0 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:33.916886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:33.935582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfcd3b-5b8f-43b3-a4ec-bb56a4d42749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:33.936463 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfcd3b-5b8f-43b3-a4ec-bb56a4d42749 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:33.936787 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfcd3b-5b8f-43b3-a4ec-bb56a4d42749 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:33.937195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfcd3b-5b8f-43b3-a4ec-bb56a4d42749 None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:33.938003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfcd3b-5b8f-43b3-a4ec-bb56a4d42749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:33.941789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfcd3b-5b8f-43b3-a4ec-bb56a4d42749 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:33.955191 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 386/784] 10.222.0.112 () {56 vars in 1092 bytes} [Thu May 26 16:34:33 2022] GET /identity/v3/services => generated 776 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:34.062278 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727e2a7-5fec-4347-9129-cfc464238f2a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:34.114598 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd40e8-521c-4d07-8c40-44026c11cd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:34.115653 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd40e8-521c-4d07-8c40-44026c11cd48 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:34.115942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd40e8-521c-4d07-8c40-44026c11cd48 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:34.116260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd40e8-521c-4d07-8c40-44026c11cd48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:34.134024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd40e8-521c-4d07-8c40-44026c11cd48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:34.135519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd40e8-521c-4d07-8c40-44026c11cd48 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:34.155580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-4dbd40e8-521c-4d07-8c40-44026c11cd48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:34.155580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:34.155580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:34.155580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:34.155580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:34.155580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:34.155580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:34.155580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:34.155580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:34.155580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:34.155580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:34.155580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:34.155580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:34.155580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:34.155580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:34.157756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:34.159699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:34.159699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:34.159699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:34.159699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:34.159699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 399/785] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:34.166819 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfcd3b-5b8f-43b3-a4ec-bb56a4d42749 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:34.247329 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:34.319479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfcd3b-5b8f-43b3-a4ec-bb56a4d42749 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:34.369244 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e913063-c668-4922-9c1c-dec44655b789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:34.369952 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e913063-c668-4922-9c1c-dec44655b789 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:34.370239 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e913063-c668-4922-9c1c-dec44655b789 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:34.370547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e913063-c668-4922-9c1c-dec44655b789 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:34.371300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e913063-c668-4922-9c1c-dec44655b789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:34.371611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e913063-c668-4922-9c1c-dec44655b789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:34.373096 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e913063-c668-4922-9c1c-dec44655b789 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:34.389296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 387/786] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:34.400474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd40e8-521c-4d07-8c40-44026c11cd48 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:34.536281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd40e8-521c-4d07-8c40-44026c11cd48 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:34.544079 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:34.574765 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53035b1e-37f5-4488-be2f-fc9bbf5be727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:34.575838 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53035b1e-37f5-4488-be2f-fc9bbf5be727 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:34.576126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53035b1e-37f5-4488-be2f-fc9bbf5be727 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:34.576438 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53035b1e-37f5-4488-be2f-fc9bbf5be727 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:34.588454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53035b1e-37f5-4488-be2f-fc9bbf5be727 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:34.589923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53035b1e-37f5-4488-be2f-fc9bbf5be727 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-53035b1e-37f5-4488-be2f-fc9bbf5be727 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:34.605764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:34.606826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:34.607795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:34.607795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:34.607795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:34.607795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:34.607795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:34.607795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:34.607795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:34.607795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:34.607795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:34:34.607795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:34.607795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 400/787] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:34:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:34.614900 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e913063-c668-4922-9c1c-dec44655b789 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:34.789296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e913063-c668-4922-9c1c-dec44655b789 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:34.800908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:34.842592 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90d6ae-e779-40b0-8778-5f6e0aa11e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:34.843438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90d6ae-e779-40b0-8778-5f6e0aa11e9f None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:34.843941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90d6ae-e779-40b0-8778-5f6e0aa11e9f None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:34.844255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90d6ae-e779-40b0-8778-5f6e0aa11e9f None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:34.845128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90d6ae-e779-40b0-8778-5f6e0aa11e9f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:34.845508 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90d6ae-e779-40b0-8778-5f6e0aa11e9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:34.847079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90d6ae-e779-40b0-8778-5f6e0aa11e9f None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:34.876884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 388/788] 10.222.0.112 () {56 vars in 1140 bytes} [Thu May 26 16:34:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:34.883049 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53035b1e-37f5-4488-be2f-fc9bbf5be727 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:35.135528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443a7ef-4248-4b7e-b816-a555107314db None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:35.135528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443a7ef-4248-4b7e-b816-a555107314db None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:35.135528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443a7ef-4248-4b7e-b816-a555107314db None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:35.136252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53035b1e-37f5-4488-be2f-fc9bbf5be727 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:35.136656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 389/789] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:34:35.142248 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a9ac2-5dac-4890-b07d-da2958fa5cb9 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:35.142841 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a9ac2-5dac-4890-b07d-da2958fa5cb9 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:35.143323 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a9ac2-5dac-4890-b07d-da2958fa5cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:35.161807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-ee7a9ac2-5dac-4890-b07d-da2958fa5cb9 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:35.163619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-ee7a9ac2-5dac-4890-b07d-da2958fa5cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:35.184387 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7567ca-a03d-4897-bf53-60a357782a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:35.185189 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7567ca-a03d-4897-bf53-60a357782a3b None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:35.185473 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7567ca-a03d-4897-bf53-60a357782a3b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:35.185781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7567ca-a03d-4897-bf53-60a357782a3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:35.203243 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7567ca-a03d-4897-bf53-60a357782a3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:35.204706 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7567ca-a03d-4897-bf53-60a357782a3b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:35.228911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-4f7567ca-a03d-4897-bf53-60a357782a3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:35.228911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:35.228911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:35.228911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:35.228911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:35.228911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:35.228911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:35.228911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:35.228911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:35.228911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:35.228911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:35.228911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:35.228911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:35.228911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:35.228911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:35.229877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:35.230814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:35.230814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:35.230814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:35.230814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:35.230814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 401/790] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:35.231926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec3e16-4a29-4efd-b68d-1d6d7254b2aa None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:35.232214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec3e16-4a29-4efd-b68d-1d6d7254b2aa None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:35.232493 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec3e16-4a29-4efd-b68d-1d6d7254b2aa None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:35.240525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 402/791] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:35.240525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec3e16-4a29-4efd-b68d-1d6d7254b2aa None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:35.246891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:35.260652 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 390/792] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:35 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:35.265113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f0e72-0aba-424a-a3c5-4fc905bdfa77 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:35.265113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f0e72-0aba-424a-a3c5-4fc905bdfa77 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:35.265113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f0e72-0aba-424a-a3c5-4fc905bdfa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:35.285026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-a73f0e72-0aba-424a-a3c5-4fc905bdfa77 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:35.287051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a73f0e72-0aba-424a-a3c5-4fc905bdfa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:35.366791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec3e16-4a29-4efd-b68d-1d6d7254b2aa None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:35.369715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 391/793] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:35 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:35.370907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f0e72-0aba-424a-a3c5-4fc905bdfa77 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:35.403761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:35.429001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff34943-27b1-49b0-aa91-687b6ff467d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:35.429924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff34943-27b1-49b0-aa91-687b6ff467d3 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:35.430399 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff34943-27b1-49b0-aa91-687b6ff467d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:35.430821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff34943-27b1-49b0-aa91-687b6ff467d3 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:35.431695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff34943-27b1-49b0-aa91-687b6ff467d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:35.432169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff34943-27b1-49b0-aa91-687b6ff467d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:35.433690 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff34943-27b1-49b0-aa91-687b6ff467d3 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:35.447658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 403/794] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:35.448744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff34943-27b1-49b0-aa91-687b6ff467d3 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:35.501762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f0e72-0aba-424a-a3c5-4fc905bdfa77 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:35.526470 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:35.555016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30078a5-8259-4e17-a6f4-9bb6324ae946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:35.556486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30078a5-8259-4e17-a6f4-9bb6324ae946 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:35.556863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30078a5-8259-4e17-a6f4-9bb6324ae946 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:35.557308 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30078a5-8259-4e17-a6f4-9bb6324ae946 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:35.562269 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30078a5-8259-4e17-a6f4-9bb6324ae946 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:35.562269 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30078a5-8259-4e17-a6f4-9bb6324ae946 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:35.585772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff34943-27b1-49b0-aa91-687b6ff467d3 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-b30078a5-8259-4e17-a6f4-9bb6324ae946 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:35.586105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:35.587189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:35.588026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:35.588026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:35.588026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:35.588026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:35.588026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:35.588026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:35.588026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:35.588026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:35.588026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:35.588026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:35.588026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:35.588026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:35.588026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:35.588026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:34:35.588026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:35.588854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 392/795] 10.222.0.112 () {56 vars in 1134 bytes} [Thu May 26 16:34:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:35.591091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dfbcc-4736-482d-836a-cd1d5bba2daf None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:35.591584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dfbcc-4736-482d-836a-cd1d5bba2daf None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:35.592073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dfbcc-4736-482d-836a-cd1d5bba2daf None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:35.594857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 393/796] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:35 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:35.596169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dfbcc-4736-482d-836a-cd1d5bba2daf None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:35.631692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375ed25-4bb0-453e-93b1-ef7259b19e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:35.632503 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375ed25-4bb0-453e-93b1-ef7259b19e53 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:35.632790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375ed25-4bb0-453e-93b1-ef7259b19e53 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:35.633069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375ed25-4bb0-453e-93b1-ef7259b19e53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:35.651935 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375ed25-4bb0-453e-93b1-ef7259b19e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-7375ed25-4bb0-453e-93b1-ef7259b19e53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:35.663350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:35.664326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:35.665237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:35.665237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:35.665237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:35.665237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:35.665237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:35.665237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:35.665237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:35.665237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:35.665237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:35.665237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:35.665237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:34:35.665237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:35.665237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 404/797] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:34:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:35.666171 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375ed25-4bb0-453e-93b1-ef7259b19e53 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:35.731792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:35.746563 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dfbcc-4736-482d-836a-cd1d5bba2daf None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:35.785137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255c0b1-8b6b-4b18-ae0f-611aae4749d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:35.786531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255c0b1-8b6b-4b18-ae0f-611aae4749d6 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:35.786942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255c0b1-8b6b-4b18-ae0f-611aae4749d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:35.787428 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255c0b1-8b6b-4b18-ae0f-611aae4749d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:35.796091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255c0b1-8b6b-4b18-ae0f-611aae4749d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:35.797565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255c0b1-8b6b-4b18-ae0f-611aae4749d6 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:35.813062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-7255c0b1-8b6b-4b18-ae0f-611aae4749d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:35.813062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:35.813062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:35.813062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:35.813062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:35.813062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:35.813062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:35.813062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:35.813062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:35.813062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:35.813062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:35.813062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:35.813062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:35.813062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:35.813062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:35.815117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:35.816937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:35.816937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:35.816937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:35.816937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:35.816937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:35.816937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:35.816937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:35.816937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:35.816937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 394/798] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:35.816937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69d541-5285-4a3b-af03-f5b0542fe53c None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:35.816937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69d541-5285-4a3b-af03-f5b0542fe53c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:35.820087 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69d541-5285-4a3b-af03-f5b0542fe53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:35.825001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375ed25-4bb0-453e-93b1-ef7259b19e53 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:35.838608 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-4f69d541-5285-4a3b-af03-f5b0542fe53c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:35.839936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4f69d541-5285-4a3b-af03-f5b0542fe53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:35.852353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:35.866201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a186b4-91f1-458f-807d-73835e841ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:35.867626 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a186b4-91f1-458f-807d-73835e841ec2 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:35.867934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a186b4-91f1-458f-807d-73835e841ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:35.868254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a186b4-91f1-458f-807d-73835e841ec2 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:35.869241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a186b4-91f1-458f-807d-73835e841ec2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:35.869554 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a186b4-91f1-458f-807d-73835e841ec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:35.871097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a186b4-91f1-458f-807d-73835e841ec2 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:35.877121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 405/799] 10.222.0.112 () {56 vars in 1129 bytes} [Thu May 26 16:34:35 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:35.877983 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a186b4-91f1-458f-807d-73835e841ec2 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:35.958589 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 395/800] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:35 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:35.960291 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69d541-5285-4a3b-af03-f5b0542fe53c None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:36.012832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a186b4-91f1-458f-807d-73835e841ec2 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:36.053283 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353f2b4-88e8-4a7f-b4a4-20552463455e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:36.053955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f2b4-88e8-4a7f-b4a4-20552463455e None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:36.054240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f2b4-88e8-4a7f-b4a4-20552463455e None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:36.054650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f2b4-88e8-4a7f-b4a4-20552463455e None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:36.055290 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353f2b4-88e8-4a7f-b4a4-20552463455e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:36.055596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353f2b4-88e8-4a7f-b4a4-20552463455e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:36.056972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353f2b4-88e8-4a7f-b4a4-20552463455e None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:36.058065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:36.067564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 406/801] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:34:35 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:36.073745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353f2b4-88e8-4a7f-b4a4-20552463455e None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:36.083553 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69d541-5285-4a3b-af03-f5b0542fe53c None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:36.124311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f4f49-0159-4c05-bb5e-54cefaa4b5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:36.124991 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f4f49-0159-4c05-bb5e-54cefaa4b5f3 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:36.125274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f4f49-0159-4c05-bb5e-54cefaa4b5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:36.125551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f4f49-0159-4c05-bb5e-54cefaa4b5f3 None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:36.126373 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f4f49-0159-4c05-bb5e-54cefaa4b5f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:36.126690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f4f49-0159-4c05-bb5e-54cefaa4b5f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:36.128141 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f4f49-0159-4c05-bb5e-54cefaa4b5f3 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:36.131655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:36.144055 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 396/802] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:36.145170 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f4f49-0159-4c05-bb5e-54cefaa4b5f3 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:36.210052 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353f2b4-88e8-4a7f-b4a4-20552463455e None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:36.260259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6befb64-c4e0-4f3a-bd72-7e71fd5eab33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:36.260934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6befb64-c4e0-4f3a-bd72-7e71fd5eab33 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:36.261218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6befb64-c4e0-4f3a-bd72-7e71fd5eab33 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:36.261488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6befb64-c4e0-4f3a-bd72-7e71fd5eab33 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:36.262197 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6befb64-c4e0-4f3a-bd72-7e71fd5eab33 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:36.262528 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6befb64-c4e0-4f3a-bd72-7e71fd5eab33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:36.263917 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6befb64-c4e0-4f3a-bd72-7e71fd5eab33 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:36.269369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 407/803] 10.222.0.112 () {56 vars in 1129 bytes} [Thu May 26 16:34:36 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:36.276968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6befb64-c4e0-4f3a-bd72-7e71fd5eab33 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:36.298845 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f4f49-0159-4c05-bb5e-54cefaa4b5f3 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:36.341101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6c78e-1841-4455-a4bc-398df3ba7b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:36.341914 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6c78e-1841-4455-a4bc-398df3ba7b88 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:36.342200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6c78e-1841-4455-a4bc-398df3ba7b88 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:36.342521 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6c78e-1841-4455-a4bc-398df3ba7b88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:36.359130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6c78e-1841-4455-a4bc-398df3ba7b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-81d6c78e-1841-4455-a4bc-398df3ba7b88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:36.367695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:36.368919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:36.369885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:36.369885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:36.369885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:36.369885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:36.369885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:36.369885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:36.369885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:36.369885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:36.369885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:36.369885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:36.369885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:36.369885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:36.369885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 397/804] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:36.369885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6c78e-1841-4455-a4bc-398df3ba7b88 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:36.378995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:36.411966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6befb64-c4e0-4f3a-bd72-7e71fd5eab33 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:36.430618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:36.460362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e806e9-2692-4e4b-b6d5-610d0c9554cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:36.461495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e806e9-2692-4e4b-b6d5-610d0c9554cc None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:36.461941 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e806e9-2692-4e4b-b6d5-610d0c9554cc None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:36.462422 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e806e9-2692-4e4b-b6d5-610d0c9554cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:36.479196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e806e9-2692-4e4b-b6d5-610d0c9554cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:36.480729 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e806e9-2692-4e4b-b6d5-610d0c9554cc None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:36.503601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-57e806e9-2692-4e4b-b6d5-610d0c9554cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:36.503601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:36.503601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:36.503601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:36.503601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:36.503601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:36.503601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:36.503601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:36.503601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:36.503601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:36.503601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:36.503601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:36.503601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:36.503601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:36.503601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:36.504640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:36.506160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:36.506160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:36.506160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:36.506160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:36.506160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 408/805] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:36.506160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e806e9-2692-4e4b-b6d5-610d0c9554cc None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:36.531522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6c78e-1841-4455-a4bc-398df3ba7b88 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:36.580438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3ebc1-61fc-492c-8854-96f87eed23af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:36.581495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3ebc1-61fc-492c-8854-96f87eed23af None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:36.581646 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3ebc1-61fc-492c-8854-96f87eed23af None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:36.581935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3ebc1-61fc-492c-8854-96f87eed23af None admin] PATH_INFO: `/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/465b269fc6ee415b8f5715843468d089/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:36.584878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3ebc1-61fc-492c-8854-96f87eed23af None admin] RBAC: Authorizing `identity:create_grant(project_id=9be90db8d7ee4bd0b01444d1eab83ad8, user_id=465b269fc6ee415b8f5715843468d089, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:36.586448 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3ebc1-61fc-492c-8854-96f87eed23af None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:36.637103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e806e9-2692-4e4b-b6d5-610d0c9554cc None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:36.673534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb1c01-9f2b-4bb1-b523-0449e1975662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:36.682587 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 398/806] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:34:36 2022] PUT /identity/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/465b269fc6ee415b8f5715843468d089/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:34:36.682804 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb1c01-9f2b-4bb1-b523-0449e1975662 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:36.682804 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb1c01-9f2b-4bb1-b523-0449e1975662 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:36.682804 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb1c01-9f2b-4bb1-b523-0449e1975662 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:36.683073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3ebc1-61fc-492c-8854-96f87eed23af None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:36.683159 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb1c01-9f2b-4bb1-b523-0449e1975662 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:36.683159 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb1c01-9f2b-4bb1-b523-0449e1975662 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:36.777485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 409/807] 10.222.0.112 () {60 vars in 1149 bytes} [Thu May 26 16:34:36 2022] POST /identity/v3/endpoints => generated 348 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:34:36.779006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb1c01-9f2b-4bb1-b523-0449e1975662 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:36.783730 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:36.831530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:36.861686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3ebc1-61fc-492c-8854-96f87eed23af None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:36.930833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc595f-0655-400b-94ff-17aded96789b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:36.931578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc595f-0655-400b-94ff-17aded96789b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:36.931906 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc595f-0655-400b-94ff-17aded96789b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:36.932167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc595f-0655-400b-94ff-17aded96789b None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:36.932901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc595f-0655-400b-94ff-17aded96789b None admin] RBAC: Adding query filter params (name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:36.933216 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc595f-0655-400b-94ff-17aded96789b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:36.935268 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc595f-0655-400b-94ff-17aded96789b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:36.945875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 399/808] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:34:36 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:36.947487 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2350b-f8ad-4072-9cec-32fccee8a437 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:36.947785 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2350b-f8ad-4072-9cec-32fccee8a437 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:36.948066 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2350b-f8ad-4072-9cec-32fccee8a437 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:36.949780 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 400/809] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:36.953444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2350b-f8ad-4072-9cec-32fccee8a437 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:36.959905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb1c01-9f2b-4bb1-b523-0449e1975662 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:37.015049 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175b943-0623-464b-a4eb-a6b24ed6559f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:37.016669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175b943-0623-464b-a4eb-a6b24ed6559f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:37.017383 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175b943-0623-464b-a4eb-a6b24ed6559f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:37.018219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175b943-0623-464b-a4eb-a6b24ed6559f None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:37.019994 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175b943-0623-464b-a4eb-a6b24ed6559f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:37.020950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175b943-0623-464b-a4eb-a6b24ed6559f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:37.024221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175b943-0623-464b-a4eb-a6b24ed6559f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:37.042067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 410/810] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:37.043689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8da7c-82ad-4726-8e29-7d045fba8863 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:37.044170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8da7c-82ad-4726-8e29-7d045fba8863 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:37.044623 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8da7c-82ad-4726-8e29-7d045fba8863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:37.063291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-c1e8da7c-82ad-4726-8e29-7d045fba8863 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:37.065926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c1e8da7c-82ad-4726-8e29-7d045fba8863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:37.116067 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2350b-f8ad-4072-9cec-32fccee8a437 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:37.142781 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:37.158466 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb306fa2-5240-4795-8dc7-4321a0a18635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:37.159733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb306fa2-5240-4795-8dc7-4321a0a18635 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:37.160213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb306fa2-5240-4795-8dc7-4321a0a18635 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:37.162341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb306fa2-5240-4795-8dc7-4321a0a18635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:37.172057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 411/811] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:37 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:37.173425 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8da7c-82ad-4726-8e29-7d045fba8863 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:37.173543 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb306fa2-5240-4795-8dc7-4321a0a18635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:37.175073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb306fa2-5240-4795-8dc7-4321a0a18635 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:37.192737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:37.196324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-bb306fa2-5240-4795-8dc7-4321a0a18635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:37.196324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:37.196324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:37.196324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:37.196324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:37.196324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:37.196324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:37.196324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:37.196324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:37.196324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:37.196324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:37.196324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:37.196324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:37.196324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:37.196324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:37.197451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:37.198733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:37.198733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:37.198733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:37.198733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:37.205757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 401/812] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:34:37.211221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb306fa2-5240-4795-8dc7-4321a0a18635 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:37.319343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8da7c-82ad-4726-8e29-7d045fba8863 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:37.345534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb306fa2-5240-4795-8dc7-4321a0a18635 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:37.357180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39feeb-85fb-4aa9-9fc9-a2f7184de0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:37.357981 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39feeb-85fb-4aa9-9fc9-a2f7184de0c6 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:37.358271 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39feeb-85fb-4aa9-9fc9-a2f7184de0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:37.358614 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39feeb-85fb-4aa9-9fc9-a2f7184de0c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:37.368524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39feeb-85fb-4aa9-9fc9-a2f7184de0c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:37.370110 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39feeb-85fb-4aa9-9fc9-a2f7184de0c6 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:37.384172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d815101-578a-42dc-a4ff-e1cc09431af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:37.385233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815101-578a-42dc-a4ff-e1cc09431af5 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-1c39feeb-85fb-4aa9-9fc9-a2f7184de0c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:37.385578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:37.386522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:37.387437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:37.387437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:37.387437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:37.387437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:37.387437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:37.387437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:37.387437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:37.387437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:37.387437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:34:37.387437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:37.387437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 412/813] 10.222.0.112 () {56 vars in 1098 bytes} [Thu May 26 16:34:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:37.388699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39feeb-85fb-4aa9-9fc9-a2f7184de0c6 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:37.389101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815101-578a-42dc-a4ff-e1cc09431af5 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:37.389671 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815101-578a-42dc-a4ff-e1cc09431af5 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:37.390698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d815101-578a-42dc-a4ff-e1cc09431af5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:37.391237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d815101-578a-42dc-a4ff-e1cc09431af5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:37.393108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d815101-578a-42dc-a4ff-e1cc09431af5 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:37.412705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 402/814] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:37.413984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d815101-578a-42dc-a4ff-e1cc09431af5 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:37.460371 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:37.470717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:37.514536 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39feeb-85fb-4aa9-9fc9-a2f7184de0c6 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:37.533816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d815101-578a-42dc-a4ff-e1cc09431af5 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:37.571453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2bdab-11bf-4ec9-8c0f-3554ee669c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:37.573200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2bdab-11bf-4ec9-8c0f-3554ee669c69 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:37.573673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2bdab-11bf-4ec9-8c0f-3554ee669c69 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:37.574400 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2bdab-11bf-4ec9-8c0f-3554ee669c69 None admin] PATH_INFO: `/v3/services/network` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:37.575663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2bdab-11bf-4ec9-8c0f-3554ee669c69 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:37.577583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2bdab-11bf-4ec9-8c0f-3554ee669c69 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:37.580310 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0636077-9966-4fa8-8db0-684c59331c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:37.581242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0636077-9966-4fa8-8db0-684c59331c9d None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:37.581370 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0636077-9966-4fa8-8db0-684c59331c9d None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:37.581711 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0636077-9966-4fa8-8db0-684c59331c9d None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:37.583173 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0636077-9966-4fa8-8db0-684c59331c9d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:37.583635 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0636077-9966-4fa8-8db0-684c59331c9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:37.585286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0636077-9966-4fa8-8db0-684c59331c9d None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-4eb2bdab-11bf-4ec9-8c0f-3554ee669c69 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:37.594494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:37.595559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:37.596402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:37.596402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:37.596402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:37.596402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:37.596402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:37.596402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:37.596402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:37.596402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:37.596402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:37.596402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:37.596402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:37.596402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:37.596402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:34:37.596402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:37.600341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 413/815] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:37 2022] GET /identity/v3/services/network => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:37.601492 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2bdab-11bf-4ec9-8c0f-3554ee669c69 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:37.613725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 403/816] 10.222.0.112 () {56 vars in 1138 bytes} [Thu May 26 16:34:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:37.615953 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0636077-9966-4fa8-8db0-684c59331c9d None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:37.720867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:37.736504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0636077-9966-4fa8-8db0-684c59331c9d None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:37.741136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2bdab-11bf-4ec9-8c0f-3554ee669c69 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:37.778240 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ada16-39d2-441e-8d08-9c1a045d5d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:37.779550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ada16-39d2-441e-8d08-9c1a045d5d8c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:37.780121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ada16-39d2-441e-8d08-9c1a045d5d8c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:37.780697 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ada16-39d2-441e-8d08-9c1a045d5d8c None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:37.782031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec504075-07d1-4314-b656-ae0b94c69486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:37.782193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ada16-39d2-441e-8d08-9c1a045d5d8c None admin] RBAC: Adding query filter params (name=network) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:37.782843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ada16-39d2-441e-8d08-9c1a045d5d8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:37.783351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec504075-07d1-4314-b656-ae0b94c69486 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:37.783785 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec504075-07d1-4314-b656-ae0b94c69486 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:37.784208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec504075-07d1-4314-b656-ae0b94c69486 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:37.786458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ada16-39d2-441e-8d08-9c1a045d5d8c None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:37.789225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:37.795468 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 404/817] 10.222.0.112 () {56 vars in 1117 bytes} [Thu May 26 16:34:37 2022] GET /identity/v3/services?name=network => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:37.796059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec504075-07d1-4314-b656-ae0b94c69486 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:37.796775 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ada16-39d2-441e-8d08-9c1a045d5d8c None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:37.797895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec504075-07d1-4314-b656-ae0b94c69486 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-ec504075-07d1-4314-b656-ae0b94c69486 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:37.815610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:37.816594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:37.818216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:37.818216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:37.818216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:37.818216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:37.818216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:37.818216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:37.818216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:37.818216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:37.818216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:34:37.818216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:37.821513 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 414/818] 10.222.0.112 () {56 vars in 1122 bytes} [Thu May 26 16:34:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:37.822568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec504075-07d1-4314-b656-ae0b94c69486 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:37.929954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ada16-39d2-441e-8d08-9c1a045d5d8c None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:37.938132 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec504075-07d1-4314-b656-ae0b94c69486 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:37.979943 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86860a-6bd6-46f8-8f66-e2c75b9a96a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:37.981013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86860a-6bd6-46f8-8f66-e2c75b9a96a1 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:37.981484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86860a-6bd6-46f8-8f66-e2c75b9a96a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:37.981942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86860a-6bd6-46f8-8f66-e2c75b9a96a1 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:37.982899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86860a-6bd6-46f8-8f66-e2c75b9a96a1 None admin] RBAC: Adding query filter params (type=network) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:37.983413 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86860a-6bd6-46f8-8f66-e2c75b9a96a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:37.984243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32cc53-69b3-4d29-8f0d-ba93e22fef00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:37.985197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32cc53-69b3-4d29-8f0d-ba93e22fef00 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:37.985523 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86860a-6bd6-46f8-8f66-e2c75b9a96a1 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:37.985642 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32cc53-69b3-4d29-8f0d-ba93e22fef00 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:37.986167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32cc53-69b3-4d29-8f0d-ba93e22fef00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:37.992458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 415/819] 10.222.0.112 () {56 vars in 1117 bytes} [Thu May 26 16:34:37 2022] GET /identity/v3/services?type=network => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:37.993590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86860a-6bd6-46f8-8f66-e2c75b9a96a1 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:38.027040 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:38.066416 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:38.103864 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32cc53-69b3-4d29-8f0d-ba93e22fef00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:38.106244 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32cc53-69b3-4d29-8f0d-ba93e22fef00 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:38.119990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86860a-6bd6-46f8-8f66-e2c75b9a96a1 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:38.160598 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a7799-90e7-4a68-b6cb-bec6eeca9d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:38.161843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a7799-90e7-4a68-b6cb-bec6eeca9d90 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:38.162453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a7799-90e7-4a68-b6cb-bec6eeca9d90 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:38.162919 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a7799-90e7-4a68-b6cb-bec6eeca9d90 None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:38.164203 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a7799-90e7-4a68-b6cb-bec6eeca9d90 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:38.164864 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a7799-90e7-4a68-b6cb-bec6eeca9d90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:38.166558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a7799-90e7-4a68-b6cb-bec6eeca9d90 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:38.190081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 416/820] 10.222.0.112 () {56 vars in 1154 bytes} [Thu May 26 16:34:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:38.191383 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a7799-90e7-4a68-b6cb-bec6eeca9d90 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:38.286538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 405/821] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:34:37 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:34:38.287770 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32cc53-69b3-4d29-8f0d-ba93e22fef00 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:38.352541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a7799-90e7-4a68-b6cb-bec6eeca9d90 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:38.372222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:38.378345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:38.400041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d214d99-ff18-4531-824b-a836a2e0519b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:38.400729 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d214d99-ff18-4531-824b-a836a2e0519b None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:38.401058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d214d99-ff18-4531-824b-a836a2e0519b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:38.401328 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d214d99-ff18-4531-824b-a836a2e0519b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:38.402069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d214d99-ff18-4531-824b-a836a2e0519b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:38.403469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d214d99-ff18-4531-824b-a836a2e0519b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:38.423976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32cc53-69b3-4d29-8f0d-ba93e22fef00 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:38.467050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ab012-460d-4752-80c6-025f5da08078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:38.468673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ab012-460d-4752-80c6-025f5da08078 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:38.469313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ab012-460d-4752-80c6-025f5da08078 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:38.469854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ab012-460d-4752-80c6-025f5da08078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:38.483009 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ab012-460d-4752-80c6-025f5da08078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:38.484788 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ab012-460d-4752-80c6-025f5da08078 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:38.505485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-b55ab012-460d-4752-80c6-025f5da08078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:38.505485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:38.505485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:38.505485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:38.505485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:38.505485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:38.505485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:38.505485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:38.505485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:38.505485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:38.505485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:38.505485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:38.505485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:38.505485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:38.505485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:38.506852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:38.507760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:38.507760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:38.507760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:38.507760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:38.509985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 406/823] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:38.511129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ab012-460d-4752-80c6-025f5da08078 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:38.518937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 417/823] 10.222.0.112 () {60 vars in 1149 bytes} [Thu May 26 16:34:38 2022] POST /identity/v3/endpoints => generated 329 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:34:38.525510 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d214d99-ff18-4531-824b-a836a2e0519b None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:38.745203 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d214d99-ff18-4531-824b-a836a2e0519b None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:38.797439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ab012-460d-4752-80c6-025f5da08078 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:38.802133 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340d5d5-13cc-45db-9447-ef0836e41599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:38.803265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340d5d5-13cc-45db-9447-ef0836e41599 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:38.803749 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340d5d5-13cc-45db-9447-ef0836e41599 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:38.804243 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340d5d5-13cc-45db-9447-ef0836e41599 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:38.806363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340d5d5-13cc-45db-9447-ef0836e41599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:38.806947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340d5d5-13cc-45db-9447-ef0836e41599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:38.809758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340d5d5-13cc-45db-9447-ef0836e41599 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:38.816535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:38.831799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 418/824] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:38.839553 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340d5d5-13cc-45db-9447-ef0836e41599 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:38.863347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3852f7d-44ff-4a2f-b92a-c15d709d3eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:38.865071 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3852f7d-44ff-4a2f-b92a-c15d709d3eb2 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:38.865581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3852f7d-44ff-4a2f-b92a-c15d709d3eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:38.866038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3852f7d-44ff-4a2f-b92a-c15d709d3eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:38.876242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:38.880040 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3852f7d-44ff-4a2f-b92a-c15d709d3eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:38.881792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3852f7d-44ff-4a2f-b92a-c15d709d3eb2 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:38.902747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-d3852f7d-44ff-4a2f-b92a-c15d709d3eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:38.902747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:38.902747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:38.902747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:38.902747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:38.902747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:38.902747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:38.902747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:38.902747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:38.902747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:38.902747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:38.902747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:38.902747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:38.902747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:38.902747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:38.911792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:38.913229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:38.913229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:38.913229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:38.913229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:38.913229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 407/825] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:38.913229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3852f7d-44ff-4a2f-b92a-c15d709d3eb2 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:38.972594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340d5d5-13cc-45db-9447-ef0836e41599 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:39.013102 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbd1ed-13cb-4bce-a3b6-f62c99fbd9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:39.013361 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbd1ed-13cb-4bce-a3b6-f62c99fbd9fa None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:39.013579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbd1ed-13cb-4bce-a3b6-f62c99fbd9fa None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:39.013856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbd1ed-13cb-4bce-a3b6-f62c99fbd9fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:39.022254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbd1ed-13cb-4bce-a3b6-f62c99fbd9fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:39.023830 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbd1ed-13cb-4bce-a3b6-f62c99fbd9fa None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:39.044936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-38fbd1ed-13cb-4bce-a3b6-f62c99fbd9fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:39.044936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:39.044936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:39.044936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:39.044936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:39.044936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:39.044936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:39.044936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:39.044936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:39.044936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:39.044936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:39.044936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:39.044936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:39.044936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:39.044936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:39.045956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:39.046894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:39.046894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:39.046894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:39.046894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:39.046894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:39.046894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:39.046894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:39.046894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:39.050511 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 419/826] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:39.052812 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbd1ed-13cb-4bce-a3b6-f62c99fbd9fa None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:39.059245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3852f7d-44ff-4a2f-b92a-c15d709d3eb2 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:39.099054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4cd8e-a661-4196-887a-a5e9baad7570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:39.099786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4cd8e-a661-4196-887a-a5e9baad7570 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:39.100072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4cd8e-a661-4196-887a-a5e9baad7570 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:39.100352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4cd8e-a661-4196-887a-a5e9baad7570 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:39.101109 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4cd8e-a661-4196-887a-a5e9baad7570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:39.101459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4cd8e-a661-4196-887a-a5e9baad7570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:39.104129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4cd8e-a661-4196-887a-a5e9baad7570 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:39.125696 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 408/827] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:39.132091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4cd8e-a661-4196-887a-a5e9baad7570 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:39.162591 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:39.184782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:39.197804 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbd1ed-13cb-4bce-a3b6-f62c99fbd9fa None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:39.241792 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b62823-044a-44e5-9935-3ba06c632031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:39.243381 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b62823-044a-44e5-9935-3ba06c632031 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:39.243938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b62823-044a-44e5-9935-3ba06c632031 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:39.244435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b62823-044a-44e5-9935-3ba06c632031 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:39.245821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b62823-044a-44e5-9935-3ba06c632031 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:39.246395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b62823-044a-44e5-9935-3ba06c632031 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:39.248727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b62823-044a-44e5-9935-3ba06c632031 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:39.265975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 420/828] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:39.270189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4cd8e-a661-4196-887a-a5e9baad7570 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:39.274566 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b62823-044a-44e5-9935-3ba06c632031 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:39.313282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16fd64-8927-4600-972b-1902e48f2282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:39.314963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16fd64-8927-4600-972b-1902e48f2282 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:39.315348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16fd64-8927-4600-972b-1902e48f2282 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:39.315631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16fd64-8927-4600-972b-1902e48f2282 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:39.326940 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16fd64-8927-4600-972b-1902e48f2282 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:39.330023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16fd64-8927-4600-972b-1902e48f2282 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:39.352528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-0d16fd64-8927-4600-972b-1902e48f2282 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:39.352528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:39.352528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:39.352528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:39.352528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:39.352528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:39.352528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:39.352528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:39.352528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:39.352528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:39.352528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:39.352528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:39.352528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:39.352528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:39.352528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:39.354351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:39.355279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:39.355279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:39.355279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:39.355279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:39.355279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:39.355279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:39.355279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:39.355279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:39.355279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 409/829] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:39.355279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e717efd-6dc7-4786-b853-70b823ef48d5 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:39.355917 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e717efd-6dc7-4786-b853-70b823ef48d5 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:39.355917 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e717efd-6dc7-4786-b853-70b823ef48d5 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:39.356841 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 410/830] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:39.357916 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38e3e8-a8c4-403c-b6cd-ab039a66bb04 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:39.358189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38e3e8-a8c4-403c-b6cd-ab039a66bb04 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:39.358492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38e3e8-a8c4-403c-b6cd-ab039a66bb04 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:39.359949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 411/831] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:39 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:39.360846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38e3e8-a8c4-403c-b6cd-ab039a66bb04 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:39.411579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b62823-044a-44e5-9935-3ba06c632031 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:39.450608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15db114-e8a2-4a6d-8295-f80037d56456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:39.451503 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15db114-e8a2-4a6d-8295-f80037d56456 None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:39.451788 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15db114-e8a2-4a6d-8295-f80037d56456 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:39.452067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15db114-e8a2-4a6d-8295-f80037d56456 None admin] PATH_INFO: `/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/06f2efcb8c6646658934a3ab55ab5744/roles/64acd9118f3d4931be8ca4bfa4ae907e` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:39.462063 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:39.471069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15db114-e8a2-4a6d-8295-f80037d56456 None admin] RBAC: Authorizing `identity:create_grant(project_id=9be90db8d7ee4bd0b01444d1eab83ad8, user_id=06f2efcb8c6646658934a3ab55ab5744, role_id=64acd9118f3d4931be8ca4bfa4ae907e)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:39.472518 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15db114-e8a2-4a6d-8295-f80037d56456 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:39.487321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38e3e8-a8c4-403c-b6cd-ab039a66bb04 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:39.523848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d0f48-d8a9-49ac-a5eb-ef5fdad9fb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:39.524434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d0f48-d8a9-49ac-a5eb-ef5fdad9fb67 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:39.524723 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d0f48-d8a9-49ac-a5eb-ef5fdad9fb67 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:39.525000 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d0f48-d8a9-49ac-a5eb-ef5fdad9fb67 None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:39.525792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d0f48-d8a9-49ac-a5eb-ef5fdad9fb67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:39.526107 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d0f48-d8a9-49ac-a5eb-ef5fdad9fb67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:39.527583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d0f48-d8a9-49ac-a5eb-ef5fdad9fb67 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:39.540183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 412/832] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:39.541549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed8b50-3cd9-4e28-87bf-e7feed207bd6 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:39.541982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed8b50-3cd9-4e28-87bf-e7feed207bd6 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:39.542757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed8b50-3cd9-4e28-87bf-e7feed207bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:39.559535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-57ed8b50-3cd9-4e28-87bf-e7feed207bd6 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:39.560747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-57ed8b50-3cd9-4e28-87bf-e7feed207bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:39.612219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:39.617171 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 421/833] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:34:39 2022] PUT /identity/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/06f2efcb8c6646658934a3ab55ab5744/roles/64acd9118f3d4931be8ca4bfa4ae907e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:34:39.618530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290518c-c926-4003-baad-c8e29fed4d51 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:39.618825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290518c-c926-4003-baad-c8e29fed4d51 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:39.619098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290518c-c926-4003-baad-c8e29fed4d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:39.637627 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-3290518c-c926-4003-baad-c8e29fed4d51 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:39.638878 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-3290518c-c926-4003-baad-c8e29fed4d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:39.643663 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 413/834] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:39 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:39.645590 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed8b50-3cd9-4e28-87bf-e7feed207bd6 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:39.734019 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 422/835] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:39 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:39.735082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290518c-c926-4003-baad-c8e29fed4d51 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:39.758665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:39.801715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed8b50-3cd9-4e28-87bf-e7feed207bd6 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:39.833110 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597d33b-b426-4536-ac03-a97bc6c3e6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:39.833789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d33b-b426-4536-ac03-a97bc6c3e6a4 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:39.834071 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d33b-b426-4536-ac03-a97bc6c3e6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:39.834366 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d33b-b426-4536-ac03-a97bc6c3e6a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:39.835229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597d33b-b426-4536-ac03-a97bc6c3e6a4 None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=5f2ec4c76f8f4d858bce53f30cc198fa) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:39.835543 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597d33b-b426-4536-ac03-a97bc6c3e6a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:39.837008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597d33b-b426-4536-ac03-a97bc6c3e6a4 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:39.844938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 414/836] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:39 2022] GET /identity/v3/role_assignments?user.id=5f2ec4c76f8f4d858bce53f30cc198fa&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 610 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:39.845905 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597d33b-b426-4536-ac03-a97bc6c3e6a4 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:39.880078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290518c-c926-4003-baad-c8e29fed4d51 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:39.928322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7ccdb-5e01-4f1a-a8a6-ee537fcede4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:39.929419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7ccdb-5e01-4f1a-a8a6-ee537fcede4e None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:39.929835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7ccdb-5e01-4f1a-a8a6-ee537fcede4e None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:39.930213 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7ccdb-5e01-4f1a-a8a6-ee537fcede4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:39.947313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7ccdb-5e01-4f1a-a8a6-ee537fcede4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-4ef7ccdb-5e01-4f1a-a8a6-ee537fcede4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:39.955592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:39.956819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:39.957950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:39.957950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:39.957950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:39.957950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:39.957950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:39.957950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:39.957950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:39.957950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:39.957950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:39.957950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:39.957950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:34:39.957950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:39.960553 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 423/837] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:34:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:39.966230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7ccdb-5e01-4f1a-a8a6-ee537fcede4e None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:39.988347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597d33b-b426-4536-ac03-a97bc6c3e6a4 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:40.034879 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:40.041801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d09932-734c-4ad0-85d2-12896fae80eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:40.042477 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d09932-734c-4ad0-85d2-12896fae80eb None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:40.042775 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d09932-734c-4ad0-85d2-12896fae80eb None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:40.043048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d09932-734c-4ad0-85d2-12896fae80eb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:40.043862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d09932-734c-4ad0-85d2-12896fae80eb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:40.045275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d09932-734c-4ad0-85d2-12896fae80eb None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:40.058362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-c4d09932-734c-4ad0-85d2-12896fae80eb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:40.061130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:40.063181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:40.064817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:40.064817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:40.064817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:40.064817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:40.064817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:40.064817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:40.064817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:40.064817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:40.064817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:40.064817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:40.064817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:40.064817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:40.064817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:34:40.064817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:40.064817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 415/838] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:34:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:40.072026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d09932-734c-4ad0-85d2-12896fae80eb None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:40.112149 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7ccdb-5e01-4f1a-a8a6-ee537fcede4e None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:40.157412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75cdc2-d7d6-4898-a865-d1c7908106f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:40.158100 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75cdc2-d7d6-4898-a865-d1c7908106f8 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:40.158661 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75cdc2-d7d6-4898-a865-d1c7908106f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:40.159133 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75cdc2-d7d6-4898-a865-d1c7908106f8 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:40.160784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75cdc2-d7d6-4898-a865-d1c7908106f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:40.161186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75cdc2-d7d6-4898-a865-d1c7908106f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:40.162784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75cdc2-d7d6-4898-a865-d1c7908106f8 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:40.175037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 424/839] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:34:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:40.182029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75cdc2-d7d6-4898-a865-d1c7908106f8 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:40.229268 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d09932-734c-4ad0-85d2-12896fae80eb None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:40.271847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:40.278646 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b4e07-1355-4b7f-8ec9-8674119a0dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:40.279377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b4e07-1355-4b7f-8ec9-8674119a0dbd None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:40.279890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b4e07-1355-4b7f-8ec9-8674119a0dbd None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:40.280230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b4e07-1355-4b7f-8ec9-8674119a0dbd None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:40.280965 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b4e07-1355-4b7f-8ec9-8674119a0dbd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:40.281281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b4e07-1355-4b7f-8ec9-8674119a0dbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:40.282714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b4e07-1355-4b7f-8ec9-8674119a0dbd None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:40.288378 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 416/840] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:34:40 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:40.293939 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b4e07-1355-4b7f-8ec9-8674119a0dbd None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:40.340443 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75cdc2-d7d6-4898-a865-d1c7908106f8 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:40.377053 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:40.404537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc93bd9-1b61-48e0-8cb7-55ed12dfb349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:40.405942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc93bd9-1b61-48e0-8cb7-55ed12dfb349 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:40.406485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc93bd9-1b61-48e0-8cb7-55ed12dfb349 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:40.407079 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc93bd9-1b61-48e0-8cb7-55ed12dfb349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:40.423182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc93bd9-1b61-48e0-8cb7-55ed12dfb349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:40.425681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc93bd9-1b61-48e0-8cb7-55ed12dfb349 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:40.430910 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b4e07-1355-4b7f-8ec9-8674119a0dbd None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:40.446087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-2dc93bd9-1b61-48e0-8cb7-55ed12dfb349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:40.446087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:40.446087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:40.446087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:40.446087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:40.446087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:40.446087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:40.446087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:40.446087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:40.446087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:40.446087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:40.446087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:40.446087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:40.446087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:40.446087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:40.447040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:40.448014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:40.448014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:40.448014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:40.448014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:40.450846 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 425/841] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:40.456952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc93bd9-1b61-48e0-8cb7-55ed12dfb349 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:40.491081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6bc75-c08c-45e1-bece-0764f1e35415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:40.491769 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6bc75-c08c-45e1-bece-0764f1e35415 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:40.492585 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6bc75-c08c-45e1-bece-0764f1e35415 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:40.492881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6bc75-c08c-45e1-bece-0764f1e35415 None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:40.493618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6bc75-c08c-45e1-bece-0764f1e35415 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:40.494173 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6bc75-c08c-45e1-bece-0764f1e35415 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:40.495686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6bc75-c08c-45e1-bece-0764f1e35415 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:40.503620 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 417/842] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:34:40 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:40.588161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc93bd9-1b61-48e0-8cb7-55ed12dfb349 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:40.591293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:40.631497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e877813-3d1c-4eba-9443-80d19ac7e769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:40.632531 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e877813-3d1c-4eba-9443-80d19ac7e769 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:40.633000 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e877813-3d1c-4eba-9443-80d19ac7e769 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:40.633453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e877813-3d1c-4eba-9443-80d19ac7e769 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:40.634399 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e877813-3d1c-4eba-9443-80d19ac7e769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:40.634931 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e877813-3d1c-4eba-9443-80d19ac7e769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:40.636515 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e877813-3d1c-4eba-9443-80d19ac7e769 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:40.652720 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 426/843] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:40.659573 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6bc75-c08c-45e1-bece-0764f1e35415 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:40.792943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6bc75-c08c-45e1-bece-0764f1e35415 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:40.830777 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:40.846761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af010d2f-20a1-4ab2-a04e-a1b86750daa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:40.846761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af010d2f-20a1-4ab2-a04e-a1b86750daa7 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:40.846761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af010d2f-20a1-4ab2-a04e-a1b86750daa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:40.846761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af010d2f-20a1-4ab2-a04e-a1b86750daa7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:40.853582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af010d2f-20a1-4ab2-a04e-a1b86750daa7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:40.855111 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af010d2f-20a1-4ab2-a04e-a1b86750daa7 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-af010d2f-20a1-4ab2-a04e-a1b86750daa7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:40.872493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:40.874598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:40.876127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:40.876127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:40.876127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:40.876127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:40.876127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:40.876127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:40.876127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:40.876127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:40.876127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:34:40.876127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:40.876127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 418/844] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:34:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:40.880501 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e877813-3d1c-4eba-9443-80d19ac7e769 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:41.037165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e877813-3d1c-4eba-9443-80d19ac7e769 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:41.083591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af58af-2f45-41bf-b526-585c1f0487e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:41.084281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af58af-2f45-41bf-b526-585c1f0487e2 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:41.084660 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af58af-2f45-41bf-b526-585c1f0487e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:41.085174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af58af-2f45-41bf-b526-585c1f0487e2 None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:41.086518 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af58af-2f45-41bf-b526-585c1f0487e2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:41.086940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af58af-2f45-41bf-b526-585c1f0487e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:41.088642 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af58af-2f45-41bf-b526-585c1f0487e2 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:41.110556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 427/845] 10.222.0.112 () {56 vars in 1140 bytes} [Thu May 26 16:34:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:41.119536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af010d2f-20a1-4ab2-a04e-a1b86750daa7 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:41.261100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af010d2f-20a1-4ab2-a04e-a1b86750daa7 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:41.315071 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87875551-b686-4836-8b3d-e832975b0e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:41.316449 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87875551-b686-4836-8b3d-e832975b0e68 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:41.317364 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87875551-b686-4836-8b3d-e832975b0e68 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:41.318059 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87875551-b686-4836-8b3d-e832975b0e68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:41.399367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:41.409134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87875551-b686-4836-8b3d-e832975b0e68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:41.411724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87875551-b686-4836-8b3d-e832975b0e68 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:41.548693 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 419/846] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:34:41 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:34:41.555639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af58af-2f45-41bf-b526-585c1f0487e2 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:41.592455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:41.682784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af58af-2f45-41bf-b526-585c1f0487e2 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:41.724498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3dd3c-ac1f-4beb-8d05-5678ddeea8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:41.725892 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3dd3c-ac1f-4beb-8d05-5678ddeea8ca None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:41.726405 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3dd3c-ac1f-4beb-8d05-5678ddeea8ca None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:41.726909 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3dd3c-ac1f-4beb-8d05-5678ddeea8ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:41.740604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3dd3c-ac1f-4beb-8d05-5678ddeea8ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:41.743186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3dd3c-ac1f-4beb-8d05-5678ddeea8ca None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:41.769689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-2dd3dd3c-ac1f-4beb-8d05-5678ddeea8ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:41.769689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:41.769689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:41.769689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:41.769689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:41.769689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:41.769689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:41.769689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:41.769689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:41.769689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:41.769689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:41.769689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:41.769689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:41.769689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:41.769689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:41.770702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:41.771601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:41.771601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:41.771601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:41.771601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:41.773469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 428/847] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:41.779567 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87875551-b686-4836-8b3d-e832975b0e68 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:41.886995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:41.907144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87875551-b686-4836-8b3d-e832975b0e68 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:41.963878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da841f-81bf-436c-a6b7-096efd8c4daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:41.964469 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da841f-81bf-436c-a6b7-096efd8c4daf None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:41.964755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da841f-81bf-436c-a6b7-096efd8c4daf None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:41.965037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da841f-81bf-436c-a6b7-096efd8c4daf None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:41.965781 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da841f-81bf-436c-a6b7-096efd8c4daf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:41.966090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da841f-81bf-436c-a6b7-096efd8c4daf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:41.967537 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da841f-81bf-436c-a6b7-096efd8c4daf None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:41.982569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 420/848] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:41.988119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3dd3c-ac1f-4beb-8d05-5678ddeea8ca None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:42.100060 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:42.141690 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3dd3c-ac1f-4beb-8d05-5678ddeea8ca None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:42.170515 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702c6a2-9db3-4afd-92a0-dbd438d4480d None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:42.170845 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702c6a2-9db3-4afd-92a0-dbd438d4480d None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:42.171096 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702c6a2-9db3-4afd-92a0-dbd438d4480d None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:42.172777 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 421/849] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:34:42.178558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5abf23-660b-4a4c-a812-8e7516426ade None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:42.179017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5abf23-660b-4a4c-a812-8e7516426ade None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:42.179346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5abf23-660b-4a4c-a812-8e7516426ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:42.190956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b5a33-993c-4382-9734-11cf0c5e9a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:42.192357 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b5a33-993c-4382-9734-11cf0c5e9a53 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:42.192648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b5a33-993c-4382-9734-11cf0c5e9a53 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:42.192924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b5a33-993c-4382-9734-11cf0c5e9a53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:42.202081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b5a33-993c-4382-9734-11cf0c5e9a53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:42.203773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b5a33-993c-4382-9734-11cf0c5e9a53 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:42.206081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-1b5abf23-660b-4a4c-a812-8e7516426ade None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:42.208266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1b5abf23-660b-4a4c-a812-8e7516426ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:42.220741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-5f4b5a33-993c-4382-9734-11cf0c5e9a53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:42.220741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:42.220741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:42.220741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:42.220741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:42.220741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:42.220741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:42.220741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:42.220741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:42.220741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:42.220741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:42.220741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:42.220741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:42.220741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:42.220741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:42.222021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:42.224894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:42.224894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:42.224894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:42.224894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:42.224894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:42.224894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:42.224894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:42.224894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:42.224894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 429/850] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:42.228796 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b5a33-993c-4382-9734-11cf0c5e9a53 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:42.324063 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 422/851] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:42 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:34:42.346850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b5a33-993c-4382-9734-11cf0c5e9a53 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:42.348885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5abf23-660b-4a4c-a812-8e7516426ade None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:42.394136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8aa7a-0720-442e-8600-6c7438fc9bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:42.395886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8aa7a-0720-442e-8600-6c7438fc9bc1 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:42.396275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8aa7a-0720-442e-8600-6c7438fc9bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:42.396610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8aa7a-0720-442e-8600-6c7438fc9bc1 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:42.398017 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8aa7a-0720-442e-8600-6c7438fc9bc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:42.398597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8aa7a-0720-442e-8600-6c7438fc9bc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:42.402686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8aa7a-0720-442e-8600-6c7438fc9bc1 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:42.407133 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:42.434431 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 430/852] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:42.437643 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8aa7a-0720-442e-8600-6c7438fc9bc1 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:42.448128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:42.484929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5abf23-660b-4a4c-a812-8e7516426ade None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:42.557282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626e6b9-9342-4a2c-bca0-17943906958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:42.558594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626e6b9-9342-4a2c-bca0-17943906958e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:42.558956 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626e6b9-9342-4a2c-bca0-17943906958e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:42.559391 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626e6b9-9342-4a2c-bca0-17943906958e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:42.575008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626e6b9-9342-4a2c-bca0-17943906958e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-0626e6b9-9342-4a2c-bca0-17943906958e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:42.584885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:42.585938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:42.587037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:42.587037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:42.587037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:42.587037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:42.587037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:42.587037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:42.587037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:42.587037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:42.587037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:42.587037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:42.587037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:34:42.587037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:42.587037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 423/853] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:34:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:34:42.592155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626e6b9-9342-4a2c-bca0-17943906958e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:42.612636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8aa7a-0720-442e-8600-6c7438fc9bc1 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:42.671374 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c069547-7d11-43e3-aaff-fb7d8ed2e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:42.671374 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c069547-7d11-43e3-aaff-fb7d8ed2e052 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:42.675686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c069547-7d11-43e3-aaff-fb7d8ed2e052 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:42.675686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c069547-7d11-43e3-aaff-fb7d8ed2e052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:42.675686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c069547-7d11-43e3-aaff-fb7d8ed2e052 None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=465b269fc6ee415b8f5715843468d089) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:42.675686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c069547-7d11-43e3-aaff-fb7d8ed2e052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:42.675686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c069547-7d11-43e3-aaff-fb7d8ed2e052 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:42.686730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 431/854] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:42 2022] GET /identity/v3/role_assignments?user.id=465b269fc6ee415b8f5715843468d089&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 610 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:42.686730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104ee2b-b395-421f-bf93-041d48e629be None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:42.686730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104ee2b-b395-421f-bf93-041d48e629be None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:42.686730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104ee2b-b395-421f-bf93-041d48e629be None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:42.691241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 432/855] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:42 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:42.692118 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071e296-22b2-4e40-93d3-d0cbe5d48c3b None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:42.692509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071e296-22b2-4e40-93d3-d0cbe5d48c3b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:42.693251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071e296-22b2-4e40-93d3-d0cbe5d48c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:42.717379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-f071e296-22b2-4e40-93d3-d0cbe5d48c3b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:42.718915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-f071e296-22b2-4e40-93d3-d0cbe5d48c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:42.749467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626e6b9-9342-4a2c-bca0-17943906958e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:42.802053 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:42.809226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edba90-a207-409c-8842-becc80ef917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:42.810610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edba90-a207-409c-8842-becc80ef917b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:42.811069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edba90-a207-409c-8842-becc80ef917b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:42.811582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edba90-a207-409c-8842-becc80ef917b None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:42.812864 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edba90-a207-409c-8842-becc80ef917b None admin] RBAC: Adding query filter params (name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:42.813445 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edba90-a207-409c-8842-becc80ef917b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:42.815011 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edba90-a207-409c-8842-becc80ef917b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:42.818439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:42.828815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 433/856] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:42 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:42.832035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 424/857] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:34:42 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:42.840014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071e296-22b2-4e40-93d3-d0cbe5d48c3b None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:42.859858 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edba90-a207-409c-8842-becc80ef917b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:43.016651 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071e296-22b2-4e40-93d3-d0cbe5d48c3b None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:43.039817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edba90-a207-409c-8842-becc80ef917b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:43.080900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c3d52-1524-4354-8d0f-b5519d6426ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:43.082796 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c3d52-1524-4354-8d0f-b5519d6426ef None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:43.084144 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c3d52-1524-4354-8d0f-b5519d6426ef None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:43.084610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c3d52-1524-4354-8d0f-b5519d6426ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:43.097860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d126e-fb09-4dfb-9617-5fab53505003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:43.099280 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d126e-fb09-4dfb-9617-5fab53505003 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:43.099751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d126e-fb09-4dfb-9617-5fab53505003 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:43.100218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d126e-fb09-4dfb-9617-5fab53505003 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:43.101402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d126e-fb09-4dfb-9617-5fab53505003 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:43.103875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d126e-fb09-4dfb-9617-5fab53505003 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:43.104406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c3d52-1524-4354-8d0f-b5519d6426ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:43.107110 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c3d52-1524-4354-8d0f-b5519d6426ef None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-f34d126e-fb09-4dfb-9617-5fab53505003 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:43.129433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:43.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:43.133550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:43.133550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:43.133550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:43.133550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:43.133550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:43.133550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:43.133550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:43.133550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:43.133550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:43.133550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:43.133550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:43.133550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:43.133550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:43.133550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:34:43.133550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:43.137948 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 425/858] 10.222.0.112 () {56 vars in 1137 bytes} [Thu May 26 16:34:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:34:43.140398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb119b-89c9-4475-bb99-58804650e595 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:43.140882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-4b9c3d52-1524-4354-8d0f-b5519d6426ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:43.140882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:43.140882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:43.140882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:43.140882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:43.140882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:43.140882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:43.140882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:43.140882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:43.140882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:43.140882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:43.140882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:43.140882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:43.140882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:43.140882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:43.142811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:43.145463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:43.145463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:43.145463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:43.145463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:43.146300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb119b-89c9-4475-bb99-58804650e595 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:43.147192 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb119b-89c9-4475-bb99-58804650e595 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:43.150379 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 426/860] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:43 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:43.150544 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 434/860] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:43.151609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c3d52-1524-4354-8d0f-b5519d6426ef None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:43.154957 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb119b-89c9-4475-bb99-58804650e595 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:43.231557 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:43.253939 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:43.304051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb119b-89c9-4475-bb99-58804650e595 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:43.317349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c3d52-1524-4354-8d0f-b5519d6426ef None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:43.358272 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1b0b8-8588-4b0f-b151-f8c24d0975d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:43.359168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1b0b8-8588-4b0f-b151-f8c24d0975d0 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:43.359562 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1b0b8-8588-4b0f-b151-f8c24d0975d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:43.359901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1b0b8-8588-4b0f-b151-f8c24d0975d0 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:43.361366 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1b0b8-8588-4b0f-b151-f8c24d0975d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:43.361636 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1b0b8-8588-4b0f-b151-f8c24d0975d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:43.364504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1b0b8-8588-4b0f-b151-f8c24d0975d0 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:43.379259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1ffed-188f-44cf-8f96-a7b7eb36523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:43.379941 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1ffed-188f-44cf-8f96-a7b7eb36523f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:43.380224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1ffed-188f-44cf-8f96-a7b7eb36523f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:43.380496 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1ffed-188f-44cf-8f96-a7b7eb36523f None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:43.381212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1ffed-188f-44cf-8f96-a7b7eb36523f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:43.381518 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1ffed-188f-44cf-8f96-a7b7eb36523f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:43.388801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 427/861] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:43.389055 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1ffed-188f-44cf-8f96-a7b7eb36523f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:43.389246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271f6f4-a6bf-4a44-8733-b622f4c34b85 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:43.389246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271f6f4-a6bf-4a44-8733-b622f4c34b85 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:43.389246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271f6f4-a6bf-4a44-8733-b622f4c34b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:43.394273 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 435/862] 10.222.0.112 () {56 vars in 1131 bytes} [Thu May 26 16:34:43 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:43.395585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1ffed-188f-44cf-8f96-a7b7eb36523f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:43.422402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-2271f6f4-a6bf-4a44-8733-b622f4c34b85 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:43.423941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2271f6f4-a6bf-4a44-8733-b622f4c34b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:43.517666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 428/863] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:43 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:43.527708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271f6f4-a6bf-4a44-8733-b622f4c34b85 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:43.544901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1ffed-188f-44cf-8f96-a7b7eb36523f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:43.548566 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:43.592697 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67677d3-79dc-4e05-9609-cd9210b65e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:43.593436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67677d3-79dc-4e05-9609-cd9210b65e49 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:43.594001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67677d3-79dc-4e05-9609-cd9210b65e49 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:43.594701 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67677d3-79dc-4e05-9609-cd9210b65e49 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:43.605991 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67677d3-79dc-4e05-9609-cd9210b65e49 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:43.607579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67677d3-79dc-4e05-9609-cd9210b65e49 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:43.617477 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-b67677d3-79dc-4e05-9609-cd9210b65e49 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:43.623519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:43.625584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:43.633844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:43.633844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:43.633844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:43.633844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:43.633844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:43.633844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:43.633844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:43.633844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:43.633844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:34:43.633844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:43.633844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 436/864] 10.222.0.112 () {56 vars in 1122 bytes} [Thu May 26 16:34:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:43.633844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67677d3-79dc-4e05-9609-cd9210b65e49 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:43.704547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271f6f4-a6bf-4a44-8733-b622f4c34b85 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:43.747615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7250b-9026-4861-8f13-3a4eec270847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:43.748295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7250b-9026-4861-8f13-3a4eec270847 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:43.748580 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7250b-9026-4861-8f13-3a4eec270847 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:43.748857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7250b-9026-4861-8f13-3a4eec270847 None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:43.749570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7250b-9026-4861-8f13-3a4eec270847 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:43.750396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7250b-9026-4861-8f13-3a4eec270847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:43.751803 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7250b-9026-4861-8f13-3a4eec270847 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:43.757551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 429/865] 10.222.0.112 () {56 vars in 1131 bytes} [Thu May 26 16:34:43 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:43.758659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7250b-9026-4861-8f13-3a4eec270847 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:43.780029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67677d3-79dc-4e05-9609-cd9210b65e49 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:43.831425 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba444b-43c7-497c-85a3-e7c286ab0774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:43.832970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba444b-43c7-497c-85a3-e7c286ab0774 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:43.833662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba444b-43c7-497c-85a3-e7c286ab0774 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:43.834101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba444b-43c7-497c-85a3-e7c286ab0774 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:43.835638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba444b-43c7-497c-85a3-e7c286ab0774 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:43.837913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba444b-43c7-497c-85a3-e7c286ab0774 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:43.922862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7250b-9026-4861-8f13-3a4eec270847 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:43.948821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:43.992830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a188e3a-a0c9-4d2c-b381-222774326e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:43.994255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a188e3a-a0c9-4d2c-b381-222774326e31 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:43.994255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a188e3a-a0c9-4d2c-b381-222774326e31 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:43.996380 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a188e3a-a0c9-4d2c-b381-222774326e31 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:43.996380 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a188e3a-a0c9-4d2c-b381-222774326e31 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:43.996380 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a188e3a-a0c9-4d2c-b381-222774326e31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:43.998357 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a188e3a-a0c9-4d2c-b381-222774326e31 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:44.016556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 437/866] 10.222.0.112 () {60 vars in 1146 bytes} [Thu May 26 16:34:43 2022] POST /identity/v3/services => generated 252 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:34:44.028027 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 430/867] 10.222.0.112 () {56 vars in 1154 bytes} [Thu May 26 16:34:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:44.039177 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba444b-43c7-497c-85a3-e7c286ab0774 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:44.087638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:44.216493 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba444b-43c7-497c-85a3-e7c286ab0774 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:44.284993 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33d222-2c06-419f-9e03-f40c8c41188d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:44.286299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d222-2c06-419f-9e03-f40c8c41188d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:44.286839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d222-2c06-419f-9e03-f40c8c41188d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:44.287343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d222-2c06-419f-9e03-f40c8c41188d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:44.390283 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33d222-2c06-419f-9e03-f40c8c41188d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:44.393101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33d222-2c06-419f-9e03-f40c8c41188d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:44.423446 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:44.554059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 438/868] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:34:44 2022] GET /identity/v3/auth/tokens => generated 1254 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:34:44.560047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a188e3a-a0c9-4d2c-b381-222774326e31 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:44.696434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a188e3a-a0c9-4d2c-b381-222774326e31 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:44.737955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1e904-c997-40df-8d9c-7fa566e58439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:44.739159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1e904-c997-40df-8d9c-7fa566e58439 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:44.739445 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1e904-c997-40df-8d9c-7fa566e58439 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:44.739734 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1e904-c997-40df-8d9c-7fa566e58439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:44.751622 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1e904-c997-40df-8d9c-7fa566e58439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:44.753163 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1e904-c997-40df-8d9c-7fa566e58439 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:44.773182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-c6f1e904-c997-40df-8d9c-7fa566e58439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:44.773182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:44.773182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:44.773182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:44.773182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:44.773182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:44.773182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:44.773182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:44.773182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:44.773182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:44.773182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:44.773182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:44.773182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:44.773182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:44.773182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:44.774929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:44.776598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:44.776598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:44.776598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:44.776598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:44.776598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 431/869] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:34:44.780937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33d222-2c06-419f-9e03-f40c8c41188d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:44.916328 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33d222-2c06-419f-9e03-f40c8c41188d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:44.941960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:44.957843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7566b-a367-49af-870b-b59cf996a08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:44.958587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7566b-a367-49af-870b-b59cf996a08b None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:44.958869 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7566b-a367-49af-870b-b59cf996a08b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:44.959147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7566b-a367-49af-870b-b59cf996a08b None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:44.959887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7566b-a367-49af-870b-b59cf996a08b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:44.960189 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7566b-a367-49af-870b-b59cf996a08b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:44.961918 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7566b-a367-49af-870b-b59cf996a08b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:44.976133 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 439/870] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:44.982602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1e904-c997-40df-8d9c-7fa566e58439 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:45.018751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:45.104287 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1e904-c997-40df-8d9c-7fa566e58439 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:45.143761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d793c-193b-4cc6-b8f5-52a20d71ebff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:45.145285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d793c-193b-4cc6-b8f5-52a20d71ebff None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:45.145897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d793c-193b-4cc6-b8f5-52a20d71ebff None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:45.147461 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d793c-193b-4cc6-b8f5-52a20d71ebff None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:45.155727 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d793c-193b-4cc6-b8f5-52a20d71ebff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:45.157276 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d793c-193b-4cc6-b8f5-52a20d71ebff None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:45.173549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-da3d793c-193b-4cc6-b8f5-52a20d71ebff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:45.173549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:45.173549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:45.173549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:45.173549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:45.173549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:45.173549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:45.173549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:45.173549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:45.173549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:45.173549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:45.173549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:45.173549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:45.173549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:45.173549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:45.174504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:45.176017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:45.176017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:45.176017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:45.176017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:45.176017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:45.176017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:45.176017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:45.176017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:45.176017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 432/871] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:45.181834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7566b-a367-49af-870b-b59cf996a08b None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:45.235564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be0766-ca28-4632-9a49-c1d7aaf47fac None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:45.236035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be0766-ca28-4632-9a49-c1d7aaf47fac None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:45.236341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be0766-ca28-4632-9a49-c1d7aaf47fac None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:45.243128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 433/872] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:45 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:45.245170 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83de173-5c71-42b9-a5d6-cec531da2b67 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:45.245462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83de173-5c71-42b9-a5d6-cec531da2b67 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:45.245741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83de173-5c71-42b9-a5d6-cec531da2b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:45.270238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-f83de173-5c71-42b9-a5d6-cec531da2b67 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:45.271507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f83de173-5c71-42b9-a5d6-cec531da2b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:45.326161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7566b-a367-49af-870b-b59cf996a08b None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:45.378528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 434/873] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:45 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:45.399593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d3f7b-7f5c-4c9c-93ba-a3a078d229cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:45.401965 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83de173-5c71-42b9-a5d6-cec531da2b67 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:45.403073 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d3f7b-7f5c-4c9c-93ba-a3a078d229cf None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:45.403595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d3f7b-7f5c-4c9c-93ba-a3a078d229cf None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:45.404098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d3f7b-7f5c-4c9c-93ba-a3a078d229cf None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:45.405300 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d3f7b-7f5c-4c9c-93ba-a3a078d229cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:45.405917 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d3f7b-7f5c-4c9c-93ba-a3a078d229cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:45.407783 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d3f7b-7f5c-4c9c-93ba-a3a078d229cf None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:45.422773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 440/874] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:45.431693 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:45.432162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d3f7b-7f5c-4c9c-93ba-a3a078d229cf None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:45.500793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:45.568127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83de173-5c71-42b9-a5d6-cec531da2b67 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:45.609486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d3f7b-7f5c-4c9c-93ba-a3a078d229cf None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:45.612071 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dd446-5993-414a-a774-51e21197a80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:45.613622 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dd446-5993-414a-a774-51e21197a80b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:45.614050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dd446-5993-414a-a774-51e21197a80b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:45.614427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dd446-5993-414a-a774-51e21197a80b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:45.616232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dd446-5993-414a-a774-51e21197a80b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:45.617671 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dd446-5993-414a-a774-51e21197a80b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-e34dd446-5993-414a-a774-51e21197a80b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:45.634764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:45.635831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:45.641928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:45.641928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:45.641928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:45.641928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:45.641928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:45.641928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:45.641928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:45.641928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:45.641928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:45.641928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:45.641928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:45.641928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:45.641928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:34:45.641928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:45.641928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 435/875] 10.222.0.112 () {56 vars in 1131 bytes} [Thu May 26 16:34:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:34:45.645061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dd446-5993-414a-a774-51e21197a80b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:45.657827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9ef63-8abb-4025-966d-4c79bf4947c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:45.659104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9ef63-8abb-4025-966d-4c79bf4947c7 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:45.659702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9ef63-8abb-4025-966d-4c79bf4947c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:45.660742 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9ef63-8abb-4025-966d-4c79bf4947c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:45.661885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9ef63-8abb-4025-966d-4c79bf4947c7 None admin] RBAC: Adding query filter params (role.id=64acd9118f3d4931be8ca4bfa4ae907e, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=06f2efcb8c6646658934a3ab55ab5744) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:45.662476 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9ef63-8abb-4025-966d-4c79bf4947c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:45.664149 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9ef63-8abb-4025-966d-4c79bf4947c7 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:45.673715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 441/876] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:45 2022] GET /identity/v3/role_assignments?user.id=06f2efcb8c6646658934a3ab55ab5744&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=64acd9118f3d4931be8ca4bfa4ae907e => generated 610 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:45.778875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:45.810688 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dd446-5993-414a-a774-51e21197a80b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:45.871750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c6efb-162e-429a-947b-048dc779d64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:45.872674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c6efb-162e-429a-947b-048dc779d64f None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:45.873064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c6efb-162e-429a-947b-048dc779d64f None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:45.873495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c6efb-162e-429a-947b-048dc779d64f None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:45.874614 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c6efb-162e-429a-947b-048dc779d64f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:45.875162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c6efb-162e-429a-947b-048dc779d64f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:45.877081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c6efb-162e-429a-947b-048dc779d64f None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:45.887223 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 436/877] 10.222.0.112 () {56 vars in 1127 bytes} [Thu May 26 16:34:45 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:45.893013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9ef63-8abb-4025-966d-4c79bf4947c7 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:46.055379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9ef63-8abb-4025-966d-4c79bf4947c7 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:46.059439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:46.108857 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838495a-699e-406c-8aff-544a604864ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:46.109927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838495a-699e-406c-8aff-544a604864ec None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:46.110237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838495a-699e-406c-8aff-544a604864ec None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:46.110645 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838495a-699e-406c-8aff-544a604864ec None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:46.111600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838495a-699e-406c-8aff-544a604864ec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:46.112138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838495a-699e-406c-8aff-544a604864ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:46.114678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838495a-699e-406c-8aff-544a604864ec None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:46.122427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 442/878] 10.222.0.112 () {56 vars in 1127 bytes} [Thu May 26 16:34:45 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:46.708528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bf980-1d33-41bb-8e19-ee1e6d2cd69f None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:46.709074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bf980-1d33-41bb-8e19-ee1e6d2cd69f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:46.709074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bf980-1d33-41bb-8e19-ee1e6d2cd69f None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:46.710855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 437/879] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:46.717282 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251338d5-6de7-4c9b-8449-aa7c27653f70 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:46.717570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251338d5-6de7-4c9b-8449-aa7c27653f70 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:46.717853 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251338d5-6de7-4c9b-8449-aa7c27653f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:46.739468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-251338d5-6de7-4c9b-8449-aa7c27653f70 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:46.741168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-251338d5-6de7-4c9b-8449-aa7c27653f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:46.837568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 443/880] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:46 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:46.870764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bf980-1d33-41bb-8e19-ee1e6d2cd69f None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:46.892750 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730b3f-682c-4263-b038-cf53718f4e16 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:46.893345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730b3f-682c-4263-b038-cf53718f4e16 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:46.894462 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730b3f-682c-4263-b038-cf53718f4e16 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:46.897153 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 444/881] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:46 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:46.904406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176cb84-89e0-4529-a360-22a0bccf4e80 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:46.904793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176cb84-89e0-4529-a360-22a0bccf4e80 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:46.905250 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176cb84-89e0-4529-a360-22a0bccf4e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:46.924885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-4176cb84-89e0-4529-a360-22a0bccf4e80 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:46.926972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-4176cb84-89e0-4529-a360-22a0bccf4e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:47.044900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 445/882] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:46 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:34:47.069096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176cb84-89e0-4529-a360-22a0bccf4e80 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:47.074640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bf980-1d33-41bb-8e19-ee1e6d2cd69f None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:47.117317 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:47.131317 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee98ab-f846-49ba-8343-e3ba7a4d9448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:47.133267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee98ab-f846-49ba-8343-e3ba7a4d9448 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:47.133831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee98ab-f846-49ba-8343-e3ba7a4d9448 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:47.134284 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee98ab-f846-49ba-8343-e3ba7a4d9448 None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:47.135376 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee98ab-f846-49ba-8343-e3ba7a4d9448 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:47.136978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee98ab-f846-49ba-8343-e3ba7a4d9448 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:47.239436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176cb84-89e0-4529-a360-22a0bccf4e80 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:47.264444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 438/883] 10.222.0.112 () {60 vars in 1146 bytes} [Thu May 26 16:34:46 2022] POST /identity/v3/services => generated 270 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:34:47.289787 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3360474-764d-418e-b1d8-5071b0982c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:47.291110 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3360474-764d-418e-b1d8-5071b0982c06 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:47.291406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3360474-764d-418e-b1d8-5071b0982c06 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:47.291689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3360474-764d-418e-b1d8-5071b0982c06 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:47.292443 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3360474-764d-418e-b1d8-5071b0982c06 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:47.294187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3360474-764d-418e-b1d8-5071b0982c06 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-f3360474-764d-418e-b1d8-5071b0982c06 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:47.308753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:47.310674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:47.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:47.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:47.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:47.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:47.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:47.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:47.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:47.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:47.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:47.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:47.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:47.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:47.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:34:47.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:47.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 446/884] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:34:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:47.323270 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee98ab-f846-49ba-8343-e3ba7a4d9448 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:47.328677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:47.481295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee98ab-f846-49ba-8343-e3ba7a4d9448 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:47.523000 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bd01f-58be-469a-a7b8-f0482995191f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:47.524088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd01f-58be-469a-a7b8-f0482995191f None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:47.524603 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd01f-58be-469a-a7b8-f0482995191f None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:47.525084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd01f-58be-469a-a7b8-f0482995191f None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:47.526001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bd01f-58be-469a-a7b8-f0482995191f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:47.526540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bd01f-58be-469a-a7b8-f0482995191f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:47.528149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bd01f-58be-469a-a7b8-f0482995191f None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:47.539542 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 439/885] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:34:47 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:47.540718 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3360474-764d-418e-b1d8-5071b0982c06 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:47.683871 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:47.701573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3360474-764d-418e-b1d8-5071b0982c06 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:47.750404 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa533efe-a4f8-4c1c-83be-bfb3694566ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:47.751092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa533efe-a4f8-4c1c-83be-bfb3694566ab None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:47.751380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa533efe-a4f8-4c1c-83be-bfb3694566ab None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:47.751667 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa533efe-a4f8-4c1c-83be-bfb3694566ab None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:47.752726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa533efe-a4f8-4c1c-83be-bfb3694566ab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:47.753043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa533efe-a4f8-4c1c-83be-bfb3694566ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:47.755977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa533efe-a4f8-4c1c-83be-bfb3694566ab None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:47.766698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 447/886] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:34:47 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:47.773401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bd01f-58be-469a-a7b8-f0482995191f None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:47.847577 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:47.885847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bd01f-58be-469a-a7b8-f0482995191f None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:47.927852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55fc3e-ae94-4223-96ad-a1f603a67eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:47.928584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55fc3e-ae94-4223-96ad-a1f603a67eab None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:47.928874 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55fc3e-ae94-4223-96ad-a1f603a67eab None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:47.929157 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55fc3e-ae94-4223-96ad-a1f603a67eab None admin] PATH_INFO: `/v3/endpoints` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:47.930175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55fc3e-ae94-4223-96ad-a1f603a67eab None admin] RBAC: Adding query filter params (interface=public, service_id=40864adfd70f46f788056ac604d8abd0, region_id=RegionOne) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:47.930629 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55fc3e-ae94-4223-96ad-a1f603a67eab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:47.932184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55fc3e-ae94-4223-96ad-a1f603a67eab None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:47.939049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 440/887] 10.222.0.112 () {56 vars in 1256 bytes} [Thu May 26 16:34:47 2022] GET /identity/v3/endpoints?service_id=40864adfd70f46f788056ac604d8abd0&interface=public®ion_id=RegionOne => generated 195 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:47.944593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa533efe-a4f8-4c1c-83be-bfb3694566ab None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:48.058940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa533efe-a4f8-4c1c-83be-bfb3694566ab None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:48.097113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb5b82-e87f-45d8-9e7a-bea95ed89e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:48.098338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5b82-e87f-45d8-9e7a-bea95ed89e05 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:48.098636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5b82-e87f-45d8-9e7a-bea95ed89e05 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:48.098914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5b82-e87f-45d8-9e7a-bea95ed89e05 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:48.099600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb5b82-e87f-45d8-9e7a-bea95ed89e05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:48.100971 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb5b82-e87f-45d8-9e7a-bea95ed89e05 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:48.107512 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 448/888] 10.222.0.112 () {56 vars in 1092 bytes} [Thu May 26 16:34:47 2022] GET /identity/v3/services => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:34:48.739653 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f307d-1439-4669-9c61-8f45cf9e148a None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:48.740006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f307d-1439-4669-9c61-8f45cf9e148a None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:48.740353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f307d-1439-4669-9c61-8f45cf9e148a None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:48.742159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 441/889] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:48 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:48.748787 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7ced2-2d6d-458a-9cb8-034f920009fc None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:48.749204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7ced2-2d6d-458a-9cb8-034f920009fc None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:48.749464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7ced2-2d6d-458a-9cb8-034f920009fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:48.775325 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-16f7ced2-2d6d-458a-9cb8-034f920009fc None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:48.776673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-16f7ced2-2d6d-458a-9cb8-034f920009fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:48.794646 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:48.856609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150357-2ae2-4b34-8911-d340f9ef421c None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:48.857118 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150357-2ae2-4b34-8911-d340f9ef421c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:48.857224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150357-2ae2-4b34-8911-d340f9ef421c None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:48.858972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 442/890] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:34:48.865398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4a584-ac1a-4dfd-be58-bf4f2e2f6a15 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:48.865870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4a584-ac1a-4dfd-be58-bf4f2e2f6a15 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:48.866162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4a584-ac1a-4dfd-be58-bf4f2e2f6a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:48.886472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 449/891] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:48 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:48.892580 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-b1f4a584-ac1a-4dfd-be58-bf4f2e2f6a15 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:48.894584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b1f4a584-ac1a-4dfd-be58-bf4f2e2f6a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:48.907957 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7ced2-2d6d-458a-9cb8-034f920009fc None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:48.998600 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 443/892] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:48 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:49.035762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4a584-ac1a-4dfd-be58-bf4f2e2f6a15 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:49.074829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7ced2-2d6d-458a-9cb8-034f920009fc None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:49.126995 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec195e-f711-4d8d-b256-fe372a1e069b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:49.127832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec195e-f711-4d8d-b256-fe372a1e069b None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:49.128109 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec195e-f711-4d8d-b256-fe372a1e069b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:49.128476 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec195e-f711-4d8d-b256-fe372a1e069b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:49.128986 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:49.150489 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec195e-f711-4d8d-b256-fe372a1e069b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-ebec195e-f711-4d8d-b256-fe372a1e069b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:49.161637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:49.162963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:49.163889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:49.163889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:49.163889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:49.163889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:49.163889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:49.163889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:49.163889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:49.163889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:49.163889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:49.163889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:49.163889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:34:49.163889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:49.163889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 450/893] 10.222.0.112 () {56 vars in 1125 bytes} [Thu May 26 16:34:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:34:49.170904 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec195e-f711-4d8d-b256-fe372a1e069b None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:49.182531 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:49.186948 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4a584-ac1a-4dfd-be58-bf4f2e2f6a15 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:49.240793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed852e7-b181-40c1-9db9-2cf3bb9b4935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:49.242313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed852e7-b181-40c1-9db9-2cf3bb9b4935 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:49.242876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed852e7-b181-40c1-9db9-2cf3bb9b4935 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:49.243383 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed852e7-b181-40c1-9db9-2cf3bb9b4935 None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:49.244660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed852e7-b181-40c1-9db9-2cf3bb9b4935 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:49.247407 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed852e7-b181-40c1-9db9-2cf3bb9b4935 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:49.326967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec195e-f711-4d8d-b256-fe372a1e069b None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:49.374556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7874a-3dc1-45a4-8f36-bd8ff4200680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:49.375457 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7874a-3dc1-45a4-8f36-bd8ff4200680 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:49.375880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7874a-3dc1-45a4-8f36-bd8ff4200680 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:49.376343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7874a-3dc1-45a4-8f36-bd8ff4200680 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:49.377281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7874a-3dc1-45a4-8f36-bd8ff4200680 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:49.377903 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7874a-3dc1-45a4-8f36-bd8ff4200680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:49.380715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7874a-3dc1-45a4-8f36-bd8ff4200680 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:49.400492 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 451/894] 10.222.0.112 () {56 vars in 1120 bytes} [Thu May 26 16:34:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:49.407462 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7874a-3dc1-45a4-8f36-bd8ff4200680 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:49.411306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 444/895] 10.222.0.112 () {60 vars in 1146 bytes} [Thu May 26 16:34:49 2022] POST /identity/v3/services => generated 242 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:34:49.493756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:49.534907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7874a-3dc1-45a4-8f36-bd8ff4200680 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:49.595498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574f449-74bf-4435-8711-28540ebaebdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:49.596654 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574f449-74bf-4435-8711-28540ebaebdf None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:49.597142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574f449-74bf-4435-8711-28540ebaebdf None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:49.597655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574f449-74bf-4435-8711-28540ebaebdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:49.613942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574f449-74bf-4435-8711-28540ebaebdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:49.615503 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574f449-74bf-4435-8711-28540ebaebdf None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:49.636657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-4574f449-74bf-4435-8711-28540ebaebdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:49.636657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:49.636657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:49.636657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:49.636657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:49.636657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:49.636657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:49.636657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:49.636657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:49.636657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:49.636657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:49.636657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:49.636657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:49.636657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:49.636657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:49.637811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:49.639156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:49.639156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:49.639156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:49.639156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:49.639156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 452/896] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:34:49.644902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed852e7-b181-40c1-9db9-2cf3bb9b4935 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:49.776851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed852e7-b181-40c1-9db9-2cf3bb9b4935 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:49.806275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:49.822785 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda54e9c-2d48-442d-8c9e-b95e1fd01a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:49.823485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda54e9c-2d48-442d-8c9e-b95e1fd01a01 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:49.823777 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda54e9c-2d48-442d-8c9e-b95e1fd01a01 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:49.824067 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda54e9c-2d48-442d-8c9e-b95e1fd01a01 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:49.824827 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda54e9c-2d48-442d-8c9e-b95e1fd01a01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:49.825134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda54e9c-2d48-442d-8c9e-b95e1fd01a01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:49.826624 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda54e9c-2d48-442d-8c9e-b95e1fd01a01 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:49.846441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 445/897] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:49.850353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574f449-74bf-4435-8711-28540ebaebdf None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:49.993622 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0bce3-2594-4e9d-a1a6-57f96b98c3ce None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:49.994395 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0bce3-2594-4e9d-a1a6-57f96b98c3ce None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:49.994539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0bce3-2594-4e9d-a1a6-57f96b98c3ce None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:49.995500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574f449-74bf-4435-8711-28540ebaebdf None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:50.002346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 446/898] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:49 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:50.006050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1279d02-9939-4db6-a973-4ff3464dd768 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:50.006627 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1279d02-9939-4db6-a973-4ff3464dd768 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:50.007138 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1279d02-9939-4db6-a973-4ff3464dd768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:50.014411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:50.031862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-a1279d02-9939-4db6-a973-4ff3464dd768 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:50.033622 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a1279d02-9939-4db6-a973-4ff3464dd768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:50.035471 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c59fef-7a0c-4dbc-8461-3263658b4920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:50.036476 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c59fef-7a0c-4dbc-8461-3263658b4920 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:50.036762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c59fef-7a0c-4dbc-8461-3263658b4920 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:50.037039 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c59fef-7a0c-4dbc-8461-3263658b4920 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:50.047178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c59fef-7a0c-4dbc-8461-3263658b4920 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:50.049533 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c59fef-7a0c-4dbc-8461-3263658b4920 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-21c59fef-7a0c-4dbc-8461-3263658b4920 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:50.068260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:50.069419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:50.070434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:50.070434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:50.070434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:50.070434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:50.070434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:50.070434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:50.070434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:50.070434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:50.070434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:34:50.070434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:50.074821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 453/899] 10.222.0.112 () {56 vars in 1122 bytes} [Thu May 26 16:34:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:50.076396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c59fef-7a0c-4dbc-8461-3263658b4920 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:50.142878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 447/900] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:50 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:50.166014 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1279d02-9939-4db6-a973-4ff3464dd768 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:50.197445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c59fef-7a0c-4dbc-8461-3263658b4920 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:50.237146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3aef6f-bd83-452f-b4ac-112e02bff08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:50.238475 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aef6f-bd83-452f-b4ac-112e02bff08f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:50.238475 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aef6f-bd83-452f-b4ac-112e02bff08f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:50.238945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aef6f-bd83-452f-b4ac-112e02bff08f None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:50.239512 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3aef6f-bd83-452f-b4ac-112e02bff08f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:50.239828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3aef6f-bd83-452f-b4ac-112e02bff08f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:50.241372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3aef6f-bd83-452f-b4ac-112e02bff08f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:50.270363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 454/901] 10.222.0.112 () {56 vars in 1154 bytes} [Thu May 26 16:34:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:50.271950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3aef6f-bd83-452f-b4ac-112e02bff08f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:50.306264 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1279d02-9939-4db6-a973-4ff3464dd768 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:50.309677 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:50.321390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:50.349902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db902c4-2b64-4ae9-ab6f-90fb2a89fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:50.351517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db902c4-2b64-4ae9-ab6f-90fb2a89fcf4 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:50.352176 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db902c4-2b64-4ae9-ab6f-90fb2a89fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:50.352697 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db902c4-2b64-4ae9-ab6f-90fb2a89fcf4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:50.353610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db902c4-2b64-4ae9-ab6f-90fb2a89fcf4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:50.356297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db902c4-2b64-4ae9-ab6f-90fb2a89fcf4 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-7db902c4-2b64-4ae9-ab6f-90fb2a89fcf4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:50.376768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:50.378037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:50.379791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:50.379791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:50.379791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:50.379791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:50.379791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:50.379791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:50.379791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:50.379791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:50.379791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:50.379791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:50.379791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:50.379791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:50.379791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:50.379791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:34:50.379791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:50.388802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3aef6f-bd83-452f-b4ac-112e02bff08f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:50.390720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 448/902] 10.222.0.112 () {56 vars in 1137 bytes} [Thu May 26 16:34:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:34:50.392819 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db902c4-2b64-4ae9-ab6f-90fb2a89fcf4 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:50.429960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf188fe-58bb-4300-ad19-093a13d98c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:50.430570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf188fe-58bb-4300-ad19-093a13d98c07 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:50.430858 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf188fe-58bb-4300-ad19-093a13d98c07 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:50.431141 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf188fe-58bb-4300-ad19-093a13d98c07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:50.517081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf188fe-58bb-4300-ad19-093a13d98c07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:50.518617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf188fe-58bb-4300-ad19-093a13d98c07 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:50.555590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:50.578237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db902c4-2b64-4ae9-ab6f-90fb2a89fcf4 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:50.626558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58505a3e-f967-433c-b6fb-ea63e5a96aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:50.627517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58505a3e-f967-433c-b6fb-ea63e5a96aef None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:50.627805 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58505a3e-f967-433c-b6fb-ea63e5a96aef None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:50.628677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58505a3e-f967-433c-b6fb-ea63e5a96aef None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:50.629636 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58505a3e-f967-433c-b6fb-ea63e5a96aef None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:50.629954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58505a3e-f967-433c-b6fb-ea63e5a96aef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:50.631511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58505a3e-f967-433c-b6fb-ea63e5a96aef None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:50.634542 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 455/903] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:34:50 2022] GET /identity/v3/auth/tokens => generated 1466 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:34:50.637078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60c91e-4234-4c1f-917e-85b3e4039a15 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:50.637507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60c91e-4234-4c1f-917e-85b3e4039a15 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:50.638841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60c91e-4234-4c1f-917e-85b3e4039a15 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:50.642039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 449/904] 10.222.0.112 () {56 vars in 1131 bytes} [Thu May 26 16:34:50 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:50.642482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 456/905] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:50 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:50.644540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58505a3e-f967-433c-b6fb-ea63e5a96aef None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:50.645346 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60c91e-4234-4c1f-917e-85b3e4039a15 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:50.692544 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:50.764949 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60c91e-4234-4c1f-917e-85b3e4039a15 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:50.769301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58505a3e-f967-433c-b6fb-ea63e5a96aef None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:50.827397 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3529584-d0f3-4126-b990-76dbabce1576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:50.828089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3529584-d0f3-4126-b990-76dbabce1576 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:50.828379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3529584-d0f3-4126-b990-76dbabce1576 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:50.828659 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3529584-d0f3-4126-b990-76dbabce1576 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:50.829386 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3529584-d0f3-4126-b990-76dbabce1576 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:50.829940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3529584-d0f3-4126-b990-76dbabce1576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:50.832761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3529584-d0f3-4126-b990-76dbabce1576 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:50.834667 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:50.845233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 457/906] 10.222.0.112 () {56 vars in 1131 bytes} [Thu May 26 16:34:50 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:50.845233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc709f5-e347-474d-8f1f-a438368e637f None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:50.845233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc709f5-e347-474d-8f1f-a438368e637f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:50.845233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc709f5-e347-474d-8f1f-a438368e637f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:50.853039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bb9b0-856f-40ef-8469-35efc8b782ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:50.854021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bb9b0-856f-40ef-8469-35efc8b782ea None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:50.854348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bb9b0-856f-40ef-8469-35efc8b782ea None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:50.854739 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bb9b0-856f-40ef-8469-35efc8b782ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:50.860493 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-5cc709f5-e347-474d-8f1f-a438368e637f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:50.861824 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5cc709f5-e347-474d-8f1f-a438368e637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:50.873472 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bb9b0-856f-40ef-8469-35efc8b782ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:50.875085 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bb9b0-856f-40ef-8469-35efc8b782ea None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:50.897490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-3f4bb9b0-856f-40ef-8469-35efc8b782ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:50.897490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:50.897490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:50.897490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:50.897490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:50.897490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:50.897490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:50.897490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:50.897490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:50.897490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:50.897490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:50.897490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:50.897490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:50.897490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:50.897490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:50.898716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:50.899648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:50.899648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:50.899648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:50.899648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:50.899648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 450/907] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:50.899648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bb9b0-856f-40ef-8469-35efc8b782ea None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:50.970655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 458/908] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:50 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:50.972534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc709f5-e347-474d-8f1f-a438368e637f None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:51.049877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:51.062847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bb9b0-856f-40ef-8469-35efc8b782ea None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:51.111856 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fede4b6-69c9-406e-8ffa-c2f9843aeb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:51.113458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fede4b6-69c9-406e-8ffa-c2f9843aeb7b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:51.113854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fede4b6-69c9-406e-8ffa-c2f9843aeb7b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:51.114110 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fede4b6-69c9-406e-8ffa-c2f9843aeb7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:51.115370 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fede4b6-69c9-406e-8ffa-c2f9843aeb7b None admin] RBAC: Adding query filter params (interface=public, service_id=462bb36ca61641268b451515e1a42177, region_id=RegionOne) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:51.116091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fede4b6-69c9-406e-8ffa-c2f9843aeb7b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:51.117616 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fede4b6-69c9-406e-8ffa-c2f9843aeb7b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:51.126211 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 451/909] 10.222.0.112 () {56 vars in 1256 bytes} [Thu May 26 16:34:50 2022] GET /identity/v3/endpoints?service_id=462bb36ca61641268b451515e1a42177&interface=public®ion_id=RegionOne => generated 195 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:51.133167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fede4b6-69c9-406e-8ffa-c2f9843aeb7b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:51.144433 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc709f5-e347-474d-8f1f-a438368e637f None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:51.184225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:51.201478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273228d-06c4-458e-96e7-cdf291401161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:51.203322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273228d-06c4-458e-96e7-cdf291401161 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:51.203322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273228d-06c4-458e-96e7-cdf291401161 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:51.203322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273228d-06c4-458e-96e7-cdf291401161 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:51.203803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273228d-06c4-458e-96e7-cdf291401161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:51.204117 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273228d-06c4-458e-96e7-cdf291401161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:51.205519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273228d-06c4-458e-96e7-cdf291401161 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:51.232449 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 459/910] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:51.234257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273228d-06c4-458e-96e7-cdf291401161 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:51.293131 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fede4b6-69c9-406e-8ffa-c2f9843aeb7b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:51.355168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00efe5-b8ca-4c33-be9b-42b23ee1f59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:51.356002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00efe5-b8ca-4c33-be9b-42b23ee1f59f None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:51.356434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00efe5-b8ca-4c33-be9b-42b23ee1f59f None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:51.356717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00efe5-b8ca-4c33-be9b-42b23ee1f59f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:51.357403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00efe5-b8ca-4c33-be9b-42b23ee1f59f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:51.358909 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00efe5-b8ca-4c33-be9b-42b23ee1f59f None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-9c00efe5-b8ca-4c33-be9b-42b23ee1f59f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:51.384016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:51.385360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:51.386561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:51.386561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:51.386561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:51.386561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:51.386561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:51.386561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:51.386561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:51.386561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:51.386561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:51.386561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:51.386561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:51.386561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:51.386561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:34:51.386561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:51.386561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 452/911] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:34:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:51.389466 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00efe5-b8ca-4c33-be9b-42b23ee1f59f None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:51.405850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273228d-06c4-458e-96e7-cdf291401161 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:51.415046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:51.461657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c16391-4cca-40e5-81d7-03e60ec17aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:51.463305 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c16391-4cca-40e5-81d7-03e60ec17aed None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:51.463305 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c16391-4cca-40e5-81d7-03e60ec17aed None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:51.463680 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c16391-4cca-40e5-81d7-03e60ec17aed None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:51.466347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c16391-4cca-40e5-81d7-03e60ec17aed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:51.469063 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c16391-4cca-40e5-81d7-03e60ec17aed None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:51.488882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 460/912] 10.222.0.112 () {56 vars in 1092 bytes} [Thu May 26 16:34:51 2022] GET /identity/v3/services => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:34:51.489727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c16391-4cca-40e5-81d7-03e60ec17aed None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:51.554503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00efe5-b8ca-4c33-be9b-42b23ee1f59f None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:51.594259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:51.615975 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4c754-69fc-4981-9959-3546f544daaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:51.617196 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4c754-69fc-4981-9959-3546f544daaf None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:51.617759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4c754-69fc-4981-9959-3546f544daaf None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:51.618362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4c754-69fc-4981-9959-3546f544daaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:51.630748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4c754-69fc-4981-9959-3546f544daaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:51.633195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4c754-69fc-4981-9959-3546f544daaf None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:51.660870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-80b4c754-69fc-4981-9959-3546f544daaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:51.660870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:51.660870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:51.660870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:51.660870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:51.660870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:51.660870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:51.660870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:51.660870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:51.660870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:51.660870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:51.660870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:51.660870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:51.660870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:51.660870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:51.662656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:51.664928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:51.664928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:51.664928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:51.664928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:51.664928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:51.664928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:51.664928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:51.664928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:51.670762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 453/913] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:51.672608 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4c754-69fc-4981-9959-3546f544daaf None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:51.700203 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c16391-4cca-40e5-81d7-03e60ec17aed None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:51.759883 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d5d4c-1071-4d31-8f34-878963f9c1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:51.760629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d5d4c-1071-4d31-8f34-878963f9c1e8 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:51.761192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d5d4c-1071-4d31-8f34-878963f9c1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:51.761761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d5d4c-1071-4d31-8f34-878963f9c1e8 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:51.762671 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d5d4c-1071-4d31-8f34-878963f9c1e8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:51.764084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d5d4c-1071-4d31-8f34-878963f9c1e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:51.765185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d5d4c-1071-4d31-8f34-878963f9c1e8 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:51.775906 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 461/914] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:34:51 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:51.784553 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d5d4c-1071-4d31-8f34-878963f9c1e8 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:51.829366 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:51.870057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4c754-69fc-4981-9959-3546f544daaf None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:51.929323 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f131537-5d3a-41cd-a554-8cb42afdcb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:51.930016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f131537-5d3a-41cd-a554-8cb42afdcb45 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:51.930346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f131537-5d3a-41cd-a554-8cb42afdcb45 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:51.931226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f131537-5d3a-41cd-a554-8cb42afdcb45 None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:51.932401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f131537-5d3a-41cd-a554-8cb42afdcb45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:51.932724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f131537-5d3a-41cd-a554-8cb42afdcb45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:51.934734 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f131537-5d3a-41cd-a554-8cb42afdcb45 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:51.952522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 454/915] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:51.961126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f131537-5d3a-41cd-a554-8cb42afdcb45 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:51.971093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d5d4c-1071-4d31-8f34-878963f9c1e8 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:51.992507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:52.013230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24425e67-1375-40ac-8e35-b9a9483441f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:52.013852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24425e67-1375-40ac-8e35-b9a9483441f6 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:52.014134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24425e67-1375-40ac-8e35-b9a9483441f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:52.014438 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24425e67-1375-40ac-8e35-b9a9483441f6 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:52.015120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24425e67-1375-40ac-8e35-b9a9483441f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:52.015493 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24425e67-1375-40ac-8e35-b9a9483441f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:52.017020 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24425e67-1375-40ac-8e35-b9a9483441f6 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:52.022790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 462/916] 10.222.0.112 () {56 vars in 1119 bytes} [Thu May 26 16:34:51 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:52.028479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24425e67-1375-40ac-8e35-b9a9483441f6 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:52.115234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f131537-5d3a-41cd-a554-8cb42afdcb45 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:52.158298 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24425e67-1375-40ac-8e35-b9a9483441f6 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:52.164134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c48ae-3146-43ed-9ad6-430fd42eb4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:52.165203 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c48ae-3146-43ed-9ad6-430fd42eb4b6 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:52.165693 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c48ae-3146-43ed-9ad6-430fd42eb4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:52.166188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c48ae-3146-43ed-9ad6-430fd42eb4b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:52.167560 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c48ae-3146-43ed-9ad6-430fd42eb4b6 None admin] RBAC: Adding query filter params (role.id=6a1901e356224f31b647f4ae3aeb3d37, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=06f2efcb8c6646658934a3ab55ab5744) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:52.168177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c48ae-3146-43ed-9ad6-430fd42eb4b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:52.170108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c48ae-3146-43ed-9ad6-430fd42eb4b6 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:52.179755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 455/917] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:34:51 2022] GET /identity/v3/role_assignments?user.id=06f2efcb8c6646658934a3ab55ab5744&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=6a1901e356224f31b647f4ae3aeb3d37 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:52.211358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf3ee-2d39-4ebe-b4bf-06109b5e867b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:52.212321 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf3ee-2d39-4ebe-b4bf-06109b5e867b None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:52.212615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf3ee-2d39-4ebe-b4bf-06109b5e867b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:52.212896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf3ee-2d39-4ebe-b4bf-06109b5e867b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:52.217874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cf3ee-2d39-4ebe-b4bf-06109b5e867b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:52.219379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cf3ee-2d39-4ebe-b4bf-06109b5e867b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:52.311779 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2d0f6-e8b4-476c-b5d5-a03a2bf2fb08 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:52.312129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2d0f6-e8b4-476c-b5d5-a03a2bf2fb08 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:52.312303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2d0f6-e8b4-476c-b5d5-a03a2bf2fb08 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:52.313934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 456/918] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:34:52.320032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73b29f-35c7-4603-9dfe-d98fc5498743 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:52.320352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73b29f-35c7-4603-9dfe-d98fc5498743 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:52.320705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73b29f-35c7-4603-9dfe-d98fc5498743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:52.326647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:52.339196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 463/919] 10.222.0.112 () {60 vars in 1149 bytes} [Thu May 26 16:34:52 2022] POST /identity/v3/endpoints => generated 348 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:34:52.341754 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-4e73b29f-35c7-4603-9dfe-d98fc5498743 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:52.343062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4e73b29f-35c7-4603-9dfe-d98fc5498743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:52.457833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 457/920] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:52 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:34:52.481763 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf3ee-2d39-4ebe-b4bf-06109b5e867b None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:52.525098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:52.610645 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf3ee-2d39-4ebe-b4bf-06109b5e867b None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:52.668185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef8d52-516e-46d6-9ce8-ad2a16db3fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:52.669024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef8d52-516e-46d6-9ce8-ad2a16db3fab None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:52.669310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef8d52-516e-46d6-9ce8-ad2a16db3fab None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:52.669583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef8d52-516e-46d6-9ce8-ad2a16db3fab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:52.670294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef8d52-516e-46d6-9ce8-ad2a16db3fab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:52.671765 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef8d52-516e-46d6-9ce8-ad2a16db3fab None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-03ef8d52-516e-46d6-9ce8-ad2a16db3fab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:52.686116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:52.687220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:52.688384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:52.688384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:52.688384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:52.688384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:52.688384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:52.688384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:52.688384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:52.688384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:52.688384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:52.688384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:52.688384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:52.688384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:52.688384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:34:52.688384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:52.688384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 464/921] 10.222.0.112 () {56 vars in 1131 bytes} [Thu May 26 16:34:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:52.695897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73b29f-35c7-4603-9dfe-d98fc5498743 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:52.827717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73b29f-35c7-4603-9dfe-d98fc5498743 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:52.860855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:52.874604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef87ae-1a51-4b57-bdf6-504fde04c4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:52.875572 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef87ae-1a51-4b57-bdf6-504fde04c4f8 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:52.877591 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef87ae-1a51-4b57-bdf6-504fde04c4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:52.877591 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef87ae-1a51-4b57-bdf6-504fde04c4f8 None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:52.877591 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef87ae-1a51-4b57-bdf6-504fde04c4f8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:52.878841 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef87ae-1a51-4b57-bdf6-504fde04c4f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:52.880512 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef87ae-1a51-4b57-bdf6-504fde04c4f8 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:52.888236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 458/922] 10.222.0.112 () {56 vars in 1127 bytes} [Thu May 26 16:34:52 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:52.895467 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef8d52-516e-46d6-9ce8-ad2a16db3fab None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:53.012796 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:53.015728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef8d52-516e-46d6-9ce8-ad2a16db3fab None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:53.054801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062d145-3cdd-4e2e-b9ff-16cd5cef02c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:53.056029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062d145-3cdd-4e2e-b9ff-16cd5cef02c5 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:53.056546 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062d145-3cdd-4e2e-b9ff-16cd5cef02c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:53.057035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062d145-3cdd-4e2e-b9ff-16cd5cef02c5 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:53.058143 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062d145-3cdd-4e2e-b9ff-16cd5cef02c5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:53.058778 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062d145-3cdd-4e2e-b9ff-16cd5cef02c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:53.060404 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062d145-3cdd-4e2e-b9ff-16cd5cef02c5 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:53.067404 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 465/923] 10.222.0.112 () {56 vars in 1127 bytes} [Thu May 26 16:34:52 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:53.078386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef87ae-1a51-4b57-bdf6-504fde04c4f8 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:53.203744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef87ae-1a51-4b57-bdf6-504fde04c4f8 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:53.244565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f61f2-f359-42d4-bc78-0e379da7e8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:53.245391 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f61f2-f359-42d4-bc78-0e379da7e8cd None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:53.245699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f61f2-f359-42d4-bc78-0e379da7e8cd None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:53.246049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f61f2-f359-42d4-bc78-0e379da7e8cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:53.246895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f61f2-f359-42d4-bc78-0e379da7e8cd None admin] RBAC: Adding query filter params (interface=public, service_id=fb1b7f42d6db493c86207fbf4f295716, region_id=RegionOne) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:53.247237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f61f2-f359-42d4-bc78-0e379da7e8cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:53.248796 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f61f2-f359-42d4-bc78-0e379da7e8cd None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:53.256716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 459/924] 10.222.0.112 () {56 vars in 1256 bytes} [Thu May 26 16:34:53 2022] GET /identity/v3/endpoints?service_id=fb1b7f42d6db493c86207fbf4f295716&interface=public®ion_id=RegionOne => generated 195 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:53.262211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062d145-3cdd-4e2e-b9ff-16cd5cef02c5 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:53.383838 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062d145-3cdd-4e2e-b9ff-16cd5cef02c5 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:53.427911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791f5a4-58fd-4e68-b066-535a6bf501ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:53.428982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791f5a4-58fd-4e68-b066-535a6bf501ff None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:53.429505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791f5a4-58fd-4e68-b066-535a6bf501ff None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:53.429988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791f5a4-58fd-4e68-b066-535a6bf501ff None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:53.430962 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791f5a4-58fd-4e68-b066-535a6bf501ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:53.432623 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791f5a4-58fd-4e68-b066-535a6bf501ff None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:53.441931 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 466/925] 10.222.0.112 () {56 vars in 1092 bytes} [Thu May 26 16:34:53 2022] GET /identity/v3/services => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:34:54.235074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9238c2-113b-4f25-b73e-41d7c1a593b2 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:54.235692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9238c2-113b-4f25-b73e-41d7c1a593b2 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:54.236008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9238c2-113b-4f25-b73e-41d7c1a593b2 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:54.239142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 460/926] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:54 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:54.245706 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12514c-5efa-4c63-98c0-6e380c040652 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:54.246012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12514c-5efa-4c63-98c0-6e380c040652 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:54.246262 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12514c-5efa-4c63-98c0-6e380c040652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:54.265850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-4e12514c-5efa-4c63-98c0-6e380c040652 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:54.267406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-4e12514c-5efa-4c63-98c0-6e380c040652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:54.302085 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:54.362497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 467/927] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:54 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:54.383006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9238c2-113b-4f25-b73e-41d7c1a593b2 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:54.458013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:54.510454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9238c2-113b-4f25-b73e-41d7c1a593b2 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:54.580054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359ee79-a224-4749-b46e-588b20de01b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:54.580964 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359ee79-a224-4749-b46e-588b20de01b3 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:54.581256 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359ee79-a224-4749-b46e-588b20de01b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:54.581525 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359ee79-a224-4749-b46e-588b20de01b3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:54.582220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359ee79-a224-4749-b46e-588b20de01b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:54.583749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359ee79-a224-4749-b46e-588b20de01b3 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-6359ee79-a224-4749-b46e-588b20de01b3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:54.597496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:54.599252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:54.600753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:54.600753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:54.600753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:54.600753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:54.600753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:54.600753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:54.600753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:54.600753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:54.600753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:54.600753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:54.600753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:54.600753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:54.600753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:54.600753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:34:54.600753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:54.606405 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 461/928] 10.222.0.112 () {56 vars in 1137 bytes} [Thu May 26 16:34:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:54.606709 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12514c-5efa-4c63-98c0-6e380c040652 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:54.760629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12514c-5efa-4c63-98c0-6e380c040652 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:54.804074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed599-91a7-4f34-b2f9-9c6dfe87a583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:54.804363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6f7bb-60b5-4338-a536-3f7fe81b8803 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:54.804491 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6f7bb-60b5-4338-a536-3f7fe81b8803 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:54.804842 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6f7bb-60b5-4338-a536-3f7fe81b8803 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:54.805827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed599-91a7-4f34-b2f9-9c6dfe87a583 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:54.806410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed599-91a7-4f34-b2f9-9c6dfe87a583 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:54.806522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 462/929] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:54.807018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed599-91a7-4f34-b2f9-9c6dfe87a583 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:54.808038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ed599-91a7-4f34-b2f9-9c6dfe87a583 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:54.808757 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ed599-91a7-4f34-b2f9-9c6dfe87a583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:54.811705 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ed599-91a7-4f34-b2f9-9c6dfe87a583 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:54.812602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2410691-65b1-4972-bd18-7ecd4c9c00b1 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:54.812934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2410691-65b1-4972-bd18-7ecd4c9c00b1 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:54.813281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2410691-65b1-4972-bd18-7ecd4c9c00b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:54.821143 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 468/930] 10.222.0.112 () {56 vars in 1131 bytes} [Thu May 26 16:34:54 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:54.826982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed599-91a7-4f34-b2f9-9c6dfe87a583 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:54.838762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-e2410691-65b1-4972-bd18-7ecd4c9c00b1 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:54.841670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-e2410691-65b1-4972-bd18-7ecd4c9c00b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:54.861083 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:54.974690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 463/931] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:54 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:54.993148 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2410691-65b1-4972-bd18-7ecd4c9c00b1 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:55.009264 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed599-91a7-4f34-b2f9-9c6dfe87a583 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:55.051806 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:55.072959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d6c9c-7657-47c4-a515-13f303e29914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:55.073899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d6c9c-7657-47c4-a515-13f303e29914 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:55.074388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d6c9c-7657-47c4-a515-13f303e29914 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:55.074888 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d6c9c-7657-47c4-a515-13f303e29914 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:55.075743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d6c9c-7657-47c4-a515-13f303e29914 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:55.076221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d6c9c-7657-47c4-a515-13f303e29914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:55.077768 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d6c9c-7657-47c4-a515-13f303e29914 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:55.084465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 469/932] 10.222.0.112 () {56 vars in 1131 bytes} [Thu May 26 16:34:54 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:55.085779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f2119-5acf-4197-a41e-f636ea95de17 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:55.086064 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f2119-5acf-4197-a41e-f636ea95de17 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:55.086372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f2119-5acf-4197-a41e-f636ea95de17 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:55.090478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 470/933] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:55 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:55.094455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f2119-5acf-4197-a41e-f636ea95de17 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:55.132927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2410691-65b1-4972-bd18-7ecd4c9c00b1 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:55.192797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8079f-990e-41b4-b6aa-70ad07ccb594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:55.193871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8079f-990e-41b4-b6aa-70ad07ccb594 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:55.194196 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8079f-990e-41b4-b6aa-70ad07ccb594 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:55.194674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8079f-990e-41b4-b6aa-70ad07ccb594 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:55.220163 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8079f-990e-41b4-b6aa-70ad07ccb594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-02a8079f-990e-41b4-b6aa-70ad07ccb594 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:34:55.233670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:55.236057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:55.237597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:55.237597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:55.237597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:55.237597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:55.237597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:34:55.237597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:34:55.237597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:34:55.237597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:34:55.237597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:34:55.237597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:34:55.237597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:34:55.237597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:55.237597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 464/934] 10.222.0.112 () {56 vars in 1125 bytes} [Thu May 26 16:34:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:55.237597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293205ff-0b86-4f28-a764-7668e35cb02e None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:55.238945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293205ff-0b86-4f28-a764-7668e35cb02e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:55.238945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293205ff-0b86-4f28-a764-7668e35cb02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:55.248792 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:55.260822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-293205ff-0b86-4f28-a764-7668e35cb02e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:55.262024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-293205ff-0b86-4f28-a764-7668e35cb02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:55.282229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f2119-5acf-4197-a41e-f636ea95de17 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:55.346161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaa080-34a9-4291-8ee3-6a2ac9ce23c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:55.347941 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaa080-34a9-4291-8ee3-6a2ac9ce23c1 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:55.348389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaa080-34a9-4291-8ee3-6a2ac9ce23c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:55.348843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaa080-34a9-4291-8ee3-6a2ac9ce23c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:55.350146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaaa080-34a9-4291-8ee3-6a2ac9ce23c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:55.352489 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaaa080-34a9-4291-8ee3-6a2ac9ce23c1 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:55.377409 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 465/935] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:55 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:55.378464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293205ff-0b86-4f28-a764-7668e35cb02e None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:55.445179 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:55.481814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 471/936] 10.222.0.112 () {60 vars in 1149 bytes} [Thu May 26 16:34:55 2022] POST /identity/v3/endpoints => generated 349 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:34:55.483904 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaa080-34a9-4291-8ee3-6a2ac9ce23c1 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:55.555416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293205ff-0b86-4f28-a764-7668e35cb02e None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:55.635246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb147a-f5c8-4963-b5e7-02c6b0e68b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:55.636255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb147a-f5c8-4963-b5e7-02c6b0e68b57 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:55.636749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb147a-f5c8-4963-b5e7-02c6b0e68b57 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:55.637206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb147a-f5c8-4963-b5e7-02c6b0e68b57 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:55.638669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb147a-f5c8-4963-b5e7-02c6b0e68b57 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:55.639876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb147a-f5c8-4963-b5e7-02c6b0e68b57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:55.641943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb147a-f5c8-4963-b5e7-02c6b0e68b57 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:55.662360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 466/937] 10.222.0.112 () {56 vars in 1120 bytes} [Thu May 26 16:34:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:55.669445 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb147a-f5c8-4963-b5e7-02c6b0e68b57 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:55.681503 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaa080-34a9-4291-8ee3-6a2ac9ce23c1 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:55.745586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31484fc-8016-42e9-a5ad-19838e618952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:55.746274 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31484fc-8016-42e9-a5ad-19838e618952 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:55.746609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31484fc-8016-42e9-a5ad-19838e618952 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:55.746887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31484fc-8016-42e9-a5ad-19838e618952 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:55.747607 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31484fc-8016-42e9-a5ad-19838e618952 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:55.749093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31484fc-8016-42e9-a5ad-19838e618952 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:55.750745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: WARNING keystone.server.flask.common [None req-b31484fc-8016-42e9-a5ad-19838e618952 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 16:34:55.770024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:55.839934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:55.847200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb147a-f5c8-4963-b5e7-02c6b0e68b57 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:55.878265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.sql.core [None req-b31484fc-8016-42e9-a5ad-19838e618952 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 16:34:55.878265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 16:34:55.878265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [parameters: {'id': 'e57caa1f785e425293a0c8b39aa8aa51', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 16:34:55.878265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87033) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 16:34:55.887276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-b31484fc-8016-42e9-a5ad-19838e618952 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e57caa1f785e425293a0c8b39aa8aa51.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e57caa1f785e425293a0c8b39aa8aa51. May 26 16:34:55.887276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:55.887276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:34:55.887276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:34:55.887276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:34:55.887276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:34:55.887276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:34:55.887276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:34:55.887276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:34:55.887276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application conn.query(q) May 26 16:34:55.887276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:34:55.887276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:34:55.887276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application result.read() May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 16:34:55.888135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application next(self.gen) May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application yield resource May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application next(self.gen) May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self.session.rollback() May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self.force_reraise() May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise self.value May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application session.commit() May 26 16:34:55.889145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._prepare_impl() May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self.session.flush() May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._flush(objects) May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application compat.raise_( May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application flush_context.execute() May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 16:34:55.890045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rec.execute(self) May 26 16:34:55.890990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 16:34:55.890990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 16:34:55.890990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 16:34:55.890990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 16:34:55.890990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 16:34:55.890990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 16:34:55.890990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 16:34:55.890990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 16:34:55.890990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 16:34:55.890990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 16:34:55.890990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 16:34:55.890990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 16:34:55.890990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 16:34:55.890990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 16:34:55.890990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application conn.query(q) May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application result.read() May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:34:55.891802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:34:55.892689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:34:55.892689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:34:55.892689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:34:55.892689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:34:55.892689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:34:55.892689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:34:55.892689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 16:34:55.892689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 16:34:55.892689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [parameters: {'id': 'e57caa1f785e425293a0c8b39aa8aa51', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 16:34:55.892689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 16:34:55.892689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:55.892689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:55.892689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:55.892689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:55.892689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:55.893565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:55.906694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:55.906694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 16:34:55.906694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 16:34:55.906694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:55.906694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:55.906694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 16:34:55.906694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 16:34:55.906694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e57caa1f785e425293a0c8b39aa8aa51. May 26 16:34:55.906694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:55.907206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f202a-591e-477e-83de-8d5beb45c736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:55.907206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f202a-591e-477e-83de-8d5beb45c736 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:55.907206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f202a-591e-477e-83de-8d5beb45c736 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:55.907206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f202a-591e-477e-83de-8d5beb45c736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:55.907507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 472/938] 10.222.0.112 () {60 vars in 1145 bytes} [Thu May 26 16:34:55 2022] POST /identity/v3/projects => generated 262 bytes in 415 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:55.907507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31484fc-8016-42e9-a5ad-19838e618952 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:55.914189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f202a-591e-477e-83de-8d5beb45c736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:55.915996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f202a-591e-477e-83de-8d5beb45c736 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:55.945698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-7a1f202a-591e-477e-83de-8d5beb45c736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:55.945698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:55.945698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:55.945698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:55.945698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:55.945698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:55.945698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:55.945698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:55.945698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:55.945698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:55.945698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:55.945698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:55.945698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:55.945698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:55.945698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:55.946714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:55.947667 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:55.947667 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:55.947667 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:55.947667 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:55.950107 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 467/939] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:34:55.956777 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f202a-591e-477e-83de-8d5beb45c736 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:56.058590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31484fc-8016-42e9-a5ad-19838e618952 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:56.101424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75979efa-f838-411f-97d9-06d68f014d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:56.102620 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75979efa-f838-411f-97d9-06d68f014d6f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:56.103089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75979efa-f838-411f-97d9-06d68f014d6f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:56.103542 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75979efa-f838-411f-97d9-06d68f014d6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:56.105452 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f202a-591e-477e-83de-8d5beb45c736 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:56.113266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75979efa-f838-411f-97d9-06d68f014d6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:56.115503 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75979efa-f838-411f-97d9-06d68f014d6f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:56.132907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-75979efa-f838-411f-97d9-06d68f014d6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:56.132907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:56.132907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:56.132907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:56.132907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:56.132907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:56.132907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:56.132907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:56.132907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:56.132907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:56.132907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:56.132907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:56.132907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:56.132907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:56.132907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:56.134458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:56.136731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:56.136731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:56.136731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:56.136731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:56.136731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:56.136731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:56.136731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:56.136731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:56.136731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 473/940] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:56.136731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305ca32-6063-46e6-9b49-4c529b88edb9 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:56.136731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305ca32-6063-46e6-9b49-4c529b88edb9 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:56.140083 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305ca32-6063-46e6-9b49-4c529b88edb9 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:56.143255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 474/941] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:56 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:56.143255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305ca32-6063-46e6-9b49-4c529b88edb9 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:56.168499 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b19b9b-b06e-44f6-9d85-db81f462fac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:56.169197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b19b9b-b06e-44f6-9d85-db81f462fac8 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:56.169481 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b19b9b-b06e-44f6-9d85-db81f462fac8 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:56.169755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b19b9b-b06e-44f6-9d85-db81f462fac8 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:56.170525 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b19b9b-b06e-44f6-9d85-db81f462fac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:56.170835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b19b9b-b06e-44f6-9d85-db81f462fac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:56.172505 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b19b9b-b06e-44f6-9d85-db81f462fac8 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:56.188802 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 468/942] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:56.190680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e1ff4-12e2-4533-8904-1338b5ec2e08 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:56.190960 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e1ff4-12e2-4533-8904-1338b5ec2e08 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:56.191226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e1ff4-12e2-4533-8904-1338b5ec2e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:56.218593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-317e1ff4-12e2-4533-8904-1338b5ec2e08 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:56.220417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-317e1ff4-12e2-4533-8904-1338b5ec2e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:56.223733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:56.240288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:56.304318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305ca32-6063-46e6-9b49-4c529b88edb9 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:56.346359 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 469/943] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:56 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:56.346359 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e1ff4-12e2-4533-8904-1338b5ec2e08 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:56.357785 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf3ef4-b2a8-4176-a140-a48cdf0631b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:56.358566 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf3ef4-b2a8-4176-a140-a48cdf0631b5 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:56.358945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf3ef4-b2a8-4176-a140-a48cdf0631b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:56.359383 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf3ef4-b2a8-4176-a140-a48cdf0631b5 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:56.360212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf3ef4-b2a8-4176-a140-a48cdf0631b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:56.360529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf3ef4-b2a8-4176-a140-a48cdf0631b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:56.362877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf3ef4-b2a8-4176-a140-a48cdf0631b5 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:56.394616 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 475/944] 10.222.0.112 () {56 vars in 1117 bytes} [Thu May 26 16:34:56 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:56.396176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf3ef4-b2a8-4176-a140-a48cdf0631b5 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:56.544518 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e1ff4-12e2-4533-8904-1338b5ec2e08 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:56.569142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf3ef4-b2a8-4176-a140-a48cdf0631b5 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:56.596270 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:56.608610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5da971-29eb-4a34-9406-ec89eebd8f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:56.609504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5da971-29eb-4a34-9406-ec89eebd8f16 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:56.610023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5da971-29eb-4a34-9406-ec89eebd8f16 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:56.610302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5da971-29eb-4a34-9406-ec89eebd8f16 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:56.621398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5da971-29eb-4a34-9406-ec89eebd8f16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:56.623048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5da971-29eb-4a34-9406-ec89eebd8f16 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:56.624790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcd0eb-167e-49c7-a63c-782227927455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:56.625841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcd0eb-167e-49c7-a63c-782227927455 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:56.626301 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcd0eb-167e-49c7-a63c-782227927455 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:56.626469 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:56.626899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcd0eb-167e-49c7-a63c-782227927455 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:56.628259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcd0eb-167e-49c7-a63c-782227927455 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:56.629871 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcd0eb-167e-49c7-a63c-782227927455 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-75bcd0eb-167e-49c7-a63c-782227927455 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:56.648998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:56.650819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:56.652315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:56.652315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:56.652315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:56.652315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:56.652315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:56.652315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:56.652315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:56.652315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:56.652315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:56.652315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:56.652315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:56.652315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:56.652315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:34:56.652315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:56.652315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 476/945] 10.222.0.112 () {56 vars in 1131 bytes} [Thu May 26 16:34:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-9c5da971-29eb-4a34-9406-ec89eebd8f16 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:56.654503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:56.656167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:56.660833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:56.660833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:56.660833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:56.660833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:56.660833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:56.660833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:56.660833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:56.660833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:56.660833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:34:56.660833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:56.660833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 470/946] 10.222.0.112 () {56 vars in 1122 bytes} [Thu May 26 16:34:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:56.665576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcd0eb-167e-49c7-a63c-782227927455 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:56.665918 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5da971-29eb-4a34-9406-ec89eebd8f16 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:56.816687 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5da971-29eb-4a34-9406-ec89eebd8f16 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:56.839159 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcd0eb-167e-49c7-a63c-782227927455 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:56.874630 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80868203-dfd4-4643-b223-f4f327d16a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:56.875695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80868203-dfd4-4643-b223-f4f327d16a61 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:56.876177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80868203-dfd4-4643-b223-f4f327d16a61 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:56.876650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80868203-dfd4-4643-b223-f4f327d16a61 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:56.878523 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80868203-dfd4-4643-b223-f4f327d16a61 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:56.879158 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80868203-dfd4-4643-b223-f4f327d16a61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:56.881528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80868203-dfd4-4643-b223-f4f327d16a61 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:56.914950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bfd4d-4cd7-48ed-bb86-469956cf0de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:56.915774 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bfd4d-4cd7-48ed-bb86-469956cf0de6 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:56.916062 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bfd4d-4cd7-48ed-bb86-469956cf0de6 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:56.916405 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bfd4d-4cd7-48ed-bb86-469956cf0de6 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:56.917534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bfd4d-4cd7-48ed-bb86-469956cf0de6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:56.917859 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bfd4d-4cd7-48ed-bb86-469956cf0de6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:56.919420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bfd4d-4cd7-48ed-bb86-469956cf0de6 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:56.926239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 477/947] 10.222.0.112 () {56 vars in 1127 bytes} [Thu May 26 16:34:56 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:56.930982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 471/948] 10.222.0.112 () {56 vars in 1154 bytes} [Thu May 26 16:34:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:56.935234 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bfd4d-4cd7-48ed-bb86-469956cf0de6 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:56.936369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80868203-dfd4-4643-b223-f4f327d16a61 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:57.007555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:57.010345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:57.052241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80868203-dfd4-4643-b223-f4f327d16a61 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:57.085759 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bfd4d-4cd7-48ed-bb86-469956cf0de6 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:57.090432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daac9b-cc63-4af4-b715-2410773cfead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:57.091251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daac9b-cc63-4af4-b715-2410773cfead None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:57.091541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daac9b-cc63-4af4-b715-2410773cfead None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:57.091828 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daac9b-cc63-4af4-b715-2410773cfead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:57.110470 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daac9b-cc63-4af4-b715-2410773cfead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:57.113701 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daac9b-cc63-4af4-b715-2410773cfead None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:57.134070 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcac8d-0a51-469f-97a8-56ddc2d14845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:57.134881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcac8d-0a51-469f-97a8-56ddc2d14845 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:57.135168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcac8d-0a51-469f-97a8-56ddc2d14845 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:57.135443 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcac8d-0a51-469f-97a8-56ddc2d14845 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:57.136158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcac8d-0a51-469f-97a8-56ddc2d14845 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:57.136463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcac8d-0a51-469f-97a8-56ddc2d14845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:57.137825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcac8d-0a51-469f-97a8-56ddc2d14845 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:57.144050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-48daac9b-cc63-4af4-b715-2410773cfead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:57.144050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:57.144050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:57.144050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:57.144050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:57.144050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:57.144050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:57.144050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:57.144050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:57.144050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:57.144050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:57.144050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:57.144050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:34:57.144050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:34:57.144050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:57.145669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:57.146890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:34:57.146890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:34:57.146890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:34:57.146890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:57.147170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 478/949] 10.222.0.112 () {56 vars in 1127 bytes} [Thu May 26 16:34:56 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:57.151388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 472/950] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:57.154470 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcac8d-0a51-469f-97a8-56ddc2d14845 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:57.162310 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daac9b-cc63-4af4-b715-2410773cfead None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:57.296493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daac9b-cc63-4af4-b715-2410773cfead None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:57.301463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcac8d-0a51-469f-97a8-56ddc2d14845 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:57.313557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:57.319960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:57.341404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21183a9-a9a5-4956-a449-3c45ec9483df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:57.342374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21183a9-a9a5-4956-a449-3c45ec9483df None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:57.342825 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21183a9-a9a5-4956-a449-3c45ec9483df None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:57.343246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21183a9-a9a5-4956-a449-3c45ec9483df None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:57.344119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21183a9-a9a5-4956-a449-3c45ec9483df None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:57.344615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21183a9-a9a5-4956-a449-3c45ec9483df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:57.346774 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21183a9-a9a5-4956-a449-3c45ec9483df None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:57.360846 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd21cee-ad41-47cf-8f0e-100958bb76e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:57.362304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd21cee-ad41-47cf-8f0e-100958bb76e3 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:57.362813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd21cee-ad41-47cf-8f0e-100958bb76e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:57.363393 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd21cee-ad41-47cf-8f0e-100958bb76e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:57.364728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd21cee-ad41-47cf-8f0e-100958bb76e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:57.371326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd21cee-ad41-47cf-8f0e-100958bb76e3 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:57.372322 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 473/951] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:34:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:57.373612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21183a9-a9a5-4956-a449-3c45ec9483df None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:57.499181 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 479/952] 10.222.0.112 () {60 vars in 1149 bytes} [Thu May 26 16:34:57 2022] POST /identity/v3/endpoints => generated 351 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:34:57.528882 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21183a9-a9a5-4956-a449-3c45ec9483df None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:57.584859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a61569-a4d8-4ccc-8ac5-93304a700517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:57.586031 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a61569-a4d8-4ccc-8ac5-93304a700517 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:57.586632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a61569-a4d8-4ccc-8ac5-93304a700517 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:57.587061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a61569-a4d8-4ccc-8ac5-93304a700517 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:57.597458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a61569-a4d8-4ccc-8ac5-93304a700517 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:57.600857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a61569-a4d8-4ccc-8ac5-93304a700517 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:57.623325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-90a61569-a4d8-4ccc-8ac5-93304a700517 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:57.623325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:57.623325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:57.623325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:57.623325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:57.623325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:57.623325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:57.623325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:57.623325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:57.623325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:57.623325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:57.623325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:57.623325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:34:57.623325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:34:57.623325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:57.624680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:57.625801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:34:57.625801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:34:57.625801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:34:57.625801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:34:57.625801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:34:57.625801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:34:57.625801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:34:57.625801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:57.629346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 474/953] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:57.637041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd21cee-ad41-47cf-8f0e-100958bb76e3 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:57.780400 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd21cee-ad41-47cf-8f0e-100958bb76e3 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:57.827654 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fb9bf-6747-459a-bbf9-7385f0283562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:57.828362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fb9bf-6747-459a-bbf9-7385f0283562 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:57.828644 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fb9bf-6747-459a-bbf9-7385f0283562 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:57.828992 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fb9bf-6747-459a-bbf9-7385f0283562 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:57.829949 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fb9bf-6747-459a-bbf9-7385f0283562 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:57.830267 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fb9bf-6747-459a-bbf9-7385f0283562 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:57.832356 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fb9bf-6747-459a-bbf9-7385f0283562 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:57.851222 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 480/954] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:34:57.857844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a61569-a4d8-4ccc-8ac5-93304a700517 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:57.899984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:57.999013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a61569-a4d8-4ccc-8ac5-93304a700517 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:58.039835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee1742-74e1-4fd7-81ef-10965e90b38e None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:58.040135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee1742-74e1-4fd7-81ef-10965e90b38e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:58.040320 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec618137-6cfd-44f8-8e26-310e60d91796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:58.040452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee1742-74e1-4fd7-81ef-10965e90b38e None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:58.041620 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec618137-6cfd-44f8-8e26-310e60d91796 None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:58.042060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec618137-6cfd-44f8-8e26-310e60d91796 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:58.042482 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec618137-6cfd-44f8-8e26-310e60d91796 None admin] PATH_INFO: `/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/06f2efcb8c6646658934a3ab55ab5744/roles/6a1901e356224f31b647f4ae3aeb3d37` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:58.043154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 481/955] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:34:58.046061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec618137-6cfd-44f8-8e26-310e60d91796 None admin] RBAC: Authorizing `identity:create_grant(project_id=9be90db8d7ee4bd0b01444d1eab83ad8, user_id=06f2efcb8c6646658934a3ab55ab5744, role_id=6a1901e356224f31b647f4ae3aeb3d37)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:58.047513 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780ed6b-3e00-4830-b4e5-1ed7069188f1 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:58.047807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780ed6b-3e00-4830-b4e5-1ed7069188f1 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:58.048092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780ed6b-3e00-4830-b4e5-1ed7069188f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:58.048729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec618137-6cfd-44f8-8e26-310e60d91796 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:58.068945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-0780ed6b-3e00-4830-b4e5-1ed7069188f1 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:58.070555 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0780ed6b-3e00-4830-b4e5-1ed7069188f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:58.097583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:58.158445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 482/956] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:58 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:34:58.187794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780ed6b-3e00-4830-b4e5-1ed7069188f1 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:58.245163 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 475/957] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:34:57 2022] PUT /identity/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/06f2efcb8c6646658934a3ab55ab5744/roles/6a1901e356224f31b647f4ae3aeb3d37 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:34:58.369123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780ed6b-3e00-4830-b4e5-1ed7069188f1 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:58.431466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a02d8-1090-4455-920e-c95bdacf511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:58.432385 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a02d8-1090-4455-920e-c95bdacf511b None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:58.432689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a02d8-1090-4455-920e-c95bdacf511b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:58.432927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a02d8-1090-4455-920e-c95bdacf511b None admin] PATH_INFO: `/v3/services/compute` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:58.433601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a02d8-1090-4455-920e-c95bdacf511b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:58.435115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a02d8-1090-4455-920e-c95bdacf511b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-167a02d8-1090-4455-920e-c95bdacf511b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:58.450505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:58.451663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:58.452686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:58.452686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:58.452686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:58.452686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:58.452686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:58.452686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:58.452686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:58.452686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:58.452686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:58.452686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:58.452686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:34:58.452686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:34:58.452686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:34:58.452686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:58.458706 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 483/958] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:34:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:34:58.460864 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec618137-6cfd-44f8-8e26-310e60d91796 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:58.580845 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:58.598673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec618137-6cfd-44f8-8e26-310e60d91796 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:58.649030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a1861-2221-4694-9e08-61acfa41efbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:58.650524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a1861-2221-4694-9e08-61acfa41efbb None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:58.651047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a1861-2221-4694-9e08-61acfa41efbb None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:58.651560 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a1861-2221-4694-9e08-61acfa41efbb None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:58.652440 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a1861-2221-4694-9e08-61acfa41efbb None admin] RBAC: Adding query filter params (name=compute) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:58.652761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a1861-2221-4694-9e08-61acfa41efbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:58.654197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a1861-2221-4694-9e08-61acfa41efbb None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:58.662064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 476/959] 10.222.0.112 () {56 vars in 1117 bytes} [Thu May 26 16:34:58 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:58.670655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a02d8-1090-4455-920e-c95bdacf511b None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:58.703745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:58.829428 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a02d8-1090-4455-920e-c95bdacf511b None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:58.869937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c9df5-dc23-4462-986f-42c69087872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:58.870682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c9df5-dc23-4462-986f-42c69087872f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:58.870972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c9df5-dc23-4462-986f-42c69087872f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:58.871250 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c9df5-dc23-4462-986f-42c69087872f None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:58.871974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c9df5-dc23-4462-986f-42c69087872f None admin] RBAC: Adding query filter params (type=compute) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:34:58.872280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c9df5-dc23-4462-986f-42c69087872f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:58.873720 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c9df5-dc23-4462-986f-42c69087872f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:58.886488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 484/960] 10.222.0.112 () {56 vars in 1117 bytes} [Thu May 26 16:34:58 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:34:59.078562 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a264d-7f35-4f2f-ab26-4df0717a52fb None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:59.078889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a264d-7f35-4f2f-ab26-4df0717a52fb None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:59.079051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a264d-7f35-4f2f-ab26-4df0717a52fb None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:59.080940 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 477/961] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:34:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:59.092445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8bc2-48ba-495f-a392-3f1725be9894 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:59.092818 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8bc2-48ba-495f-a392-3f1725be9894 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:59.093064 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8bc2-48ba-495f-a392-3f1725be9894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:59.114949 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-801a8bc2-48ba-495f-a392-3f1725be9894 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:59.116167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-801a8bc2-48ba-495f-a392-3f1725be9894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:59.212901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 485/962] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:34:59 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:34:59.242116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a264d-7f35-4f2f-ab26-4df0717a52fb None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:59.370820 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a264d-7f35-4f2f-ab26-4df0717a52fb None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:59.408125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6625f-1f2c-46d1-bc6a-b2daa1679dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:59.409431 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6625f-1f2c-46d1-bc6a-b2daa1679dbb None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:59.409718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6625f-1f2c-46d1-bc6a-b2daa1679dbb None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:59.409991 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6625f-1f2c-46d1-bc6a-b2daa1679dbb None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:59.410734 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6625f-1f2c-46d1-bc6a-b2daa1679dbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:59.412310 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6625f-1f2c-46d1-bc6a-b2daa1679dbb None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:59.413993 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: WARNING keystone.server.flask.common [None req-b4c6625f-1f2c-46d1-bc6a-b2daa1679dbb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 16:34:59.472245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.sql.core [None req-b4c6625f-1f2c-46d1-bc6a-b2daa1679dbb None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 16:34:59.472245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 16:34:59.472245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [parameters: {'user_id': '5efc687ea1ad47daa50859c4ee584e35', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 16:34:59.472245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87034) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 16:34:59.505013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-b4c6625f-1f2c-46d1-bc6a-b2daa1679dbb None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 16:34:59.505013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:59.505013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:34:59.505013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:34:59.505013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:34:59.505013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:34:59.505013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:34:59.505013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:34:59.505013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:34:59.505013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application conn.query(q) May 26 16:34:59.505013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:34:59.505013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:34:59.505013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:34:59.505013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application result.read() May 26 16:34:59.505013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:34:59.505983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application next(self.gen) May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application yield resource May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application next(self.gen) May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self.session.rollback() May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self.force_reraise() May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise self.value May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application session.commit() May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 16:34:59.507073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._prepare_impl() May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self.session.flush() May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._flush(objects) May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application compat.raise_( May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application flush_context.execute() May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rec.execute(self) May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 16:34:59.508006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:34:59.508979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application conn.query(q) May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application result.read() May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:34:59.509838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:34:59.518715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:34:59.518715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:34:59.518715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:34:59.518715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:34:59.518715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 16:34:59.518715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 16:34:59.518715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [parameters: {'user_id': '5efc687ea1ad47daa50859c4ee584e35', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 16:34:59.518715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 16:34:59.518715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:59.518715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:34:59.518715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:59.518715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:59.518715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:59.518715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:59.518715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 16:34:59.520164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 16:34:59.521857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 16:34:59.521857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 16:34:59.521857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 16:34:59.521857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 16:34:59.521857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 16:34:59.521857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:34:59.521857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 478/963] 10.222.0.112 () {60 vars in 1136 bytes} [Thu May 26 16:34:59 2022] POST /identity/v3/users => generated 160 bytes in 266 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:59.522679 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a8bc2-48ba-495f-a392-3f1725be9894 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:59.540383 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:59.700000 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a8bc2-48ba-495f-a392-3f1725be9894 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:59.763305 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0db1b-4920-4d82-860d-16838af1e553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:59.764684 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0db1b-4920-4d82-860d-16838af1e553 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:59.765175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0db1b-4920-4d82-860d-16838af1e553 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:59.765670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0db1b-4920-4d82-860d-16838af1e553 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:59.780413 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0db1b-4920-4d82-860d-16838af1e553 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:59.783189 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0db1b-4920-4d82-860d-16838af1e553 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-6df0db1b-4920-4d82-860d-16838af1e553 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:34:59.817165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:34:59.819689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:34:59.821953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:34:59.821953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:34:59.821953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:34:59.821953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:34:59.821953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:34:59.821953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:34:59.821953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:34:59.821953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:34:59.821953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:34:59.821953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:34:59.826495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 486/964] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:34:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:34:59.829437 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6625f-1f2c-46d1-bc6a-b2daa1679dbb None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:59.859656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:00.010304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6625f-1f2c-46d1-bc6a-b2daa1679dbb None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:00.051278 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb38bdb-e213-4cc9-a9cf-97b7e906e4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:00.051975 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb38bdb-e213-4cc9-a9cf-97b7e906e4ce None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:00.052257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb38bdb-e213-4cc9-a9cf-97b7e906e4ce None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:00.052538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb38bdb-e213-4cc9-a9cf-97b7e906e4ce None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:00.053354 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb38bdb-e213-4cc9-a9cf-97b7e906e4ce None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:00.053662 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb38bdb-e213-4cc9-a9cf-97b7e906e4ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:00.055358 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb38bdb-e213-4cc9-a9cf-97b7e906e4ce None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:00.101520 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 479/965] 10.222.0.112 () {56 vars in 1106 bytes} [Thu May 26 16:34:59 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:00.240541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32e4f2-d3f1-4f30-85ef-3be8b6f664c2 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:00.240541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32e4f2-d3f1-4f30-85ef-3be8b6f664c2 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:00.240541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32e4f2-d3f1-4f30-85ef-3be8b6f664c2 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:00.241721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 487/966] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:00 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:00.248970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b841d80-3a63-40ae-8f75-99b866ad8d75 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:00.249464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b841d80-3a63-40ae-8f75-99b866ad8d75 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:00.249933 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b841d80-3a63-40ae-8f75-99b866ad8d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:00.280047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-0b841d80-3a63-40ae-8f75-99b866ad8d75 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:00.282663 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0b841d80-3a63-40ae-8f75-99b866ad8d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:00.404694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:00.413429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 480/967] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:00 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:35:00.440118 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32e4f2-d3f1-4f30-85ef-3be8b6f664c2 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:00.554133 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:00.589903 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32e4f2-d3f1-4f30-85ef-3be8b6f664c2 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:00.634146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c330973-7a3f-426b-956d-62e174bb6c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:00.634983 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c330973-7a3f-426b-956d-62e174bb6c30 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:00.635265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c330973-7a3f-426b-956d-62e174bb6c30 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:00.635655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c330973-7a3f-426b-956d-62e174bb6c30 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:00.636387 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c330973-7a3f-426b-956d-62e174bb6c30 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:00.637764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c330973-7a3f-426b-956d-62e174bb6c30 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-8c330973-7a3f-426b-956d-62e174bb6c30 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:00.651793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:00.653263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:00.654119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:00.654119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:35:00.654119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:00.654119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:00.654119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:00.654119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:00.654119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:00.654119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:00.654119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:00.654119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:00.654119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:35:00.654119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:35:00.654119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:35:00.654119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:00.662192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 488/968] 10.222.0.112 () {56 vars in 1131 bytes} [Thu May 26 16:35:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:00.662357 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b841d80-3a63-40ae-8f75-99b866ad8d75 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:00.806691 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b841d80-3a63-40ae-8f75-99b866ad8d75 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:00.860924 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882177d9-0303-4dec-9a00-1bbc94a3292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:00.862266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882177d9-0303-4dec-9a00-1bbc94a3292e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:00.862585 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882177d9-0303-4dec-9a00-1bbc94a3292e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:00.863031 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882177d9-0303-4dec-9a00-1bbc94a3292e None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:00.863815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882177d9-0303-4dec-9a00-1bbc94a3292e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:00.864182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882177d9-0303-4dec-9a00-1bbc94a3292e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:00.866079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882177d9-0303-4dec-9a00-1bbc94a3292e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:00.878682 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 481/969] 10.222.0.112 () {56 vars in 1127 bytes} [Thu May 26 16:35:00 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:00.880388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c330973-7a3f-426b-956d-62e174bb6c30 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:01.073041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c330973-7a3f-426b-956d-62e174bb6c30 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:01.135772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b36fa-8719-41f0-a778-c685fc6c88e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:01.136903 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b36fa-8719-41f0-a778-c685fc6c88e0 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:01.137392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b36fa-8719-41f0-a778-c685fc6c88e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:01.137894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b36fa-8719-41f0-a778-c685fc6c88e0 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:01.139235 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b36fa-8719-41f0-a778-c685fc6c88e0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:01.139784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b36fa-8719-41f0-a778-c685fc6c88e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:01.142356 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b36fa-8719-41f0-a778-c685fc6c88e0 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:01.159257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 489/970] 10.222.0.112 () {56 vars in 1127 bytes} [Thu May 26 16:35:00 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:01.161481 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882177d9-0303-4dec-9a00-1bbc94a3292e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:01.245466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2784-9a3a-49b0-a45d-9d8c817d6d86 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:01.245792 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2784-9a3a-49b0-a45d-9d8c817d6d86 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:01.246025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2784-9a3a-49b0-a45d-9d8c817d6d86 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:01.247647 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 490/971] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:35:01.253768 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521ad29-3ac7-4401-ad69-5be6057675cc None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:01.254042 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521ad29-3ac7-4401-ad69-5be6057675cc None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:01.254385 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521ad29-3ac7-4401-ad69-5be6057675cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:01.259902 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:01.277707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:01.288843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e521ad29-3ac7-4401-ad69-5be6057675cc None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:01.291757 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e521ad29-3ac7-4401-ad69-5be6057675cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:01.355402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882177d9-0303-4dec-9a00-1bbc94a3292e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:01.404493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683040d6-90d5-4362-8c77-3671bfd6c201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:01.405436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 491/972] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:01 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:35:01.405667 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683040d6-90d5-4362-8c77-3671bfd6c201 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:01.406181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683040d6-90d5-4362-8c77-3671bfd6c201 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:01.406794 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683040d6-90d5-4362-8c77-3671bfd6c201 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:01.409101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683040d6-90d5-4362-8c77-3671bfd6c201 None admin] RBAC: Adding query filter params (interface=admin, service_id=fb1b7f42d6db493c86207fbf4f295716, region_id=RegionOne) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:01.409749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683040d6-90d5-4362-8c77-3671bfd6c201 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:01.412546 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683040d6-90d5-4362-8c77-3671bfd6c201 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:01.430907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 482/973] 10.222.0.112 () {56 vars in 1254 bytes} [Thu May 26 16:35:01 2022] GET /identity/v3/endpoints?service_id=fb1b7f42d6db493c86207fbf4f295716&interface=admin®ion_id=RegionOne => generated 194 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:01.431998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521ad29-3ac7-4401-ad69-5be6057675cc None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:01.432434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683040d6-90d5-4362-8c77-3671bfd6c201 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:01.564420 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683040d6-90d5-4362-8c77-3671bfd6c201 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:01.570920 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521ad29-3ac7-4401-ad69-5be6057675cc None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:01.597542 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:01.608385 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491279a0-f4e1-410e-a82f-10a6681a97f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:01.609314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:01.609632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491279a0-f4e1-410e-a82f-10a6681a97f7 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:01.610156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491279a0-f4e1-410e-a82f-10a6681a97f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:01.610693 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491279a0-f4e1-410e-a82f-10a6681a97f7 None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:01.614849 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491279a0-f4e1-410e-a82f-10a6681a97f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:01.615978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491279a0-f4e1-410e-a82f-10a6681a97f7 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:01.617129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee190b-c8aa-44e8-b57d-d9057aa4ecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:01.618437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee190b-c8aa-44e8-b57d-d9057aa4ecbc None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:01.618898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee190b-c8aa-44e8-b57d-d9057aa4ecbc None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:01.619587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee190b-c8aa-44e8-b57d-d9057aa4ecbc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:01.626256 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 483/974] 10.222.0.112 () {56 vars in 1092 bytes} [Thu May 26 16:35:01 2022] GET /identity/v3/services => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:35:01.641690 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee190b-c8aa-44e8-b57d-d9057aa4ecbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-f8ee190b-c8aa-44e8-b57d-d9057aa4ecbc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:35:01.652581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:01.653802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:01.654770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:01.654770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:01.654770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:01.654770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:01.654770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:35:01.654770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:35:01.654770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:35:01.654770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:35:01.654770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:35:01.654770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:35:01.654770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:35:01.654770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:01.660826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 492/975] 10.222.0.112 () {56 vars in 1125 bytes} [Thu May 26 16:35:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:01.662933 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491279a0-f4e1-410e-a82f-10a6681a97f7 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:01.666946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d81c-8e8a-4263-9281-f49baca87c78 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:01.667242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d81c-8e8a-4263-9281-f49baca87c78 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:01.667519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d81c-8e8a-4263-9281-f49baca87c78 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:01.668961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 493/976] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:35:01.675588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a381ec-81a4-4ce2-b9f3-77738324d7fd None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:01.675863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a381ec-81a4-4ce2-b9f3-77738324d7fd None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:01.676136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a381ec-81a4-4ce2-b9f3-77738324d7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:01.701072 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-65a381ec-81a4-4ce2-b9f3-77738324d7fd None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:01.703059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-65a381ec-81a4-4ce2-b9f3-77738324d7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:01.812400 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 494/977] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:01 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:35:01.841835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a381ec-81a4-4ce2-b9f3-77738324d7fd None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:01.847034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491279a0-f4e1-410e-a82f-10a6681a97f7 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:01.909743 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce1638-b280-4812-8d9e-a4a8de3445d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:01.910630 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce1638-b280-4812-8d9e-a4a8de3445d6 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:01.910914 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce1638-b280-4812-8d9e-a4a8de3445d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:01.911225 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce1638-b280-4812-8d9e-a4a8de3445d6 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:01.912431 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce1638-b280-4812-8d9e-a4a8de3445d6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:01.912878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce1638-b280-4812-8d9e-a4a8de3445d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:01.914155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce1638-b280-4812-8d9e-a4a8de3445d6 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:01.924414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 484/978] 10.222.0.112 () {56 vars in 1120 bytes} [Thu May 26 16:35:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:01.931210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce1638-b280-4812-8d9e-a4a8de3445d6 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:01.992974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a381ec-81a4-4ce2-b9f3-77738324d7fd None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:02.024033 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:02.027796 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:02.048798 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542476d4-49b5-4903-a2c2-672cd553139e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:02.050008 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542476d4-49b5-4903-a2c2-672cd553139e None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:02.050543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542476d4-49b5-4903-a2c2-672cd553139e None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:02.051533 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542476d4-49b5-4903-a2c2-672cd553139e None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:02.052772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542476d4-49b5-4903-a2c2-672cd553139e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:02.055453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542476d4-49b5-4903-a2c2-672cd553139e None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:02.086388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce1638-b280-4812-8d9e-a4a8de3445d6 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:02.140002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402ffa6-6046-4640-b13b-6e69982e2f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:02.140816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402ffa6-6046-4640-b13b-6e69982e2f8a None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:02.141100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402ffa6-6046-4640-b13b-6e69982e2f8a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:02.141380 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402ffa6-6046-4640-b13b-6e69982e2f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:02.154230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402ffa6-6046-4640-b13b-6e69982e2f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:02.156125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402ffa6-6046-4640-b13b-6e69982e2f8a None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:02.180251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-a402ffa6-6046-4640-b13b-6e69982e2f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:02.180251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:02.180251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:02.180251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:02.180251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:02.180251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:02.180251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:02.180251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:02.180251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:02.180251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:02.180251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:02.180251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:02.180251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:35:02.180251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:35:02.180251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:02.181332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:02.182257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:35:02.182257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:35:02.182257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:02.182257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:02.186131 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 485/979] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:35:02.187248 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402ffa6-6046-4640-b13b-6e69982e2f8a None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:02.256637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 495/980] 10.222.0.112 () {60 vars in 1146 bytes} [Thu May 26 16:35:01 2022] POST /identity/v3/services => generated 243 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:35:02.381727 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402ffa6-6046-4640-b13b-6e69982e2f8a None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:02.396327 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:02.456109 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8ece2-bbe8-4284-809b-83751223e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:02.456933 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ece2-bbe8-4284-809b-83751223e731 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:02.457381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ece2-bbe8-4284-809b-83751223e731 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:02.457668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ece2-bbe8-4284-809b-83751223e731 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:02.458436 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8ece2-bbe8-4284-809b-83751223e731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:02.458782 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8ece2-bbe8-4284-809b-83751223e731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:02.460316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8ece2-bbe8-4284-809b-83751223e731 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:02.475270 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 486/981] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:35:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:02.481047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542476d4-49b5-4903-a2c2-672cd553139e None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:02.623029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542476d4-49b5-4903-a2c2-672cd553139e None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:02.663248 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f41ee-8621-4edd-9afa-b54e6f79ca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:02.664693 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f41ee-8621-4edd-9afa-b54e6f79ca59 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:02.665133 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f41ee-8621-4edd-9afa-b54e6f79ca59 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:02.665562 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f41ee-8621-4edd-9afa-b54e6f79ca59 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:02.679659 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f41ee-8621-4edd-9afa-b54e6f79ca59 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:02.682695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f41ee-8621-4edd-9afa-b54e6f79ca59 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-968f41ee-8621-4edd-9afa-b54e6f79ca59 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:35:02.706015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:02.707276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:02.708272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:02.708272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:02.708272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:35:02.708272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:35:02.708272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:35:02.708272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:35:02.708272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:35:02.708272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:35:02.708272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:35:02.708272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:02.713693 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 496/982] 10.222.0.112 () {56 vars in 1122 bytes} [Thu May 26 16:35:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:02.714984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8ece2-bbe8-4284-809b-83751223e731 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:02.884603 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8ece2-bbe8-4284-809b-83751223e731 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:02.933008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc6715-3a61-4869-ba60-5017cc1e223e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:02.933803 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc6715-3a61-4869-ba60-5017cc1e223e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:02.934092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc6715-3a61-4869-ba60-5017cc1e223e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:02.943812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc6715-3a61-4869-ba60-5017cc1e223e None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:02.943812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc6715-3a61-4869-ba60-5017cc1e223e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:02.943812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc6715-3a61-4869-ba60-5017cc1e223e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:02.943812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc6715-3a61-4869-ba60-5017cc1e223e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:02.964055 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 487/983] 10.222.0.112 () {56 vars in 1154 bytes} [Thu May 26 16:35:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:02.965753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f41ee-8621-4edd-9afa-b54e6f79ca59 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:03.038721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:03.120938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f41ee-8621-4edd-9afa-b54e6f79ca59 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:03.173877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824ab58-3119-43d5-b887-6195b03d3f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:03.175117 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824ab58-3119-43d5-b887-6195b03d3f18 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:03.175614 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824ab58-3119-43d5-b887-6195b03d3f18 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:03.176086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824ab58-3119-43d5-b887-6195b03d3f18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:03.280655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824ab58-3119-43d5-b887-6195b03d3f18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:03.282003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824ab58-3119-43d5-b887-6195b03d3f18 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:03.337116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:03.413810 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 497/984] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:35:02 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:35:03.419865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc6715-3a61-4869-ba60-5017cc1e223e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:03.455578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:03.591369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc6715-3a61-4869-ba60-5017cc1e223e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:03.638807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28b6e0-3b92-483e-9988-ea7b3265f7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:03.639609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28b6e0-3b92-483e-9988-ea7b3265f7b6 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:03.639892 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28b6e0-3b92-483e-9988-ea7b3265f7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:03.640166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28b6e0-3b92-483e-9988-ea7b3265f7b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:03.654537 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28b6e0-3b92-483e-9988-ea7b3265f7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:03.656469 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28b6e0-3b92-483e-9988-ea7b3265f7b6 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:03.685594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-2c28b6e0-3b92-483e-9988-ea7b3265f7b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:03.685594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:03.685594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:03.685594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:03.685594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:03.685594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:03.685594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:03.685594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:03.685594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:03.685594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:03.685594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:03.685594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:03.685594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:35:03.685594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:35:03.685594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:03.687326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:03.688236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:35:03.688236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:35:03.688236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:03.688236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:03.693920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 488/985] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:35:03.695126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824ab58-3119-43d5-b887-6195b03d3f18 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:03.854117 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824ab58-3119-43d5-b887-6195b03d3f18 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:03.897580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7264d-3a1b-470b-8701-870c1ebba202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:03.898634 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7264d-3a1b-470b-8701-870c1ebba202 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:03.899104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7264d-3a1b-470b-8701-870c1ebba202 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:03.899537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7264d-3a1b-470b-8701-870c1ebba202 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:03.900746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7264d-3a1b-470b-8701-870c1ebba202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:03.901259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7264d-3a1b-470b-8701-870c1ebba202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:03.903612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7264d-3a1b-470b-8701-870c1ebba202 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:03.930050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 498/986] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:35:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:03.932146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28b6e0-3b92-483e-9988-ea7b3265f7b6 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:04.064676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:04.103033 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28b6e0-3b92-483e-9988-ea7b3265f7b6 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:04.155061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2640d4-55a7-49fd-a1e2-3a1688366186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:04.155932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2640d4-55a7-49fd-a1e2-3a1688366186 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:04.156207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2640d4-55a7-49fd-a1e2-3a1688366186 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:04.156491 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2640d4-55a7-49fd-a1e2-3a1688366186 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:04.165341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2640d4-55a7-49fd-a1e2-3a1688366186 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:04.167157 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2640d4-55a7-49fd-a1e2-3a1688366186 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:04.183610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-8e2640d4-55a7-49fd-a1e2-3a1688366186 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:35:04.183610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:04.183610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:04.183610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:04.183610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:04.183610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:04.183610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:04.183610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:04.183610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:04.183610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:04.183610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:04.183610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:04.183610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:35:04.183610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:35:04.183610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:04.184612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:04.191199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:35:04.191199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:35:04.191199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:35:04.191199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:35:04.191199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:35:04.191199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:35:04.191199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:35:04.191199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:04.191199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 489/987] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:35:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:04.193910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7264d-3a1b-470b-8701-870c1ebba202 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:04.202302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:04.339801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7264d-3a1b-470b-8701-870c1ebba202 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:04.352329 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d73da3-3439-4ed5-b464-bfd6bee46477 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:04.352711 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d73da3-3439-4ed5-b464-bfd6bee46477 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:04.353063 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d73da3-3439-4ed5-b464-bfd6bee46477 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:04.355247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 490/988] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:35:04.361161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafd199-b179-447a-8b1d-b1d56de43b66 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:04.361549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafd199-b179-447a-8b1d-b1d56de43b66 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:04.361709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafd199-b179-447a-8b1d-b1d56de43b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:04.397558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-6bafd199-b179-447a-8b1d-b1d56de43b66 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:04.398433 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345d74f-0f95-4df5-8aa2-827e2ad75a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:04.398958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-6bafd199-b179-447a-8b1d-b1d56de43b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:04.399291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345d74f-0f95-4df5-8aa2-827e2ad75a96 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:04.399726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345d74f-0f95-4df5-8aa2-827e2ad75a96 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:04.400162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345d74f-0f95-4df5-8aa2-827e2ad75a96 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:04.401657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345d74f-0f95-4df5-8aa2-827e2ad75a96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:04.403433 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345d74f-0f95-4df5-8aa2-827e2ad75a96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:04.404628 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345d74f-0f95-4df5-8aa2-827e2ad75a96 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:04.427735 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 499/989] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:35:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:04.429840 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345d74f-0f95-4df5-8aa2-827e2ad75a96 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:04.488979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 491/990] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:04 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:35:04.508806 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:04.511377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafd199-b179-447a-8b1d-b1d56de43b66 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:04.557354 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345d74f-0f95-4df5-8aa2-827e2ad75a96 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:04.602690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:04.617212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19ecea-7891-4cca-b61b-830e6ac0c052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:04.621174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19ecea-7891-4cca-b61b-830e6ac0c052 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:04.621174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19ecea-7891-4cca-b61b-830e6ac0c052 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:04.621174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19ecea-7891-4cca-b61b-830e6ac0c052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:04.621174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19ecea-7891-4cca-b61b-830e6ac0c052 None admin] RBAC: Adding query filter params (role.id=6a1901e356224f31b647f4ae3aeb3d37, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=06f2efcb8c6646658934a3ab55ab5744) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:04.621174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19ecea-7891-4cca-b61b-830e6ac0c052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:04.621174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19ecea-7891-4cca-b61b-830e6ac0c052 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:04.627490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 500/991] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:35:04 2022] GET /identity/v3/role_assignments?user.id=06f2efcb8c6646658934a3ab55ab5744&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=6a1901e356224f31b647f4ae3aeb3d37 => generated 610 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:04.627490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a3464-15cd-41ee-b301-ccb5f7bfa248 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:04.627490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a3464-15cd-41ee-b301-ccb5f7bfa248 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:04.627490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a3464-15cd-41ee-b301-ccb5f7bfa248 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:04.627490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 501/992] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:04.642047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e98e8-ce01-491a-bb6f-e3e4a5442e48 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:04.642047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e98e8-ce01-491a-bb6f-e3e4a5442e48 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:04.642047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e98e8-ce01-491a-bb6f-e3e4a5442e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:04.657157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-fe2e98e8-ce01-491a-bb6f-e3e4a5442e48 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:04.659400 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-fe2e98e8-ce01-491a-bb6f-e3e4a5442e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:04.668781 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafd199-b179-447a-8b1d-b1d56de43b66 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:04.713856 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee351e0-509b-4bd9-b866-ff2f4e9b28b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:04.714673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee351e0-509b-4bd9-b866-ff2f4e9b28b0 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:04.714963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee351e0-509b-4bd9-b866-ff2f4e9b28b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:04.715333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee351e0-509b-4bd9-b866-ff2f4e9b28b0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:04.716121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee351e0-509b-4bd9-b866-ff2f4e9b28b0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:04.717594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee351e0-509b-4bd9-b866-ff2f4e9b28b0 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-dee351e0-509b-4bd9-b866-ff2f4e9b28b0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:04.734539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:04.735721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:04.737901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:04.737901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:04.737901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:04.737901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:04.737901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:04.737901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:04.737901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:04.737901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:04.737901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:04.737901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:04.737901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:35:04.737901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:35:04.737901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:35:04.737901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:04.737901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 492/993] 10.222.0.112 () {56 vars in 1131 bytes} [Thu May 26 16:35:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:04.746250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee351e0-509b-4bd9-b866-ff2f4e9b28b0 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:04.794078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 502/994] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:04 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:35:04.819946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e98e8-ce01-491a-bb6f-e3e4a5442e48 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:04.902426 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:04.908662 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee351e0-509b-4bd9-b866-ff2f4e9b28b0 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:04.951216 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:04.964123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b42103-39b5-484a-911e-77caa0a7c160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:04.964913 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b42103-39b5-484a-911e-77caa0a7c160 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:04.965326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b42103-39b5-484a-911e-77caa0a7c160 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:04.965684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b42103-39b5-484a-911e-77caa0a7c160 None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:04.966696 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b42103-39b5-484a-911e-77caa0a7c160 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:04.967075 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b42103-39b5-484a-911e-77caa0a7c160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:04.968913 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b42103-39b5-484a-911e-77caa0a7c160 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:04.971482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e98e8-ce01-491a-bb6f-e3e4a5442e48 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:04.987733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 493/995] 10.222.0.112 () {56 vars in 1127 bytes} [Thu May 26 16:35:04 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:04.989822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b42103-39b5-484a-911e-77caa0a7c160 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:05.022150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2050bba-3182-4a85-a391-116ee47b8d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:05.024868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2050bba-3182-4a85-a391-116ee47b8d29 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:05.025346 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2050bba-3182-4a85-a391-116ee47b8d29 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:05.025819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2050bba-3182-4a85-a391-116ee47b8d29 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:05.026696 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2050bba-3182-4a85-a391-116ee47b8d29 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:05.028458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2050bba-3182-4a85-a391-116ee47b8d29 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-b2050bba-3182-4a85-a391-116ee47b8d29 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:05.044322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:05.046043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:05.048038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:05.048038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:35:05.048038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:05.048038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:05.048038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:05.048038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:05.048038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:05.048038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:05.048038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:05.048038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:05.048038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:35:05.048038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:35:05.048038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:35:05.048038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:05.048038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 503/996] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:35:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:05.055160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2050bba-3182-4a85-a391-116ee47b8d29 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:05.151455 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b42103-39b5-484a-911e-77caa0a7c160 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:05.203273 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2050bba-3182-4a85-a391-116ee47b8d29 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:05.219063 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c38f5-221d-468d-ae89-29c6ea12d884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:05.219672 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c38f5-221d-468d-ae89-29c6ea12d884 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:05.219988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c38f5-221d-468d-ae89-29c6ea12d884 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:05.220329 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c38f5-221d-468d-ae89-29c6ea12d884 None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:05.221905 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c38f5-221d-468d-ae89-29c6ea12d884 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:05.221905 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c38f5-221d-468d-ae89-29c6ea12d884 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:05.223547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c38f5-221d-468d-ae89-29c6ea12d884 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:05.233572 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 494/997] 10.222.0.112 () {56 vars in 1127 bytes} [Thu May 26 16:35:04 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:05.233761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:05.234748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c38f5-221d-468d-ae89-29c6ea12d884 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:05.255312 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c729b3a-b790-4305-9742-02d7affad56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:05.256082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c729b3a-b790-4305-9742-02d7affad56a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:05.256383 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c729b3a-b790-4305-9742-02d7affad56a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:05.256658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c729b3a-b790-4305-9742-02d7affad56a None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:05.257372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c729b3a-b790-4305-9742-02d7affad56a None admin] RBAC: Adding query filter params (name=compute) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:05.257683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c729b3a-b790-4305-9742-02d7affad56a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:05.259182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c729b3a-b790-4305-9742-02d7affad56a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:05.266401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 504/998] 10.222.0.112 () {56 vars in 1117 bytes} [Thu May 26 16:35:05 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:05.272622 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c729b3a-b790-4305-9742-02d7affad56a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:05.313597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:05.377247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c38f5-221d-468d-ae89-29c6ea12d884 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:05.438850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c729b3a-b790-4305-9742-02d7affad56a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:05.446908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ae953-d3fa-440d-b4dc-e0fac52f2fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:05.447950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ae953-d3fa-440d-b4dc-e0fac52f2fab None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:05.448408 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ae953-d3fa-440d-b4dc-e0fac52f2fab None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:05.448869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ae953-d3fa-440d-b4dc-e0fac52f2fab None admin] PATH_INFO: `/v3/endpoints` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:05.450127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ae953-d3fa-440d-b4dc-e0fac52f2fab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:05.452564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ae953-d3fa-440d-b4dc-e0fac52f2fab None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:05.488974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5b1af-d2f7-410d-8ff1-14e277433da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:05.489556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5b1af-d2f7-410d-8ff1-14e277433da0 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:05.489835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5b1af-d2f7-410d-8ff1-14e277433da0 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:05.490108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5b1af-d2f7-410d-8ff1-14e277433da0 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:05.490903 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5b1af-d2f7-410d-8ff1-14e277433da0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:05.491344 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5b1af-d2f7-410d-8ff1-14e277433da0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:05.492777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5b1af-d2f7-410d-8ff1-14e277433da0 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:05.498410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 505/999] 10.222.0.112 () {56 vars in 1117 bytes} [Thu May 26 16:35:05 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:05.504968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5b1af-d2f7-410d-8ff1-14e277433da0 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:05.554160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 495/1000] 10.222.0.112 () {60 vars in 1149 bytes} [Thu May 26 16:35:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:35:05.597236 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:05.686791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5b1af-d2f7-410d-8ff1-14e277433da0 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:05.747560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8fd06-62dc-4274-a53d-f82748fb2b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:05.748521 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8fd06-62dc-4274-a53d-f82748fb2b3d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:05.748866 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8fd06-62dc-4274-a53d-f82748fb2b3d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:05.749146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8fd06-62dc-4274-a53d-f82748fb2b3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:05.750011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8fd06-62dc-4274-a53d-f82748fb2b3d None admin] RBAC: Adding query filter params (interface=public, service_id=5e98e21bfad147d28f0ebf860050b1a8, region_id=RegionOne) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:05.750340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8fd06-62dc-4274-a53d-f82748fb2b3d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:05.752250 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8fd06-62dc-4274-a53d-f82748fb2b3d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:05.765634 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 506/1001] 10.222.0.112 () {56 vars in 1256 bytes} [Thu May 26 16:35:05 2022] GET /identity/v3/endpoints?service_id=5e98e21bfad147d28f0ebf860050b1a8&interface=public®ion_id=RegionOne => generated 195 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:05.767261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ae953-d3fa-440d-b4dc-e0fac52f2fab None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:05.915169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ae953-d3fa-440d-b4dc-e0fac52f2fab None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:05.932296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:05.955530 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6134bf-c4e6-448d-9bab-c3903e5757d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:05.956871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6134bf-c4e6-448d-9bab-c3903e5757d8 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:05.956871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6134bf-c4e6-448d-9bab-c3903e5757d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:05.957130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6134bf-c4e6-448d-9bab-c3903e5757d8 None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:05.957824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6134bf-c4e6-448d-9bab-c3903e5757d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:05.960267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6134bf-c4e6-448d-9bab-c3903e5757d8 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:05.969908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 496/1002] 10.222.0.112 () {56 vars in 1092 bytes} [Thu May 26 16:35:05 2022] GET /identity/v3/services => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:35:07.073229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4c17f-3c6d-4db0-a3a3-c47fddd0d5fa None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:07.073809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4c17f-3c6d-4db0-a3a3-c47fddd0d5fa None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:07.074086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4c17f-3c6d-4db0-a3a3-c47fddd0d5fa None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:07.076742 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 507/1003] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:07 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:07.084252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07787657-c96b-416e-af13-a951d91f7d61 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:07.084753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07787657-c96b-416e-af13-a951d91f7d61 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:07.084831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07787657-c96b-416e-af13-a951d91f7d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:07.104030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-07787657-c96b-416e-af13-a951d91f7d61 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:07.105238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-07787657-c96b-416e-af13-a951d91f7d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:07.182223 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 497/1004] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:07 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:35:07.205668 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4c17f-3c6d-4db0-a3a3-c47fddd0d5fa None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:07.348084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4c17f-3c6d-4db0-a3a3-c47fddd0d5fa None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:07.357891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:07.396113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ed9b1-9890-438a-a37c-9a8e04edc2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:07.396910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ed9b1-9890-438a-a37c-9a8e04edc2e8 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:07.397192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ed9b1-9890-438a-a37c-9a8e04edc2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:07.397460 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ed9b1-9890-438a-a37c-9a8e04edc2e8 None admin] PATH_INFO: `/v3/services/image` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:07.398113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ed9b1-9890-438a-a37c-9a8e04edc2e8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:07.400012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ed9b1-9890-438a-a37c-9a8e04edc2e8 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-786ed9b1-9890-438a-a37c-9a8e04edc2e8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:07.418050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:07.419238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:07.425459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:07.425459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:35:07.425459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:07.425459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:07.425459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:07.425459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:07.425459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:07.425459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:07.425459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:07.425459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:07.425459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:35:07.425459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:35:07.425459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:35:07.425459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:07.425459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 508/1005] 10.222.0.112 () {56 vars in 1110 bytes} [Thu May 26 16:35:07 2022] GET /identity/v3/services/image => generated 86 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:07.427892 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07787657-c96b-416e-af13-a951d91f7d61 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:07.592593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07787657-c96b-416e-af13-a951d91f7d61 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:07.605006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:07.645316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07b85e-d334-4f0d-a1ea-c17fa5b7830b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:07.646001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07b85e-d334-4f0d-a1ea-c17fa5b7830b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:07.646283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07b85e-d334-4f0d-a1ea-c17fa5b7830b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:07.646656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07b85e-d334-4f0d-a1ea-c17fa5b7830b None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:07.647390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07b85e-d334-4f0d-a1ea-c17fa5b7830b None admin] RBAC: Adding query filter params (name=image) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:07.647704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07b85e-d334-4f0d-a1ea-c17fa5b7830b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:07.649112 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07b85e-d334-4f0d-a1ea-c17fa5b7830b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:07.655693 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 498/1006] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:07 2022] GET /identity/v3/services?name=image => generated 123 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:07.662175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ed9b1-9890-438a-a37c-9a8e04edc2e8 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:07.801703 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ed9b1-9890-438a-a37c-9a8e04edc2e8 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:07.863718 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610506e5-3303-44d4-bb2d-3b97219a8fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:07.864756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610506e5-3303-44d4-bb2d-3b97219a8fe3 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:07.865248 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610506e5-3303-44d4-bb2d-3b97219a8fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:07.865724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610506e5-3303-44d4-bb2d-3b97219a8fe3 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:07.867106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610506e5-3303-44d4-bb2d-3b97219a8fe3 None admin] RBAC: Adding query filter params (type=image) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:07.867646 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610506e5-3303-44d4-bb2d-3b97219a8fe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:07.870194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610506e5-3303-44d4-bb2d-3b97219a8fe3 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:07.886625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 509/1007] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:07 2022] GET /identity/v3/services?type=image => generated 123 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:08.110433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75250a90-8e3e-4276-b9e2-96a2946ecb4e None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:08.111535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75250a90-8e3e-4276-b9e2-96a2946ecb4e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:08.111535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75250a90-8e3e-4276-b9e2-96a2946ecb4e None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:08.113226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 499/1008] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:08 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:08.119393 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0501d-7baa-4381-8135-03696b9516f5 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:08.119909 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0501d-7baa-4381-8135-03696b9516f5 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:08.119909 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0501d-7baa-4381-8135-03696b9516f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:08.148054 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-64b0501d-7baa-4381-8135-03696b9516f5 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:08.149346 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-64b0501d-7baa-4381-8135-03696b9516f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:08.201841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:08.262399 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 510/1009] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:08 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:35:08.283806 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75250a90-8e3e-4276-b9e2-96a2946ecb4e None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:08.433342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75250a90-8e3e-4276-b9e2-96a2946ecb4e None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:08.495292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450bd0c-785e-4581-80e6-d2f4cc15cff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:08.496634 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450bd0c-785e-4581-80e6-d2f4cc15cff0 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:08.497126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450bd0c-785e-4581-80e6-d2f4cc15cff0 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:08.497610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450bd0c-785e-4581-80e6-d2f4cc15cff0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:08.499735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450bd0c-785e-4581-80e6-d2f4cc15cff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:08.502596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450bd0c-785e-4581-80e6-d2f4cc15cff0 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:08.510212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 500/1010] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:08 2022] GET /identity/v3/domains/default => generated 200 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:08.512102 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0501d-7baa-4381-8135-03696b9516f5 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:08.552919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547301c-a30a-490f-8dd5-0f1389bca7e4 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:08.553308 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547301c-a30a-490f-8dd5-0f1389bca7e4 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:08.553525 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547301c-a30a-490f-8dd5-0f1389bca7e4 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:08.555067 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 501/1011] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:35:08.561228 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ad692-cfb0-450f-949c-9450477c32ef None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:08.561535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ad692-cfb0-450f-949c-9450477c32ef None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:08.562059 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ad692-cfb0-450f-949c-9450477c32ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:08.580878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-d21ad692-cfb0-450f-949c-9450477c32ef None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:08.582160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d21ad692-cfb0-450f-949c-9450477c32ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:08.629535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:08.641109 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0501d-7baa-4381-8135-03696b9516f5 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:08.671228 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 502/1012] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:08 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:35:08.683911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9d796-9fc0-48bb-a42e-64095983628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:08.684592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9d796-9fc0-48bb-a42e-64095983628a None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:08.685011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9d796-9fc0-48bb-a42e-64095983628a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:08.685191 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9d796-9fc0-48bb-a42e-64095983628a None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:08.685856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9d796-9fc0-48bb-a42e-64095983628a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:08.687634 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9d796-9fc0-48bb-a42e-64095983628a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:08.695551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ad692-cfb0-450f-949c-9450477c32ef None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:08.818281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 511/1013] 10.222.0.112 () {60 vars in 1146 bytes} [Thu May 26 16:35:08 2022] POST /identity/v3/projects => generated 312 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:35:08.819963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ad692-cfb0-450f-949c-9450477c32ef None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:08.878151 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44b73f-30f7-46da-b588-979b5a9989ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:08.879394 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44b73f-30f7-46da-b588-979b5a9989ea None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:08.880048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44b73f-30f7-46da-b588-979b5a9989ea None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:08.880429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44b73f-30f7-46da-b588-979b5a9989ea None admin] PATH_INFO: `/v3/services/compute` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:08.881562 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44b73f-30f7-46da-b588-979b5a9989ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:08.884030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44b73f-30f7-46da-b588-979b5a9989ea None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-4c44b73f-30f7-46da-b588-979b5a9989ea None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:08.906492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:08.914500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:08.915954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:08.915954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:08.915954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:08.915954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:08.915954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:08.915954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:08.915954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:08.915954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:08.915954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:08.915954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:08.915954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:35:08.915954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:35:08.915954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:35:08.915954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:08.915954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 503/1014] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:35:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:35:08.923938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9d796-9fc0-48bb-a42e-64095983628a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:08.960623 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:09.086695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9d796-9fc0-48bb-a42e-64095983628a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:09.148353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531a755-b575-4b97-ae8b-92009cb9475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:09.150490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531a755-b575-4b97-ae8b-92009cb9475c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:09.150490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531a755-b575-4b97-ae8b-92009cb9475c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:09.150490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531a755-b575-4b97-ae8b-92009cb9475c None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:09.151438 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531a755-b575-4b97-ae8b-92009cb9475c None admin] RBAC: Adding query filter params (name=compute) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:09.151917 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531a755-b575-4b97-ae8b-92009cb9475c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:09.154548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531a755-b575-4b97-ae8b-92009cb9475c None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:09.163531 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 512/1015] 10.222.0.112 () {56 vars in 1117 bytes} [Thu May 26 16:35:08 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:09.171399 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44b73f-30f7-46da-b588-979b5a9989ea None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:09.213718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:09.308090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44b73f-30f7-46da-b588-979b5a9989ea None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:09.357587 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de5dd9-3be7-4370-8fd8-dee047c8cfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:09.358276 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de5dd9-3be7-4370-8fd8-dee047c8cfbf None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:09.358611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de5dd9-3be7-4370-8fd8-dee047c8cfbf None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:09.359064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de5dd9-3be7-4370-8fd8-dee047c8cfbf None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:09.359941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de5dd9-3be7-4370-8fd8-dee047c8cfbf None admin] RBAC: Adding query filter params (type=compute) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:09.360296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de5dd9-3be7-4370-8fd8-dee047c8cfbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:09.362882 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de5dd9-3be7-4370-8fd8-dee047c8cfbf None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:09.368802 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 504/1016] 10.222.0.112 () {56 vars in 1117 bytes} [Thu May 26 16:35:09 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:09.374249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531a755-b575-4b97-ae8b-92009cb9475c None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:09.490315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:09.511898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531a755-b575-4b97-ae8b-92009cb9475c None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:09.561745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd040a-97c4-46ca-8711-3539fffd79ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:09.562834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd040a-97c4-46ca-8711-3539fffd79ab None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:09.563125 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd040a-97c4-46ca-8711-3539fffd79ab None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:09.563396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd040a-97c4-46ca-8711-3539fffd79ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:09.564275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd040a-97c4-46ca-8711-3539fffd79ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:09.565708 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd040a-97c4-46ca-8711-3539fffd79ab None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:09.735627 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 513/1017] 10.222.0.112 () {60 vars in 1149 bytes} [Thu May 26 16:35:09 2022] POST /identity/v3/endpoints => generated 336 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:35:10.484975 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b3fdc-8377-4f94-9b4f-ccf7e642b30a None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:10.485766 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b3fdc-8377-4f94-9b4f-ccf7e642b30a None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:10.485766 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b3fdc-8377-4f94-9b4f-ccf7e642b30a None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:10.487532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 505/1018] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:10 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:10.495177 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cf3cd-c7f8-4b92-921e-e35a69b4b627 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:10.495912 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cf3cd-c7f8-4b92-921e-e35a69b4b627 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:10.495912 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cf3cd-c7f8-4b92-921e-e35a69b4b627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:10.516497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-af5cf3cd-c7f8-4b92-921e-e35a69b4b627 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:10.518488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-af5cf3cd-c7f8-4b92-921e-e35a69b4b627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:10.610369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 514/1019] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:10 2022] POST /identity/v3/auth/tokens => generated 1867 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:35:10.648178 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b3fdc-8377-4f94-9b4f-ccf7e642b30a None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:10.845201 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:10.854986 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b3fdc-8377-4f94-9b4f-ccf7e642b30a None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:10.932755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c33a4-f74b-46b8-84a3-a558c20211e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:10.933846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c33a4-f74b-46b8-84a3-a558c20211e5 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:10.934370 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c33a4-f74b-46b8-84a3-a558c20211e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:10.934825 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c33a4-f74b-46b8-84a3-a558c20211e5 None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:10.936073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c33a4-f74b-46b8-84a3-a558c20211e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:10.942075 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c33a4-f74b-46b8-84a3-a558c20211e5 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:11.078377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 506/1020] 10.222.0.112 () {60 vars in 1146 bytes} [Thu May 26 16:35:10 2022] POST /identity/v3/services => generated 243 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:35:11.546191 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299b02f-0529-43d5-8f6e-a8d1bb44ddde None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:11.546894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299b02f-0529-43d5-8f6e-a8d1bb44ddde None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:11.546894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299b02f-0529-43d5-8f6e-a8d1bb44ddde None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:11.548388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 515/1021] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:11.554072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363d276-1f56-4490-bf5e-5f603698e51c None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:11.554811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363d276-1f56-4490-bf5e-5f603698e51c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:11.554811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363d276-1f56-4490-bf5e-5f603698e51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:11.578671 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-d363d276-1f56-4490-bf5e-5f603698e51c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:11.581190 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d363d276-1f56-4490-bf5e-5f603698e51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:11.721695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 507/1022] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:11 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:35:11.765621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299b02f-0529-43d5-8f6e-a8d1bb44ddde None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:11.863105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:11.917874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299b02f-0529-43d5-8f6e-a8d1bb44ddde None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:11.982582 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4118348-2409-466f-8578-485202bda35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:11.983677 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4118348-2409-466f-8578-485202bda35b None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:11.984027 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4118348-2409-466f-8578-485202bda35b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:11.984450 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4118348-2409-466f-8578-485202bda35b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:11.986733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4118348-2409-466f-8578-485202bda35b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:11.988683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4118348-2409-466f-8578-485202bda35b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:11.990614 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 516/1023] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:11 2022] GET /identity/v3/domains/default => generated 200 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:11.996819 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363d276-1f56-4490-bf5e-5f603698e51c None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:12.129816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:12.164987 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363d276-1f56-4490-bf5e-5f603698e51c None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:12.230500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876694b8-f669-4dca-a9bd-7f691c5414d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:12.231242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876694b8-f669-4dca-a9bd-7f691c5414d6 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:12.231528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876694b8-f669-4dca-a9bd-7f691c5414d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:12.231854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876694b8-f669-4dca-a9bd-7f691c5414d6 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:12.232555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876694b8-f669-4dca-a9bd-7f691c5414d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:12.234095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876694b8-f669-4dca-a9bd-7f691c5414d6 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:12.332393 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23b381-95aa-4c97-811d-a2ce8a1a1550 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:12.332705 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23b381-95aa-4c97-811d-a2ce8a1a1550 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:12.333077 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23b381-95aa-4c97-811d-a2ce8a1a1550 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:12.334611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 517/1024] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:12.339608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f5ab7-935a-4bc9-9ca8-c09299407080 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:12.339896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f5ab7-935a-4bc9-9ca8-c09299407080 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:12.340176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f5ab7-935a-4bc9-9ca8-c09299407080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:12.353655 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 508/1025] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:35:11 2022] POST /identity/v3/users => generated 286 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:35:12.371246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-cb7f5ab7-935a-4bc9-9ca8-c09299407080 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:12.372550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-cb7f5ab7-935a-4bc9-9ca8-c09299407080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:12.477947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 518/1026] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:12 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:35:12.502434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876694b8-f669-4dca-a9bd-7f691c5414d6 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:12.656536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876694b8-f669-4dca-a9bd-7f691c5414d6 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:12.705514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b81a3a-1835-4db8-a2cd-dc3adb510756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:12.706453 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b81a3a-1835-4db8-a2cd-dc3adb510756 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:12.706703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b81a3a-1835-4db8-a2cd-dc3adb510756 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:12.706950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b81a3a-1835-4db8-a2cd-dc3adb510756 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:12.718273 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:12.724227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b81a3a-1835-4db8-a2cd-dc3adb510756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-78b81a3a-1835-4db8-a2cd-dc3adb510756 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:35:12.737790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:12.739984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:12.741835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:12.741835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:12.741835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:12.741835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:12.741835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:35:12.741835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:35:12.741835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:35:12.741835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:35:12.741835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:35:12.741835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:35:12.741835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:35:12.741835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:12.741835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 509/1027] 10.222.0.112 () {56 vars in 1125 bytes} [Thu May 26 16:35:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:35:12.748810 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f5ab7-935a-4bc9-9ca8-c09299407080 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:12.860894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:12.909622 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f5ab7-935a-4bc9-9ca8-c09299407080 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:12.951421 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001185c-a685-4916-bc70-9684bfa62caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:12.952096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001185c-a685-4916-bc70-9684bfa62caf None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:12.952376 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001185c-a685-4916-bc70-9684bfa62caf None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:12.952630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001185c-a685-4916-bc70-9684bfa62caf None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:12.953376 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001185c-a685-4916-bc70-9684bfa62caf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:12.953678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001185c-a685-4916-bc70-9684bfa62caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:12.955135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001185c-a685-4916-bc70-9684bfa62caf None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:12.968345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 519/1028] 10.222.0.112 () {56 vars in 1120 bytes} [Thu May 26 16:35:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:12.975304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b81a3a-1835-4db8-a2cd-dc3adb510756 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:13.120560 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b81a3a-1835-4db8-a2cd-dc3adb510756 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:13.173418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353bded-44f4-49f8-8a3c-92defffd2b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:13.175601 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353bded-44f4-49f8-8a3c-92defffd2b90 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:13.175998 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353bded-44f4-49f8-8a3c-92defffd2b90 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:13.176387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353bded-44f4-49f8-8a3c-92defffd2b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:13.193837 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353bded-44f4-49f8-8a3c-92defffd2b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:13.202355 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353bded-44f4-49f8-8a3c-92defffd2b90 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:13.227611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-2353bded-44f4-49f8-8a3c-92defffd2b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:13.227611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:13.227611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:13.227611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:13.227611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:13.227611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:13.227611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:13.227611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:13.227611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:13.227611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:13.227611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:13.227611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:13.227611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:35:13.227611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:35:13.227611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:13.228610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:13.229582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:35:13.229582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:35:13.229582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:13.229582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:13.230643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 510/1029] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:13.237214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001185c-a685-4916-bc70-9684bfa62caf None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:13.384887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001185c-a685-4916-bc70-9684bfa62caf None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:13.423152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:13.442310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a822e3a-5acc-41a4-a62a-80b2b1e9cb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:13.443441 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a822e3a-5acc-41a4-a62a-80b2b1e9cb91 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:13.443923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a822e3a-5acc-41a4-a62a-80b2b1e9cb91 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:13.444391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a822e3a-5acc-41a4-a62a-80b2b1e9cb91 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:13.445685 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a822e3a-5acc-41a4-a62a-80b2b1e9cb91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:13.446227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a822e3a-5acc-41a4-a62a-80b2b1e9cb91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:13.448769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a822e3a-5acc-41a4-a62a-80b2b1e9cb91 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:13.465417 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 520/1030] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:35:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:13.471559 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353bded-44f4-49f8-8a3c-92defffd2b90 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:13.536345 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:13.602430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353bded-44f4-49f8-8a3c-92defffd2b90 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:13.643695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa2ca2-4f70-4ae2-b928-8ca000fd7818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:13.644888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa2ca2-4f70-4ae2-b928-8ca000fd7818 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:13.645285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa2ca2-4f70-4ae2-b928-8ca000fd7818 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:13.645651 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa2ca2-4f70-4ae2-b928-8ca000fd7818 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:13.660147 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa2ca2-4f70-4ae2-b928-8ca000fd7818 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:13.662621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa2ca2-4f70-4ae2-b928-8ca000fd7818 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-3caa2ca2-4f70-4ae2-b928-8ca000fd7818 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:35:13.680460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:13.687757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:13.690444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:13.690444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:13.690444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:35:13.690444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:35:13.690444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:35:13.690444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:35:13.690444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:35:13.690444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:35:13.690444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:35:13.690444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:13.690444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 511/1031] 10.222.0.112 () {56 vars in 1098 bytes} [Thu May 26 16:35:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:13.693094 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a822e3a-5acc-41a4-a62a-80b2b1e9cb91 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:13.828237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a822e3a-5acc-41a4-a62a-80b2b1e9cb91 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:13.878172 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4edc5-8e68-4b8a-b19e-02bd33c4d98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:13.878903 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4edc5-8e68-4b8a-b19e-02bd33c4d98c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:13.879194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4edc5-8e68-4b8a-b19e-02bd33c4d98c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:13.879472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4edc5-8e68-4b8a-b19e-02bd33c4d98c None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:13.880319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4edc5-8e68-4b8a-b19e-02bd33c4d98c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:13.880630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4edc5-8e68-4b8a-b19e-02bd33c4d98c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:13.882124 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4edc5-8e68-4b8a-b19e-02bd33c4d98c None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:13.906437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 521/1032] 10.222.0.112 () {56 vars in 1138 bytes} [Thu May 26 16:35:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:13.907865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa2ca2-4f70-4ae2-b928-8ca000fd7818 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:14.023823 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88535c76-bf33-4e30-9983-5a42d663723d None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:14.024247 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88535c76-bf33-4e30-9983-5a42d663723d None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:14.024673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88535c76-bf33-4e30-9983-5a42d663723d None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:14.027516 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 522/1033] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:14 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:14.032937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc1d1b-0868-4e90-8599-e8347df74da9 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:14.034466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc1d1b-0868-4e90-8599-e8347df74da9 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:14.034626 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc1d1b-0868-4e90-8599-e8347df74da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:14.053727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-26fc1d1b-0868-4e90-8599-e8347df74da9 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:14.055481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-26fc1d1b-0868-4e90-8599-e8347df74da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:14.067480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa2ca2-4f70-4ae2-b928-8ca000fd7818 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:14.091262 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:14.109771 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:14.124796 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d801735-29bd-46ac-95d3-47960d3529a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:14.125560 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d801735-29bd-46ac-95d3-47960d3529a5 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:14.125963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d801735-29bd-46ac-95d3-47960d3529a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:14.126355 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d801735-29bd-46ac-95d3-47960d3529a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:14.164173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 523/1034] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:14 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:35:14.191351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc1d1b-0868-4e90-8599-e8347df74da9 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:14.247753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d801735-29bd-46ac-95d3-47960d3529a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:14.249392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d801735-29bd-46ac-95d3-47960d3529a5 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:14.341501 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc1d1b-0868-4e90-8599-e8347df74da9 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:14.390550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11034dc4-c796-4478-b726-efab2e3b20f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:14.391427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11034dc4-c796-4478-b726-efab2e3b20f7 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:14.391711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11034dc4-c796-4478-b726-efab2e3b20f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:14.391990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11034dc4-c796-4478-b726-efab2e3b20f7 None admin] PATH_INFO: `/v3/services/image` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:14.393195 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11034dc4-c796-4478-b726-efab2e3b20f7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:14.394649 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11034dc4-c796-4478-b726-efab2e3b20f7 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:14.405859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 512/1035] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:35:13 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-11034dc4-c796-4478-b726-efab2e3b20f7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:14.407564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:14.409921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:14.411255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:14.411255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:35:14.411255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:14.411255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:14.411255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:14.411255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:14.411255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:14.411255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:14.411255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:14.411255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:14.411255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:35:14.411255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:35:14.411255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:35:14.411255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:14.414454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 524/1036] 10.222.0.112 () {56 vars in 1110 bytes} [Thu May 26 16:35:14 2022] GET /identity/v3/services/image => generated 86 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:35:14.415427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11034dc4-c796-4478-b726-efab2e3b20f7 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:14.416502 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d801735-29bd-46ac-95d3-47960d3529a5 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:14.442363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:14.479460 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:14.566199 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11034dc4-c796-4478-b726-efab2e3b20f7 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:14.612800 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d801735-29bd-46ac-95d3-47960d3529a5 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:14.634909 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27102055-a852-4940-a2eb-c117d26bc6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:14.635586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27102055-a852-4940-a2eb-c117d26bc6bd None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:14.635874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27102055-a852-4940-a2eb-c117d26bc6bd None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:14.636154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27102055-a852-4940-a2eb-c117d26bc6bd None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:14.637120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27102055-a852-4940-a2eb-c117d26bc6bd None admin] RBAC: Adding query filter params (name=image) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:14.637486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27102055-a852-4940-a2eb-c117d26bc6bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:14.638878 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27102055-a852-4940-a2eb-c117d26bc6bd None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:14.650374 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 525/1037] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:14 2022] GET /identity/v3/services?name=image => generated 123 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:14.661106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27102055-a852-4940-a2eb-c117d26bc6bd None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:14.666268 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe1101-dea5-464c-acd8-00978b2af682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:14.667050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe1101-dea5-464c-acd8-00978b2af682 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:14.667334 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe1101-dea5-464c-acd8-00978b2af682 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:14.667640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe1101-dea5-464c-acd8-00978b2af682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:14.689978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe1101-dea5-464c-acd8-00978b2af682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:14.692262 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe1101-dea5-464c-acd8-00978b2af682 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:14.713915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-9cfe1101-dea5-464c-acd8-00978b2af682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:14.713915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:14.713915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:14.713915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:14.713915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:14.713915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:14.713915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:14.713915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:14.713915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:14.713915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:14.713915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:14.713915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:14.713915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:35:14.713915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:35:14.713915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:14.715238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:14.716604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:35:14.716604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:35:14.716604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:14.716604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:14.716604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 513/1038] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:14.724000 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe1101-dea5-464c-acd8-00978b2af682 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:14.812823 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:14.818997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27102055-a852-4940-a2eb-c117d26bc6bd None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:14.824348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:14.874865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe1101-dea5-464c-acd8-00978b2af682 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:14.876670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f989199-e9bc-4fd5-bdcc-53b16da326be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:14.878364 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f989199-e9bc-4fd5-bdcc-53b16da326be None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:14.879685 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f989199-e9bc-4fd5-bdcc-53b16da326be None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:14.879685 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f989199-e9bc-4fd5-bdcc-53b16da326be None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:14.880592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f989199-e9bc-4fd5-bdcc-53b16da326be None admin] RBAC: Adding query filter params (type=image) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:14.881182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f989199-e9bc-4fd5-bdcc-53b16da326be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:14.883064 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f989199-e9bc-4fd5-bdcc-53b16da326be None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:14.889702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 526/1039] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:14 2022] GET /identity/v3/services?type=image => generated 352 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:14.895515 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f989199-e9bc-4fd5-bdcc-53b16da326be None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:14.951084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385326ed-5485-420b-afec-57470338fd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:14.952588 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385326ed-5485-420b-afec-57470338fd3e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:14.953306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385326ed-5485-420b-afec-57470338fd3e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:14.953806 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385326ed-5485-420b-afec-57470338fd3e None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:14.955432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385326ed-5485-420b-afec-57470338fd3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:14.955740 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385326ed-5485-420b-afec-57470338fd3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:14.958098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385326ed-5485-420b-afec-57470338fd3e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:14.975607 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 514/1040] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:35:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:14.977082 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec129b1-5400-4668-8282-a071cdde3ad2 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:14.977405 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec129b1-5400-4668-8282-a071cdde3ad2 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:14.977690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec129b1-5400-4668-8282-a071cdde3ad2 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:14.978999 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 515/1041] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:14.981528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec129b1-5400-4668-8282-a071cdde3ad2 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:15.042481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f989199-e9bc-4fd5-bdcc-53b16da326be None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:15.095381 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01a3e3-1597-4259-9891-390b51c1096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:15.096469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01a3e3-1597-4259-9891-390b51c1096a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:15.096977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01a3e3-1597-4259-9891-390b51c1096a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:15.097431 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01a3e3-1597-4259-9891-390b51c1096a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:15.098924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01a3e3-1597-4259-9891-390b51c1096a None admin] RBAC: Adding query filter params (interface=public, service_id=a1fb8f3edf11463c817128f7dcdac42d, region_id=RegionOne) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:15.099444 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01a3e3-1597-4259-9891-390b51c1096a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:15.101800 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01a3e3-1597-4259-9891-390b51c1096a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:15.115967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 527/1042] 10.222.0.112 () {56 vars in 1256 bytes} [Thu May 26 16:35:14 2022] GET /identity/v3/endpoints?service_id=a1fb8f3edf11463c817128f7dcdac42d&interface=public®ion_id=RegionOne => generated 195 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:15.115967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d0d1c-b745-482c-9fe5-88b703f53688 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:15.115967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d0d1c-b745-482c-9fe5-88b703f53688 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:15.115967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d0d1c-b745-482c-9fe5-88b703f53688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:15.131467 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-a38d0d1c-b745-482c-9fe5-88b703f53688 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:15.132718 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a38d0d1c-b745-482c-9fe5-88b703f53688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:15.137277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec129b1-5400-4668-8282-a071cdde3ad2 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:15.161957 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:15.164932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:15.176675 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50849a4a-10a9-43d4-b3c7-4e995d97c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:15.177939 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50849a4a-10a9-43d4-b3c7-4e995d97c861 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:15.178627 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50849a4a-10a9-43d4-b3c7-4e995d97c861 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:15.179082 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50849a4a-10a9-43d4-b3c7-4e995d97c861 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:15.193075 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50849a4a-10a9-43d4-b3c7-4e995d97c861 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:15.195806 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50849a4a-10a9-43d4-b3c7-4e995d97c861 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:15.213333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-50849a4a-10a9-43d4-b3c7-4e995d97c861 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:35:15.213333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:15.213333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:15.213333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:15.213333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:15.213333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:15.213333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:15.213333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:15.213333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:15.213333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:15.213333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:15.213333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:15.213333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:35:15.213333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:35:15.213333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:15.214388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:15.215343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:35:15.215343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:35:15.215343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:35:15.215343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:35:15.215343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:35:15.215343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:35:15.215343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:35:15.215343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:15.215343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 516/1043] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:35:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:15.215848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50849a4a-10a9-43d4-b3c7-4e995d97c861 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:15.230930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 528/1044] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:15 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:35:15.231911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d0d1c-b745-482c-9fe5-88b703f53688 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:15.344831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50849a4a-10a9-43d4-b3c7-4e995d97c861 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:15.381963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d0d1c-b745-482c-9fe5-88b703f53688 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:15.389930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087625e2-5ca8-4e2c-8e52-9293e24cb4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:15.390668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087625e2-5ca8-4e2c-8e52-9293e24cb4fb None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:15.390949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087625e2-5ca8-4e2c-8e52-9293e24cb4fb None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:15.391227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087625e2-5ca8-4e2c-8e52-9293e24cb4fb None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:15.391937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087625e2-5ca8-4e2c-8e52-9293e24cb4fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:15.393870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087625e2-5ca8-4e2c-8e52-9293e24cb4fb None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:15.400907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 517/1045] 10.222.0.112 () {56 vars in 1092 bytes} [Thu May 26 16:35:15 2022] GET /identity/v3/services => generated 1966 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:35:15.401791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087625e2-5ca8-4e2c-8e52-9293e24cb4fb None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:15.431758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3be8a-12a3-4b50-98ba-4dfee2534a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:15.432965 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3be8a-12a3-4b50-98ba-4dfee2534a7e None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:15.433493 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3be8a-12a3-4b50-98ba-4dfee2534a7e None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:15.433997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3be8a-12a3-4b50-98ba-4dfee2534a7e None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:15.435721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3be8a-12a3-4b50-98ba-4dfee2534a7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:15.436206 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3be8a-12a3-4b50-98ba-4dfee2534a7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:15.440287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3be8a-12a3-4b50-98ba-4dfee2534a7e None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:15.458199 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 529/1046] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:35:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:15.464705 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3be8a-12a3-4b50-98ba-4dfee2534a7e None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:15.487184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:15.495318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:15.569025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087625e2-5ca8-4e2c-8e52-9293e24cb4fb None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:15.617582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a737e-5b3b-4b61-952a-2f9beb28e826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:15.618425 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a737e-5b3b-4b61-952a-2f9beb28e826 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:15.618715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a737e-5b3b-4b61-952a-2f9beb28e826 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:15.619005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a737e-5b3b-4b61-952a-2f9beb28e826 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:15.634416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a737e-5b3b-4b61-952a-2f9beb28e826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:35:15.645355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3be8a-12a3-4b50-98ba-4dfee2534a7e None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-fe2a737e-5b3b-4b61-952a-2f9beb28e826 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:35:15.646718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:15.648478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:15.649978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:15.649978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:15.649978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:15.649978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:15.649978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:35:15.649978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:35:15.649978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:35:15.649978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:35:15.649978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:35:15.649978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:35:15.649978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:35:15.649978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:15.651064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 518/1047] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:35:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:15.656840 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a737e-5b3b-4b61-952a-2f9beb28e826 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:15.702089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcf96d-4876-4fa6-974f-cdc52034bf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:15.702778 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcf96d-4876-4fa6-974f-cdc52034bf14 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:15.703062 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcf96d-4876-4fa6-974f-cdc52034bf14 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:15.703340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcf96d-4876-4fa6-974f-cdc52034bf14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:15.704171 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcf96d-4876-4fa6-974f-cdc52034bf14 None admin] RBAC: Adding query filter params (role.id=6a1901e356224f31b647f4ae3aeb3d37, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=5f2ec4c76f8f4d858bce53f30cc198fa) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:15.704486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcf96d-4876-4fa6-974f-cdc52034bf14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:15.706006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcf96d-4876-4fa6-974f-cdc52034bf14 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:15.714974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 530/1048] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:35:15 2022] GET /identity/v3/role_assignments?user.id=5f2ec4c76f8f4d858bce53f30cc198fa&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=6a1901e356224f31b647f4ae3aeb3d37 => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:15.827510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a737e-5b3b-4b61-952a-2f9beb28e826 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:15.847804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:15.888347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0397c6-a1e7-4d60-8bf9-e91b8f6c4a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:15.889448 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0397c6-a1e7-4d60-8bf9-e91b8f6c4a71 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:15.889742 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0397c6-a1e7-4d60-8bf9-e91b8f6c4a71 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:15.890182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0397c6-a1e7-4d60-8bf9-e91b8f6c4a71 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:15.891053 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0397c6-a1e7-4d60-8bf9-e91b8f6c4a71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:15.891381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0397c6-a1e7-4d60-8bf9-e91b8f6c4a71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:15.894419 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0397c6-a1e7-4d60-8bf9-e91b8f6c4a71 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:15.909896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 519/1049] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:35:15 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:15.918393 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcf96d-4876-4fa6-974f-cdc52034bf14 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:16.043579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:16.073076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcf96d-4876-4fa6-974f-cdc52034bf14 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:16.122920 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295171f7-d964-488f-b839-b35c0cb76123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:16.123808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295171f7-d964-488f-b839-b35c0cb76123 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:16.124090 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295171f7-d964-488f-b839-b35c0cb76123 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:16.124366 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295171f7-d964-488f-b839-b35c0cb76123 None admin] PATH_INFO: `/v3/users/289e2421e44e4a1fb057937e6390a1cb` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:16.143758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295171f7-d964-488f-b839-b35c0cb76123 None admin] RBAC: Authorizing `identity:get_user(user_id=289e2421e44e4a1fb057937e6390a1cb)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:16.145882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295171f7-d964-488f-b839-b35c0cb76123 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:16.148684 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 531/1050] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:35:15 2022] GET /identity/v3/users/289e2421e44e4a1fb057937e6390a1cb => generated 286 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:16.156974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0397c6-a1e7-4d60-8bf9-e91b8f6c4a71 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:16.318257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0397c6-a1e7-4d60-8bf9-e91b8f6c4a71 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:16.364171 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fef2a8-587b-4b94-8837-1f5e9eddb7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:16.364905 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fef2a8-587b-4b94-8837-1f5e9eddb7f1 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:16.365156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fef2a8-587b-4b94-8837-1f5e9eddb7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:16.365435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fef2a8-587b-4b94-8837-1f5e9eddb7f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:16.413364 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:16.447851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fef2a8-587b-4b94-8837-1f5e9eddb7f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:16.449953 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fef2a8-587b-4b94-8837-1f5e9eddb7f1 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:16.595621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 520/1051] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:35:16 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:35:16.605999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295171f7-d964-488f-b839-b35c0cb76123 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:16.763534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295171f7-d964-488f-b839-b35c0cb76123 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:16.811911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6eb44-2225-43dc-a332-c849fd1563d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:16.813112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6eb44-2225-43dc-a332-c849fd1563d7 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:16.813400 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6eb44-2225-43dc-a332-c849fd1563d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:16.813674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6eb44-2225-43dc-a332-c849fd1563d7 None admin] PATH_INFO: `/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:16.816223 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6eb44-2225-43dc-a332-c849fd1563d7 None admin] RBAC: Authorizing `identity:get_project(project_id=ee863f05d02747d78f213a1cc7b0cdcf)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:16.817705 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6eb44-2225-43dc-a332-c849fd1563d7 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:16.819741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 532/1052] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:35:16 2022] GET /identity/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf => generated 312 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:16.825974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fef2a8-587b-4b94-8837-1f5e9eddb7f1 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:16.929014 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:16.980319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fef2a8-587b-4b94-8837-1f5e9eddb7f1 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:17.039976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9de307-9df2-4e1d-be84-69528259ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:17.040653 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9de307-9df2-4e1d-be84-69528259ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:17.040939 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9de307-9df2-4e1d-be84-69528259ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:17.041235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9de307-9df2-4e1d-be84-69528259ffc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:17.042186 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9de307-9df2-4e1d-be84-69528259ffc0 None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=ee863f05d02747d78f213a1cc7b0cdcf, user.id=289e2421e44e4a1fb057937e6390a1cb) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:17.042534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9de307-9df2-4e1d-be84-69528259ffc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:17.044019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9de307-9df2-4e1d-be84-69528259ffc0 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:17.058894 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 521/1053] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:35:16 2022] GET /identity/v3/role_assignments?user.id=289e2421e44e4a1fb057937e6390a1cb&scope.project.id=ee863f05d02747d78f213a1cc7b0cdcf&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:17.906259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67863e-943d-4ef9-a851-50a97208fa93 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:17.907044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67863e-943d-4ef9-a851-50a97208fa93 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:17.907044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67863e-943d-4ef9-a851-50a97208fa93 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:17.908457 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 533/1054] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:17.915479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395316f-a077-489b-896b-2b9a2ca73e7e None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:17.916153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395316f-a077-489b-896b-2b9a2ca73e7e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:17.916636 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395316f-a077-489b-896b-2b9a2ca73e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:17.936733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-5395316f-a077-489b-896b-2b9a2ca73e7e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:17.938206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5395316f-a077-489b-896b-2b9a2ca73e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:18.072763 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 522/1055] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:17 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:35:18.106107 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67863e-943d-4ef9-a851-50a97208fa93 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:18.122868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:18.270158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67863e-943d-4ef9-a851-50a97208fa93 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:18.286868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98e01a-2ef9-42b7-8d4c-34c722b0228a None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:18.287384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98e01a-2ef9-42b7-8d4c-34c722b0228a None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:18.287814 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98e01a-2ef9-42b7-8d4c-34c722b0228a None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:18.289757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 523/1056] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:35:18.297034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756fcc9-c461-4239-8805-43eb13ae2f05 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:18.297432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756fcc9-c461-4239-8805-43eb13ae2f05 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:18.297682 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756fcc9-c461-4239-8805-43eb13ae2f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:18.324712 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-5756fcc9-c461-4239-8805-43eb13ae2f05 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:18.326541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5756fcc9-c461-4239-8805-43eb13ae2f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:18.327807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1e9d2-4905-4b1e-bbb5-e4c53f413647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:18.328745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1e9d2-4905-4b1e-bbb5-e4c53f413647 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:18.329138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1e9d2-4905-4b1e-bbb5-e4c53f413647 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:18.329509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1e9d2-4905-4b1e-bbb5-e4c53f413647 None admin] PATH_INFO: `/v3/services/image` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:18.330456 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1e9d2-4905-4b1e-bbb5-e4c53f413647 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:18.332925 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1e9d2-4905-4b1e-bbb5-e4c53f413647 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-1ea1e9d2-4905-4b1e-bbb5-e4c53f413647 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:18.351076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:18.353068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:18.354190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:18.354190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:35:18.354190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:18.354190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:18.354190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:18.354190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:18.354190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:18.354190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:18.354190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:18.354190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:18.354190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:35:18.354190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:35:18.354190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:35:18.354190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:18.354190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 534/1057] 10.222.0.112 () {56 vars in 1110 bytes} [Thu May 26 16:35:18 2022] GET /identity/v3/services/image => generated 86 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:18.358649 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1e9d2-4905-4b1e-bbb5-e4c53f413647 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:18.434110 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:18.459897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 524/1058] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:18 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:35:18.482544 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:18.488642 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756fcc9-c461-4239-8805-43eb13ae2f05 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:18.528030 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1e9d2-4905-4b1e-bbb5-e4c53f413647 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:18.588902 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b68bb1-4b1e-4a8f-a013-e7fd2a92d844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:18.590504 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b68bb1-4b1e-4a8f-a013-e7fd2a92d844 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:18.590819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b68bb1-4b1e-4a8f-a013-e7fd2a92d844 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:18.591104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b68bb1-4b1e-4a8f-a013-e7fd2a92d844 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:18.591834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b68bb1-4b1e-4a8f-a013-e7fd2a92d844 None admin] RBAC: Adding query filter params (name=image) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:18.592143 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b68bb1-4b1e-4a8f-a013-e7fd2a92d844 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:18.593571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b68bb1-4b1e-4a8f-a013-e7fd2a92d844 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:18.604413 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 535/1059] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:18 2022] GET /identity/v3/services?name=image => generated 123 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:18.605168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b68bb1-4b1e-4a8f-a013-e7fd2a92d844 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:18.647073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756fcc9-c461-4239-8805-43eb13ae2f05 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:18.708924 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d488cf6-186c-4c6e-864c-729bb25e4f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:18.710664 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d488cf6-186c-4c6e-864c-729bb25e4f01 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:18.711358 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d488cf6-186c-4c6e-864c-729bb25e4f01 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:18.711866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d488cf6-186c-4c6e-864c-729bb25e4f01 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:18.729248 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d488cf6-186c-4c6e-864c-729bb25e4f01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-7d488cf6-186c-4c6e-864c-729bb25e4f01 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:35:18.743969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:18.745941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:18.748220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:18.748220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:18.748220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:18.748220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:18.748220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:35:18.748220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:35:18.748220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:35:18.748220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:35:18.748220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:35:18.748220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:35:18.748220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:35:18.748220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:18.748220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 525/1060] 10.222.0.112 () {56 vars in 1125 bytes} [Thu May 26 16:35:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:18.755546 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d488cf6-186c-4c6e-864c-729bb25e4f01 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:18.793070 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b68bb1-4b1e-4a8f-a013-e7fd2a92d844 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:18.833156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0046371-6e93-415c-9b4f-0351c5aed1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:18.833840 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0046371-6e93-415c-9b4f-0351c5aed1df None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:18.834141 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0046371-6e93-415c-9b4f-0351c5aed1df None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:18.834430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0046371-6e93-415c-9b4f-0351c5aed1df None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:18.835142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0046371-6e93-415c-9b4f-0351c5aed1df None admin] RBAC: Adding query filter params (type=image) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:18.835458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0046371-6e93-415c-9b4f-0351c5aed1df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:18.836868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0046371-6e93-415c-9b4f-0351c5aed1df None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:18.839501 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:18.852218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 536/1061] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:18 2022] GET /identity/v3/services?type=image => generated 352 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:18.858994 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0046371-6e93-415c-9b4f-0351c5aed1df None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:18.867019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:18.959546 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d488cf6-186c-4c6e-864c-729bb25e4f01 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:19.016930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0bb6d-b94a-44eb-8214-1f468a11726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:19.017846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0bb6d-b94a-44eb-8214-1f468a11726e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:19.018936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0bb6d-b94a-44eb-8214-1f468a11726e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:19.019360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0bb6d-b94a-44eb-8214-1f468a11726e None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:19.020254 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0bb6d-b94a-44eb-8214-1f468a11726e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:19.020708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0bb6d-b94a-44eb-8214-1f468a11726e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:19.022259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0bb6d-b94a-44eb-8214-1f468a11726e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:19.033255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 526/1062] 10.222.0.112 () {56 vars in 1120 bytes} [Thu May 26 16:35:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:19.035153 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0046371-6e93-415c-9b4f-0351c5aed1df None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:19.040549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0bb6d-b94a-44eb-8214-1f468a11726e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:19.089094 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbccaa6-a785-4d17-839a-45f12f50ac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:19.090102 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbccaa6-a785-4d17-839a-45f12f50ac61 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:19.090416 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbccaa6-a785-4d17-839a-45f12f50ac61 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:19.090716 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbccaa6-a785-4d17-839a-45f12f50ac61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:19.091520 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbccaa6-a785-4d17-839a-45f12f50ac61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:19.093734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbccaa6-a785-4d17-839a-45f12f50ac61 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:19.188164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0bb6d-b94a-44eb-8214-1f468a11726e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:19.226259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:19.228862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 537/1063] 10.222.0.112 () {60 vars in 1149 bytes} [Thu May 26 16:35:18 2022] POST /identity/v3/endpoints => generated 329 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:35:19.278097 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366540da-e7b0-4897-a067-6d95226ceb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:19.279270 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366540da-e7b0-4897-a067-6d95226ceb05 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:19.279692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366540da-e7b0-4897-a067-6d95226ceb05 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:19.280113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366540da-e7b0-4897-a067-6d95226ceb05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:19.300896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366540da-e7b0-4897-a067-6d95226ceb05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:19.303480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366540da-e7b0-4897-a067-6d95226ceb05 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:19.337755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-366540da-e7b0-4897-a067-6d95226ceb05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:19.337755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:19.337755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:19.337755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:19.337755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:19.337755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:19.337755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:19.337755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:19.337755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:19.337755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:19.337755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:19.337755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:19.337755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:35:19.337755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:35:19.337755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:19.339134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:19.340072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:35:19.340072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:35:19.340072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:19.340072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:19.340338 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 527/1064] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:35:19.351679 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbccaa6-a785-4d17-839a-45f12f50ac61 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:19.444067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:19.512825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbccaa6-a785-4d17-839a-45f12f50ac61 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:19.573469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684dad33-6401-4c83-8f75-be7152fec230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:19.574251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dad33-6401-4c83-8f75-be7152fec230 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:19.574694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dad33-6401-4c83-8f75-be7152fec230 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:19.575102 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dad33-6401-4c83-8f75-be7152fec230 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:19.575963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684dad33-6401-4c83-8f75-be7152fec230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:19.576396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684dad33-6401-4c83-8f75-be7152fec230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:19.578003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684dad33-6401-4c83-8f75-be7152fec230 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:19.592268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 538/1065] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:35:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:19.597990 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366540da-e7b0-4897-a067-6d95226ceb05 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:19.726688 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418879-aff1-4f9a-94b3-f401be4446af None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:19.727268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418879-aff1-4f9a-94b3-f401be4446af None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:19.727811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418879-aff1-4f9a-94b3-f401be4446af None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:19.733486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 539/1066] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:19 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:35:19.739042 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff6bef-e4ae-4a87-ac02-e1b3e80ff590 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:19.739344 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff6bef-e4ae-4a87-ac02-e1b3e80ff590 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:19.739620 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff6bef-e4ae-4a87-ac02-e1b3e80ff590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:19.758228 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366540da-e7b0-4897-a067-6d95226ceb05 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:19.763323 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-d9ff6bef-e4ae-4a87-ac02-e1b3e80ff590 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:19.764796 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d9ff6bef-e4ae-4a87-ac02-e1b3e80ff590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:19.814541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9d022-3827-483f-9058-277cf37e22b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:19.815892 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d022-3827-483f-9058-277cf37e22b2 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:19.816357 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d022-3827-483f-9058-277cf37e22b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:19.816820 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d022-3827-483f-9058-277cf37e22b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:19.829665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9d022-3827-483f-9058-277cf37e22b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:19.832172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9d022-3827-483f-9058-277cf37e22b2 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-a2b9d022-3827-483f-9058-277cf37e22b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:35:19.856422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:19.858069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:19.859411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:19.859411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:19.859411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:35:19.859411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:35:19.859411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:35:19.859411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:35:19.859411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:35:19.859411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:35:19.859411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:35:19.859411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:19.859411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 528/1067] 10.222.0.112 () {56 vars in 1098 bytes} [Thu May 26 16:35:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:19.866651 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9d022-3827-483f-9058-277cf37e22b2 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:19.890399 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 540/1068] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:19 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:35:19.907776 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:19.912554 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff6bef-e4ae-4a87-ac02-e1b3e80ff590 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:19.976193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:20.014797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9d022-3827-483f-9058-277cf37e22b2 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:20.050829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff6bef-e4ae-4a87-ac02-e1b3e80ff590 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:20.069552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf294e-1315-492f-9645-fe8925266f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:20.070295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf294e-1315-492f-9645-fe8925266f61 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:20.071053 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf294e-1315-492f-9645-fe8925266f61 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:20.071053 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf294e-1315-492f-9645-fe8925266f61 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:20.072947 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf294e-1315-492f-9645-fe8925266f61 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:20.072947 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf294e-1315-492f-9645-fe8925266f61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:20.073435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf294e-1315-492f-9645-fe8925266f61 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:20.099297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 529/1069] 10.222.0.112 () {56 vars in 1138 bytes} [Thu May 26 16:35:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:20.105303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf294e-1315-492f-9645-fe8925266f61 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:20.114080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1e666-e51e-401f-aa48-6082bf4b3456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:20.115011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1e666-e51e-401f-aa48-6082bf4b3456 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:20.115364 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1e666-e51e-401f-aa48-6082bf4b3456 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:20.115659 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1e666-e51e-401f-aa48-6082bf4b3456 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:20.128883 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1e666-e51e-401f-aa48-6082bf4b3456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-e4c1e666-e51e-401f-aa48-6082bf4b3456 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:35:20.136672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:20.138571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:20.140204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:20.140204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:20.140204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:20.140204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:20.140204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:35:20.140204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:35:20.140204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:35:20.140204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:35:20.140204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:35:20.140204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:35:20.140204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:35:20.140204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:20.140204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 541/1070] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:35:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:35:20.145371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1e666-e51e-401f-aa48-6082bf4b3456 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:20.229248 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:20.250209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf294e-1315-492f-9645-fe8925266f61 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:20.302223 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1e666-e51e-401f-aa48-6082bf4b3456 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:20.307058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e32fd-558e-4a9e-94fd-a6294a3f3cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:20.308259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e32fd-558e-4a9e-94fd-a6294a3f3cdf None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:20.308682 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e32fd-558e-4a9e-94fd-a6294a3f3cdf None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:20.309115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e32fd-558e-4a9e-94fd-a6294a3f3cdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:20.313399 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:20.327481 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e32fd-558e-4a9e-94fd-a6294a3f3cdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:20.330200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e32fd-558e-4a9e-94fd-a6294a3f3cdf None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:20.351838 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a798d-bffd-4aba-ad76-1973286d0c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:20.352427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a798d-bffd-4aba-ad76-1973286d0c10 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:20.352712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a798d-bffd-4aba-ad76-1973286d0c10 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:20.352980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a798d-bffd-4aba-ad76-1973286d0c10 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:20.353722 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a798d-bffd-4aba-ad76-1973286d0c10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:20.354028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a798d-bffd-4aba-ad76-1973286d0c10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:20.355433 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a798d-bffd-4aba-ad76-1973286d0c10 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:20.363137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-398e32fd-558e-4a9e-94fd-a6294a3f3cdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:20.363137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:20.363137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:20.363137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:20.363137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:20.363137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:20.363137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:20.363137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:20.363137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:20.363137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:20.363137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:20.363137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:20.363137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:35:20.363137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:35:20.363137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:20.364165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:20.365060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:35:20.365060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:35:20.365060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:20.365060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:20.372302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 530/1071] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:35:20.373528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e32fd-558e-4a9e-94fd-a6294a3f3cdf None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:20.377031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 542/1072] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:35:20 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:20.383231 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a798d-bffd-4aba-ad76-1973286d0c10 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:20.524110 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e32fd-558e-4a9e-94fd-a6294a3f3cdf None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:20.524363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a798d-bffd-4aba-ad76-1973286d0c10 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:20.575821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef3474-d468-4dc3-9ae7-9ed6941f149b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:20.576655 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef3474-d468-4dc3-9ae7-9ed6941f149b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:20.577095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef3474-d468-4dc3-9ae7-9ed6941f149b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:20.577508 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef3474-d468-4dc3-9ae7-9ed6941f149b None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:20.578505 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef3474-d468-4dc3-9ae7-9ed6941f149b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:20.579009 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef3474-d468-4dc3-9ae7-9ed6941f149b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:20.581345 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef3474-d468-4dc3-9ae7-9ed6941f149b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:20.582870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17cb24-0174-4802-befb-7c4420493251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:20.583791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:20.584174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17cb24-0174-4802-befb-7c4420493251 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:20.584695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17cb24-0174-4802-befb-7c4420493251 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:20.585105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17cb24-0174-4802-befb-7c4420493251 None admin] PATH_INFO: `/v3/users/289e2421e44e4a1fb057937e6390a1cb` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:20.587381 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17cb24-0174-4802-befb-7c4420493251 None admin] RBAC: Authorizing `identity:get_user(user_id=289e2421e44e4a1fb057937e6390a1cb)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:20.589334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17cb24-0174-4802-befb-7c4420493251 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:20.591896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 543/1073] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:35:20 2022] GET /identity/v3/users/289e2421e44e4a1fb057937e6390a1cb => generated 286 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:20.598359 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 531/1074] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:35:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:20.603458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17cb24-0174-4802-befb-7c4420493251 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:20.603640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef3474-d468-4dc3-9ae7-9ed6941f149b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:20.661193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:20.762776 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17cb24-0174-4802-befb-7c4420493251 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:20.764948 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef3474-d468-4dc3-9ae7-9ed6941f149b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:20.813498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995229b-8959-45fd-af05-bd4f10b1c355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:20.814485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995229b-8959-45fd-af05-bd4f10b1c355 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:20.815729 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995229b-8959-45fd-af05-bd4f10b1c355 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:20.815729 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995229b-8959-45fd-af05-bd4f10b1c355 None admin] PATH_INFO: `/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:20.817055 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995229b-8959-45fd-af05-bd4f10b1c355 None admin] RBAC: Authorizing `identity:get_project(project_id=ee863f05d02747d78f213a1cc7b0cdcf)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:20.818561 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995229b-8959-45fd-af05-bd4f10b1c355 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:20.821016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 544/1075] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:35:20 2022] GET /identity/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf => generated 312 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:20.826108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8561a9-2080-46b8-8513-8a5c48183708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:20.826747 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995229b-8959-45fd-af05-bd4f10b1c355 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:20.827183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8561a9-2080-46b8-8513-8a5c48183708 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:20.827535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8561a9-2080-46b8-8513-8a5c48183708 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:20.827889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8561a9-2080-46b8-8513-8a5c48183708 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:20.838585 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8561a9-2080-46b8-8513-8a5c48183708 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:20.840637 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8561a9-2080-46b8-8513-8a5c48183708 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:20.865135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-3a8561a9-2080-46b8-8513-8a5c48183708 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:35:20.865135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:20.865135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:20.865135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:20.865135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:20.865135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:20.865135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:20.865135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:20.865135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:20.865135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:20.865135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:20.865135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:20.865135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:35:20.865135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:35:20.865135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:20.866870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:20.867974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:35:20.867974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:35:20.867974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:35:20.867974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:35:20.867974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:35:20.867974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:35:20.867974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:35:20.867974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:20.867974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 532/1076] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:35:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:35:20.874565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8561a9-2080-46b8-8513-8a5c48183708 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:20.953150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:20.981397 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995229b-8959-45fd-af05-bd4f10b1c355 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:20.984719 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:21.014575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8561a9-2080-46b8-8513-8a5c48183708 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:21.042281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5fbdf-543e-4b81-8f1c-f7f6f8e9cb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:21.043210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5fbdf-543e-4b81-8f1c-f7f6f8e9cb39 None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:21.043496 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5fbdf-543e-4b81-8f1c-f7f6f8e9cb39 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:21.043789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5fbdf-543e-4b81-8f1c-f7f6f8e9cb39 None admin] PATH_INFO: `/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf/users/289e2421e44e4a1fb057937e6390a1cb/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:21.047694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5fbdf-543e-4b81-8f1c-f7f6f8e9cb39 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee863f05d02747d78f213a1cc7b0cdcf, user_id=289e2421e44e4a1fb057937e6390a1cb, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:21.049685 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5fbdf-543e-4b81-8f1c-f7f6f8e9cb39 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:21.072832 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb692141-2f5f-4c87-aec8-f1ed68ea5fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:21.075099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb692141-2f5f-4c87-aec8-f1ed68ea5fc9 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:21.075099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb692141-2f5f-4c87-aec8-f1ed68ea5fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:21.075099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb692141-2f5f-4c87-aec8-f1ed68ea5fc9 None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:21.075099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb692141-2f5f-4c87-aec8-f1ed68ea5fc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:21.075099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb692141-2f5f-4c87-aec8-f1ed68ea5fc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:21.076510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb692141-2f5f-4c87-aec8-f1ed68ea5fc9 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:21.096666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 533/1077] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:35:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:21.098732 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb692141-2f5f-4c87-aec8-f1ed68ea5fc9 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:21.139303 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 545/1078] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:35:20 2022] PUT /identity/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf/users/289e2421e44e4a1fb057937e6390a1cb/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:35:21.285331 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb692141-2f5f-4c87-aec8-f1ed68ea5fc9 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:21.309380 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:21.348566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465fcab-cf4f-494f-884c-0ffde43fa877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:21.349485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465fcab-cf4f-494f-884c-0ffde43fa877 None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:21.349771 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465fcab-cf4f-494f-884c-0ffde43fa877 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:21.350055 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465fcab-cf4f-494f-884c-0ffde43fa877 None admin] PATH_INFO: `/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/5f2ec4c76f8f4d858bce53f30cc198fa/roles/6a1901e356224f31b647f4ae3aeb3d37` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:21.354606 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465fcab-cf4f-494f-884c-0ffde43fa877 None admin] RBAC: Authorizing `identity:create_grant(project_id=9be90db8d7ee4bd0b01444d1eab83ad8, user_id=5f2ec4c76f8f4d858bce53f30cc198fa, role_id=6a1901e356224f31b647f4ae3aeb3d37)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:21.356017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465fcab-cf4f-494f-884c-0ffde43fa877 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:21.496214 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 534/1079] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:35:21 2022] PUT /identity/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/5f2ec4c76f8f4d858bce53f30cc198fa/roles/6a1901e356224f31b647f4ae3aeb3d37 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:35:21.968233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62cb97-0a8c-4b41-88ac-e49b37399c3c None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:21.968484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62cb97-0a8c-4b41-88ac-e49b37399c3c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:21.968763 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62cb97-0a8c-4b41-88ac-e49b37399c3c None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:21.970461 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 546/1080] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:35:21.976601 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb620b-c368-4335-8e61-4fdfeb088727 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:21.988687 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb620b-c368-4335-8e61-4fdfeb088727 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:21.988687 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb620b-c368-4335-8e61-4fdfeb088727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:22.000932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-bceb620b-c368-4335-8e61-4fdfeb088727 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:22.002222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-bceb620b-c368-4335-8e61-4fdfeb088727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:22.125105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 535/1081] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:21 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:35:22.150743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62cb97-0a8c-4b41-88ac-e49b37399c3c None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:22.289176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62cb97-0a8c-4b41-88ac-e49b37399c3c None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:22.340568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9776a-2728-4d48-bd9a-8cba1b8faa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:22.341226 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9776a-2728-4d48-bd9a-8cba1b8faa0e None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:22.341497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9776a-2728-4d48-bd9a-8cba1b8faa0e None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:22.341771 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9776a-2728-4d48-bd9a-8cba1b8faa0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:22.387510 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:22.462010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9776a-2728-4d48-bd9a-8cba1b8faa0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:22.464945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9776a-2728-4d48-bd9a-8cba1b8faa0e None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:22.629854 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 547/1082] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:35:22 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 16:35:22.636069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb620b-c368-4335-8e61-4fdfeb088727 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:22.781824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb620b-c368-4335-8e61-4fdfeb088727 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:22.787913 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:22.842441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2310f-a0a8-499b-b68a-5958e9ba81f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:22.843836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2310f-a0a8-499b-b68a-5958e9ba81f6 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:22.844136 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2310f-a0a8-499b-b68a-5958e9ba81f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:22.844420 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2310f-a0a8-499b-b68a-5958e9ba81f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:22.856322 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2310f-a0a8-499b-b68a-5958e9ba81f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:22.857796 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2310f-a0a8-499b-b68a-5958e9ba81f6 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:22.876316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-8bc2310f-a0a8-499b-b68a-5958e9ba81f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:22.876316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:22.876316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:22.876316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:22.876316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:22.876316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:22.876316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:22.876316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:22.876316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:22.876316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:22.876316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:22.876316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:22.876316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:35:22.876316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:35:22.876316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:22.879017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:22.880881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:35:22.880881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:35:22.880881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:22.880881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:22.880881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 536/1083] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:22.887750 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9776a-2728-4d48-bd9a-8cba1b8faa0e None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:22.980046 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:23.029999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9776a-2728-4d48-bd9a-8cba1b8faa0e None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:23.070062 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96a9f1-7f56-45a5-b99b-6ea8493be846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:23.070758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96a9f1-7f56-45a5-b99b-6ea8493be846 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:23.071036 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96a9f1-7f56-45a5-b99b-6ea8493be846 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:23.071302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96a9f1-7f56-45a5-b99b-6ea8493be846 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:23.072155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96a9f1-7f56-45a5-b99b-6ea8493be846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:23.072453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96a9f1-7f56-45a5-b99b-6ea8493be846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:23.074352 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96a9f1-7f56-45a5-b99b-6ea8493be846 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:23.102464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 548/1084] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:35:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:23.877328 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b2b70-4950-4ce8-a991-8391c3be3655 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:23.877892 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b2b70-4950-4ce8-a991-8391c3be3655 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:23.878060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b2b70-4950-4ce8-a991-8391c3be3655 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:23.879518 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 537/1085] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:23.886767 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015607e-e92c-4799-9963-8abbeb21932c None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:23.887322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015607e-e92c-4799-9963-8abbeb21932c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:23.887530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015607e-e92c-4799-9963-8abbeb21932c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:23.907143 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-4015607e-e92c-4799-9963-8abbeb21932c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:23.908360 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-4015607e-e92c-4799-9963-8abbeb21932c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:23.991150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 549/1086] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:23 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:35:24.014879 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b2b70-4950-4ce8-a991-8391c3be3655 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:24.134625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b2b70-4950-4ce8-a991-8391c3be3655 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:24.161017 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d145ad-1921-400a-8a37-968d7cceb617 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:24.161464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d145ad-1921-400a-8a37-968d7cceb617 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:24.161873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d145ad-1921-400a-8a37-968d7cceb617 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:24.163562 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 550/1087] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:24 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:35:24.169273 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964f313-df51-4ae6-892b-7935fa5067d8 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:24.169461 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964f313-df51-4ae6-892b-7935fa5067d8 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:24.169741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964f313-df51-4ae6-892b-7935fa5067d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:24.180829 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46b373-c14e-4c81-886c-bbf9b175bd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:24.181681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46b373-c14e-4c81-886c-bbf9b175bd2c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:24.181963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46b373-c14e-4c81-886c-bbf9b175bd2c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:24.182240 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46b373-c14e-4c81-886c-bbf9b175bd2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:24.187844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e964f313-df51-4ae6-892b-7935fa5067d8 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:24.189333 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e964f313-df51-4ae6-892b-7935fa5067d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:24.194688 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46b373-c14e-4c81-886c-bbf9b175bd2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-5a46b373-c14e-4c81-886c-bbf9b175bd2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:35:24.202736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:24.204411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:24.205390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:24.205390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:24.205390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:24.205390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:24.205390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:35:24.205390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:35:24.205390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:35:24.205390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:35:24.205390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:35:24.205390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:35:24.205390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:35:24.205390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:24.205390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 538/1088] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:35:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:24.210853 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46b373-c14e-4c81-886c-bbf9b175bd2c None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:24.230448 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:24.264499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:24.288005 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 551/1089] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:24 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:35:24.312487 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964f313-df51-4ae6-892b-7935fa5067d8 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:24.333754 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46b373-c14e-4c81-886c-bbf9b175bd2c None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:24.375990 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ae587-d57b-431d-bbe4-7f56a434280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:24.376995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ae587-d57b-431d-bbe4-7f56a434280e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:24.377328 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ae587-d57b-431d-bbe4-7f56a434280e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:24.378251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ae587-d57b-431d-bbe4-7f56a434280e None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:24.379725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ae587-d57b-431d-bbe4-7f56a434280e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:24.379725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ae587-d57b-431d-bbe4-7f56a434280e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:24.380995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ae587-d57b-431d-bbe4-7f56a434280e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:24.390113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 539/1090] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:35:24 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:24.396469 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ae587-d57b-431d-bbe4-7f56a434280e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:24.429944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964f313-df51-4ae6-892b-7935fa5067d8 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:24.468044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec3e0d-458c-415f-b25d-69de123f2e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:24.469027 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec3e0d-458c-415f-b25d-69de123f2e5c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:24.469309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec3e0d-458c-415f-b25d-69de123f2e5c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:24.469582 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec3e0d-458c-415f-b25d-69de123f2e5c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:24.479706 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:24.481623 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec3e0d-458c-415f-b25d-69de123f2e5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-38ec3e0d-458c-415f-b25d-69de123f2e5c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:35:24.490010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:24.492581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:24.493491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:24.493491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:24.493491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:24.493491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:24.493491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:35:24.493491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:35:24.493491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:35:24.493491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:35:24.493491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:35:24.493491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:35:24.493491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:35:24.493491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:24.493491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 552/1091] 10.222.0.112 () {56 vars in 1125 bytes} [Thu May 26 16:35:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:24.497507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec3e0d-458c-415f-b25d-69de123f2e5c None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:24.505968 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ae587-d57b-431d-bbe4-7f56a434280e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:24.546497 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2eb35-262b-47f0-a764-7ba57116ca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:24.547575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2eb35-262b-47f0-a764-7ba57116ca79 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:24.547951 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2eb35-262b-47f0-a764-7ba57116ca79 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:24.548342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2eb35-262b-47f0-a764-7ba57116ca79 None admin] PATH_INFO: `/v3/users/289e2421e44e4a1fb057937e6390a1cb` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:24.550353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2eb35-262b-47f0-a764-7ba57116ca79 None admin] RBAC: Authorizing `identity:get_user(user_id=289e2421e44e4a1fb057937e6390a1cb)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:24.551351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:24.551981 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2eb35-262b-47f0-a764-7ba57116ca79 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:24.554279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 540/1092] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:35:24 2022] GET /identity/v3/users/289e2421e44e4a1fb057937e6390a1cb => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:24.562456 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2eb35-262b-47f0-a764-7ba57116ca79 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:24.637443 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec3e0d-458c-415f-b25d-69de123f2e5c None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:24.678862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbc5b8-45f9-4b39-b493-636902108781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:24.679600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbc5b8-45f9-4b39-b493-636902108781 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:24.680085 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbc5b8-45f9-4b39-b493-636902108781 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:24.680569 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbc5b8-45f9-4b39-b493-636902108781 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:24.681364 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbc5b8-45f9-4b39-b493-636902108781 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:24.681686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbc5b8-45f9-4b39-b493-636902108781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:24.683337 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbc5b8-45f9-4b39-b493-636902108781 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:24.694558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2eb35-262b-47f0-a764-7ba57116ca79 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:24.695059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 553/1093] 10.222.0.112 () {56 vars in 1120 bytes} [Thu May 26 16:35:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:24.700841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbc5b8-45f9-4b39-b493-636902108781 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:24.733628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b770c4-2cda-4994-9711-7cc3c6bc4844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:24.734297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b770c4-2cda-4994-9711-7cc3c6bc4844 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:24.734618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b770c4-2cda-4994-9711-7cc3c6bc4844 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:24.734891 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b770c4-2cda-4994-9711-7cc3c6bc4844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:24.753459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:24.810751 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbc5b8-45f9-4b39-b493-636902108781 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:24.812647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b770c4-2cda-4994-9711-7cc3c6bc4844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:24.814422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b770c4-2cda-4994-9711-7cc3c6bc4844 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:24.819218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:24.847939 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97094edf-5572-4f7b-bb53-3c07f3273008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:24.848850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97094edf-5572-4f7b-bb53-3c07f3273008 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:24.849130 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97094edf-5572-4f7b-bb53-3c07f3273008 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:24.849405 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97094edf-5572-4f7b-bb53-3c07f3273008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:24.862463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97094edf-5572-4f7b-bb53-3c07f3273008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:24.864211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97094edf-5572-4f7b-bb53-3c07f3273008 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:24.884545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-97094edf-5572-4f7b-bb53-3c07f3273008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:24.884545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:24.884545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:24.884545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:24.884545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:24.884545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:24.884545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:24.884545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:24.884545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:24.884545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:24.884545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:24.884545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:24.884545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:35:24.884545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:35:24.884545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:24.885540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:24.886715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:35:24.886715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:35:24.886715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:24.886715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:24.886715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 554/1094] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:24.891523 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97094edf-5572-4f7b-bb53-3c07f3273008 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:24.927474 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 541/1095] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:35:24 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:35:24.945957 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b770c4-2cda-4994-9711-7cc3c6bc4844 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:24.991327 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:25.028020 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97094edf-5572-4f7b-bb53-3c07f3273008 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:25.054192 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b770c4-2cda-4994-9711-7cc3c6bc4844 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:25.077982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e157867-6db3-4716-b6dd-8ec935246e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:25.079122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e157867-6db3-4716-b6dd-8ec935246e68 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:25.079617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e157867-6db3-4716-b6dd-8ec935246e68 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:25.080104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e157867-6db3-4716-b6dd-8ec935246e68 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:25.082057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e157867-6db3-4716-b6dd-8ec935246e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:25.082500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e157867-6db3-4716-b6dd-8ec935246e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:25.084048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e157867-6db3-4716-b6dd-8ec935246e68 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:25.105964 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 555/1096] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:35:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:25.106169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43ff36-212b-476a-9a0e-989d1336788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:25.106169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43ff36-212b-476a-9a0e-989d1336788c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:25.106169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43ff36-212b-476a-9a0e-989d1336788c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:25.106169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43ff36-212b-476a-9a0e-989d1336788c None admin] PATH_INFO: `/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:25.106534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43ff36-212b-476a-9a0e-989d1336788c None admin] RBAC: Authorizing `identity:get_project(project_id=ee863f05d02747d78f213a1cc7b0cdcf)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:25.106870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43ff36-212b-476a-9a0e-989d1336788c None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:25.107654 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e157867-6db3-4716-b6dd-8ec935246e68 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:25.114384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 542/1097] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:35:24 2022] GET /identity/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:25.117440 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43ff36-212b-476a-9a0e-989d1336788c None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:25.135905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:25.245289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e157867-6db3-4716-b6dd-8ec935246e68 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:25.252415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43ff36-212b-476a-9a0e-989d1336788c None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:25.268470 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:25.291742 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72959e0-3978-4634-b7d5-b00fa0823b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:25.292409 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72959e0-3978-4634-b7d5-b00fa0823b8d None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:25.292689 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72959e0-3978-4634-b7d5-b00fa0823b8d None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:25.292961 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72959e0-3978-4634-b7d5-b00fa0823b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:25.293792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72959e0-3978-4634-b7d5-b00fa0823b8d None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=ee863f05d02747d78f213a1cc7b0cdcf, user.id=289e2421e44e4a1fb057937e6390a1cb) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:25.294107 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72959e0-3978-4634-b7d5-b00fa0823b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:25.295066 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50901efe-74cb-4a17-8f15-68bedc11ca2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:25.295584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72959e0-3978-4634-b7d5-b00fa0823b8d None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:25.295862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50901efe-74cb-4a17-8f15-68bedc11ca2a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:25.296147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50901efe-74cb-4a17-8f15-68bedc11ca2a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:25.296425 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50901efe-74cb-4a17-8f15-68bedc11ca2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:25.302731 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 543/1098] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:35:25 2022] GET /identity/v3/role_assignments?user.id=289e2421e44e4a1fb057937e6390a1cb&scope.project.id=ee863f05d02747d78f213a1cc7b0cdcf&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 610 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:25.305268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50901efe-74cb-4a17-8f15-68bedc11ca2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:25.306762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50901efe-74cb-4a17-8f15-68bedc11ca2a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-50901efe-74cb-4a17-8f15-68bedc11ca2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:35:25.324988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:25.326372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:25.327535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:25.327535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:25.327535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:35:25.327535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:35:25.327535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:35:25.327535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:35:25.327535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:35:25.327535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:35:25.327535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:35:25.327535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:25.327535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 556/1099] 10.222.0.112 () {56 vars in 1098 bytes} [Thu May 26 16:35:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:25.335281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72959e0-3978-4634-b7d5-b00fa0823b8d None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:25.462674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72959e0-3978-4634-b7d5-b00fa0823b8d None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:25.504545 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a4ff2-e277-49e3-8753-01e601279ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:25.505253 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a4ff2-e277-49e3-8753-01e601279ba6 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:25.505534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a4ff2-e277-49e3-8753-01e601279ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:25.505813 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a4ff2-e277-49e3-8753-01e601279ba6 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:25.506725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a4ff2-e277-49e3-8753-01e601279ba6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:25.507043 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a4ff2-e277-49e3-8753-01e601279ba6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:25.508575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a4ff2-e277-49e3-8753-01e601279ba6 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:25.532878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 544/1100] 10.222.0.112 () {56 vars in 1138 bytes} [Thu May 26 16:35:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:25.542353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50901efe-74cb-4a17-8f15-68bedc11ca2a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:25.649665 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:25.672837 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50901efe-74cb-4a17-8f15-68bedc11ca2a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:25.713493 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44230579-173a-49e6-ae56-00be5d6ce2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:25.714076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44230579-173a-49e6-ae56-00be5d6ce2fe None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:25.714393 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44230579-173a-49e6-ae56-00be5d6ce2fe None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:25.714674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44230579-173a-49e6-ae56-00be5d6ce2fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:25.799309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44230579-173a-49e6-ae56-00be5d6ce2fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:25.801549 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44230579-173a-49e6-ae56-00be5d6ce2fe None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:25.899926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:25.928513 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 557/1101] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:35:25 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 16:35:25.934570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a4ff2-e277-49e3-8753-01e601279ba6 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:25.984870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:26.113737 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a4ff2-e277-49e3-8753-01e601279ba6 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:26.155829 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc9f57-395b-45f9-8f0d-8d7fa4e66ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:26.156648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc9f57-395b-45f9-8f0d-8d7fa4e66ad3 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:26.156931 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc9f57-395b-45f9-8f0d-8d7fa4e66ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:26.157202 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc9f57-395b-45f9-8f0d-8d7fa4e66ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:26.170997 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc9f57-395b-45f9-8f0d-8d7fa4e66ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:26.172480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc9f57-395b-45f9-8f0d-8d7fa4e66ad3 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:26.195233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-e6bc9f57-395b-45f9-8f0d-8d7fa4e66ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:26.195233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:26.195233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:26.195233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:26.195233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:26.195233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:26.195233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:26.195233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:26.195233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:26.195233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:26.195233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:26.195233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:26.195233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:35:26.195233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:35:26.195233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:26.196339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:26.197894 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:35:26.197894 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:35:26.197894 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:35:26.197894 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:26.198704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 545/1102] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:26.203189 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44230579-173a-49e6-ae56-00be5d6ce2fe None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:26.323980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44230579-173a-49e6-ae56-00be5d6ce2fe None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:26.360035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcc684-72ef-4fa7-9bbf-4c9f9e0216da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:26.360712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcc684-72ef-4fa7-9bbf-4c9f9e0216da None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:26.360997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcc684-72ef-4fa7-9bbf-4c9f9e0216da None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:26.361274 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcc684-72ef-4fa7-9bbf-4c9f9e0216da None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:26.362636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dcc684-72ef-4fa7-9bbf-4c9f9e0216da None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:26.363058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dcc684-72ef-4fa7-9bbf-4c9f9e0216da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:26.364486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dcc684-72ef-4fa7-9bbf-4c9f9e0216da None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:26.377130 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 558/1103] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:35:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:26.383809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc9f57-395b-45f9-8f0d-8d7fa4e66ad3 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:26.485665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:26.498900 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc9f57-395b-45f9-8f0d-8d7fa4e66ad3 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:26.542537 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2fdd0-3fcd-4c7a-b9b9-9efb7659269f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:26.543363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2fdd0-3fcd-4c7a-b9b9-9efb7659269f None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:26.543649 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2fdd0-3fcd-4c7a-b9b9-9efb7659269f None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:26.543927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2fdd0-3fcd-4c7a-b9b9-9efb7659269f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:26.552243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2fdd0-3fcd-4c7a-b9b9-9efb7659269f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:26.553748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2fdd0-3fcd-4c7a-b9b9-9efb7659269f None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:26.569895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-f9e2fdd0-3fcd-4c7a-b9b9-9efb7659269f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:35:26.569895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:26.569895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:26.569895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:26.569895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:26.569895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:26.569895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:26.569895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:26.569895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:26.569895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:26.569895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:26.569895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:26.569895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:35:26.569895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:35:26.569895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:26.571302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:26.572209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:35:26.572209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:35:26.572209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:35:26.572209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:35:26.572209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:35:26.572209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:35:26.572209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:35:26.572209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:26.572209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 546/1104] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:35:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:26.577841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcc684-72ef-4fa7-9bbf-4c9f9e0216da None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:26.631947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:26.715332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcc684-72ef-4fa7-9bbf-4c9f9e0216da None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:26.754078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b330f4-db7a-47f8-940a-1f54de3142f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:26.754778 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b330f4-db7a-47f8-940a-1f54de3142f1 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:26.755064 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b330f4-db7a-47f8-940a-1f54de3142f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:26.755343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b330f4-db7a-47f8-940a-1f54de3142f1 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:26.756479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b330f4-db7a-47f8-940a-1f54de3142f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:26.756479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b330f4-db7a-47f8-940a-1f54de3142f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:26.758371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b330f4-db7a-47f8-940a-1f54de3142f1 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:26.771837 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 559/1105] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:35:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:26.778629 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2fdd0-3fcd-4c7a-b9b9-9efb7659269f None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:26.896153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2fdd0-3fcd-4c7a-b9b9-9efb7659269f None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:26.952657 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84938daa-d839-408f-add8-603ef7cfecfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:26.953351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84938daa-d839-408f-add8-603ef7cfecfa None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:26.953598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84938daa-d839-408f-add8-603ef7cfecfa None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:26.953925 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84938daa-d839-408f-add8-603ef7cfecfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:26.954975 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84938daa-d839-408f-add8-603ef7cfecfa None admin] RBAC: Adding query filter params (role.id=6a1901e356224f31b647f4ae3aeb3d37, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=5f2ec4c76f8f4d858bce53f30cc198fa) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:26.955403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84938daa-d839-408f-add8-603ef7cfecfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:26.958346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84938daa-d839-408f-add8-603ef7cfecfa None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:26.966871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 547/1106] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:35:26 2022] GET /identity/v3/role_assignments?user.id=5f2ec4c76f8f4d858bce53f30cc198fa&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=6a1901e356224f31b647f4ae3aeb3d37 => generated 610 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:28.247205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e7792-a008-4d99-85d5-720a712d4a5a None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:28.247768 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e7792-a008-4d99-85d5-720a712d4a5a None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:28.247768 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e7792-a008-4d99-85d5-720a712d4a5a None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:28.249178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 560/1107] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:35:28.257775 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ee784-28b3-4f96-b53c-868ed3c03fc0 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:28.259637 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ee784-28b3-4f96-b53c-868ed3c03fc0 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:28.260107 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ee784-28b3-4f96-b53c-868ed3c03fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:28.281050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-939ee784-28b3-4f96-b53c-868ed3c03fc0 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:28.282354 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-939ee784-28b3-4f96-b53c-868ed3c03fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:28.291541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:28.372290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 548/1108] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:28 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:35:28.400338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e7792-a008-4d99-85d5-720a712d4a5a None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:28.533965 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:28.539268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e7792-a008-4d99-85d5-720a712d4a5a None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:28.583153 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfe0d2-fe9f-43f6-8e7f-877852b23e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:28.584170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfe0d2-fe9f-43f6-8e7f-877852b23e5f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:28.584456 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfe0d2-fe9f-43f6-8e7f-877852b23e5f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:28.584736 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfe0d2-fe9f-43f6-8e7f-877852b23e5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:28.585971 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfe0d2-fe9f-43f6-8e7f-877852b23e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:28.587439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfe0d2-fe9f-43f6-8e7f-877852b23e5f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:28.589092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 561/1109] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:28 2022] GET /identity/v3/domains/default => generated 200 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:28.597189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ee784-28b3-4f96-b53c-868ed3c03fc0 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:28.722572 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ee784-28b3-4f96-b53c-868ed3c03fc0 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:28.762119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7de96-e79e-4856-8a26-cc05993f173a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:28.762862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7de96-e79e-4856-8a26-cc05993f173a None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:28.763150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7de96-e79e-4856-8a26-cc05993f173a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:28.763432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7de96-e79e-4856-8a26-cc05993f173a None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:28.764192 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7de96-e79e-4856-8a26-cc05993f173a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:28.765685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7de96-e79e-4856-8a26-cc05993f173a None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:29.005905 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:29.012720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 549/1110] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:35:28 2022] POST /identity/v3/users => generated 287 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:35:31.403232 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d933800-f7f6-4316-8d7e-ea9d7efa72f4 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:31.403759 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d933800-f7f6-4316-8d7e-ea9d7efa72f4 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:31.403759 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d933800-f7f6-4316-8d7e-ea9d7efa72f4 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:31.405147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 562/1111] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:31.411983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639b62f-361c-4036-94e9-fe9e9c23cae6 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:31.412528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639b62f-361c-4036-94e9-fe9e9c23cae6 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:31.412528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639b62f-361c-4036-94e9-fe9e9c23cae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:31.431110 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-5639b62f-361c-4036-94e9-fe9e9c23cae6 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:31.432345 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5639b62f-361c-4036-94e9-fe9e9c23cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:31.509296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 550/1112] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:31 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:35:31.536296 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d933800-f7f6-4316-8d7e-ea9d7efa72f4 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:31.662420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d933800-f7f6-4316-8d7e-ea9d7efa72f4 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:31.703268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7439a6-7885-4737-b7c8-31d3b9c64b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:31.704136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7439a6-7885-4737-b7c8-31d3b9c64b5c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:31.704419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7439a6-7885-4737-b7c8-31d3b9c64b5c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:31.704696 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7439a6-7885-4737-b7c8-31d3b9c64b5c None admin] PATH_INFO: `/v3/roles/0449b3526e454e9ea05258c90de6de31` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:31.707165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7439a6-7885-4737-b7c8-31d3b9c64b5c None admin] RBAC: Authorizing `identity:get_role(role_id=0449b3526e454e9ea05258c90de6de31)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:31.708613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7439a6-7885-4737-b7c8-31d3b9c64b5c None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:31.710067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 563/1113] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:35:31 2022] GET /identity/v3/roles/0449b3526e454e9ea05258c90de6de31 => generated 224 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:31.716125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639b62f-361c-4036-94e9-fe9e9c23cae6 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:31.844037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639b62f-361c-4036-94e9-fe9e9c23cae6 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:31.876432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:31.884912 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270fde0-5fab-4842-828f-660b24460150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:31.894462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270fde0-5fab-4842-828f-660b24460150 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:31.894462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270fde0-5fab-4842-828f-660b24460150 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:31.894462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270fde0-5fab-4842-828f-660b24460150 None admin] PATH_INFO: `/v3/users/abd904268e8546ef92770915e22940c5` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:31.903134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270fde0-5fab-4842-828f-660b24460150 None admin] RBAC: Authorizing `identity:get_user(user_id=abd904268e8546ef92770915e22940c5)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:31.904616 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270fde0-5fab-4842-828f-660b24460150 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:31.906549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 551/1114] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:35:31 2022] GET /identity/v3/users/abd904268e8546ef92770915e22940c5 => generated 287 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:31.913663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7439a6-7885-4737-b7c8-31d3b9c64b5c None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:31.957795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:32.037898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7439a6-7885-4737-b7c8-31d3b9c64b5c None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:32.089196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef5a76-d9a1-4d3b-a210-976ab6ea339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:32.089859 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef5a76-d9a1-4d3b-a210-976ab6ea339a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:32.090147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef5a76-d9a1-4d3b-a210-976ab6ea339a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:32.090461 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef5a76-d9a1-4d3b-a210-976ab6ea339a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:32.165982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef5a76-d9a1-4d3b-a210-976ab6ea339a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:32.167502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef5a76-d9a1-4d3b-a210-976ab6ea339a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:32.207711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:32.281153 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 564/1115] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:35:31 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:35:32.286781 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270fde0-5fab-4842-828f-660b24460150 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:32.400393 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270fde0-5fab-4842-828f-660b24460150 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:32.448050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78416131-5785-4438-bac1-f1e596aa7b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:32.448832 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78416131-5785-4438-bac1-f1e596aa7b39 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:32.449124 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78416131-5785-4438-bac1-f1e596aa7b39 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:32.449408 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78416131-5785-4438-bac1-f1e596aa7b39 None admin] PATH_INFO: `/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:32.450674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78416131-5785-4438-bac1-f1e596aa7b39 None admin] RBAC: Authorizing `identity:get_project(project_id=ee863f05d02747d78f213a1cc7b0cdcf)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:32.452138 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78416131-5785-4438-bac1-f1e596aa7b39 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:32.453884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 552/1116] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:35:32 2022] GET /identity/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:32.460917 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef5a76-d9a1-4d3b-a210-976ab6ea339a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:32.574986 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef5a76-d9a1-4d3b-a210-976ab6ea339a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:32.616038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7dc80-c4e5-4332-85a5-5175f0f0106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:32.616713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7dc80-c4e5-4332-85a5-5175f0f0106c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:32.616995 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7dc80-c4e5-4332-85a5-5175f0f0106c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:32.617270 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7dc80-c4e5-4332-85a5-5175f0f0106c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:32.618116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7dc80-c4e5-4332-85a5-5175f0f0106c None admin] RBAC: Adding query filter params (role.id=0449b3526e454e9ea05258c90de6de31, scope.project.id=ee863f05d02747d78f213a1cc7b0cdcf, user.id=abd904268e8546ef92770915e22940c5) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:32.618464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7dc80-c4e5-4332-85a5-5175f0f0106c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:32.619913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7dc80-c4e5-4332-85a5-5175f0f0106c None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:32.622114 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:32.626406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 565/1117] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:35:32 2022] GET /identity/v3/role_assignments?user.id=abd904268e8546ef92770915e22940c5&scope.project.id=ee863f05d02747d78f213a1cc7b0cdcf&role.id=0449b3526e454e9ea05258c90de6de31 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:34.868760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d52aeb-8982-4a35-a346-0c0dd88f6477 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:34.869289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d52aeb-8982-4a35-a346-0c0dd88f6477 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:34.869289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d52aeb-8982-4a35-a346-0c0dd88f6477 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:34.870718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 553/1118] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:34.876083 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e57ea-8403-4f10-a0c3-9abdb98ab39b None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:34.876474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e57ea-8403-4f10-a0c3-9abdb98ab39b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:34.876632 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e57ea-8403-4f10-a0c3-9abdb98ab39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:34.895130 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-1e9e57ea-8403-4f10-a0c3-9abdb98ab39b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:34.896324 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1e9e57ea-8403-4f10-a0c3-9abdb98ab39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:34.967251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 566/1119] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:34 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:35:34.991206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d52aeb-8982-4a35-a346-0c0dd88f6477 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:35.051181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:35.101581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d52aeb-8982-4a35-a346-0c0dd88f6477 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:35.140005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0350fdb-8f6b-458b-8f22-b22e37541e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:35.140788 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0350fdb-8f6b-458b-8f22-b22e37541e12 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:35.141070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0350fdb-8f6b-458b-8f22-b22e37541e12 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:35.141346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0350fdb-8f6b-458b-8f22-b22e37541e12 None admin] PATH_INFO: `/v3/roles/0449b3526e454e9ea05258c90de6de31` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:35.142890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0350fdb-8f6b-458b-8f22-b22e37541e12 None admin] RBAC: Authorizing `identity:get_role(role_id=0449b3526e454e9ea05258c90de6de31)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:35.144791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0350fdb-8f6b-458b-8f22-b22e37541e12 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:35.146390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 554/1120] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:35:34 2022] GET /identity/v3/roles/0449b3526e454e9ea05258c90de6de31 => generated 224 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:35.153630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e57ea-8403-4f10-a0c3-9abdb98ab39b None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:35.263642 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e57ea-8403-4f10-a0c3-9abdb98ab39b None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:35.293638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:35.302427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95a7ed-ddb7-49c8-a5e1-1af0d25869ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:35.303311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95a7ed-ddb7-49c8-a5e1-1af0d25869ba None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:35.303596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95a7ed-ddb7-49c8-a5e1-1af0d25869ba None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:35.303874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95a7ed-ddb7-49c8-a5e1-1af0d25869ba None admin] PATH_INFO: `/v3/users/abd904268e8546ef92770915e22940c5` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:35.305101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95a7ed-ddb7-49c8-a5e1-1af0d25869ba None admin] RBAC: Authorizing `identity:get_user(user_id=abd904268e8546ef92770915e22940c5)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:35.306632 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95a7ed-ddb7-49c8-a5e1-1af0d25869ba None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:35.308318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 567/1121] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:35:35 2022] GET /identity/v3/users/abd904268e8546ef92770915e22940c5 => generated 287 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:35.314080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0350fdb-8f6b-458b-8f22-b22e37541e12 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:35.430265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0350fdb-8f6b-458b-8f22-b22e37541e12 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:35.459842 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:35.472426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55a1ae-cac7-4a67-935e-2504e99af153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:35.473312 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55a1ae-cac7-4a67-935e-2504e99af153 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:35.473590 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55a1ae-cac7-4a67-935e-2504e99af153 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:35.473861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55a1ae-cac7-4a67-935e-2504e99af153 None admin] PATH_INFO: `/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:35.475211 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55a1ae-cac7-4a67-935e-2504e99af153 None admin] RBAC: Authorizing `identity:get_project(project_id=ee863f05d02747d78f213a1cc7b0cdcf)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:35.476652 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55a1ae-cac7-4a67-935e-2504e99af153 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:35.478404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 555/1122] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:35:35 2022] GET /identity/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:35.485074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95a7ed-ddb7-49c8-a5e1-1af0d25869ba None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:35.598823 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95a7ed-ddb7-49c8-a5e1-1af0d25869ba None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:35.636262 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf02d61-70a1-47e4-927b-42b1fb0d8b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:35.637155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf02d61-70a1-47e4-927b-42b1fb0d8b15 None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:35.637439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf02d61-70a1-47e4-927b-42b1fb0d8b15 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:35.637718 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf02d61-70a1-47e4-927b-42b1fb0d8b15 None admin] PATH_INFO: `/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf/users/abd904268e8546ef92770915e22940c5/roles/0449b3526e454e9ea05258c90de6de31` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:35.639968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf02d61-70a1-47e4-927b-42b1fb0d8b15 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee863f05d02747d78f213a1cc7b0cdcf, user_id=abd904268e8546ef92770915e22940c5, role_id=0449b3526e454e9ea05258c90de6de31)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:35.641443 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf02d61-70a1-47e4-927b-42b1fb0d8b15 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:35.743639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 568/1123] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:35:35 2022] PUT /identity/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf/users/abd904268e8546ef92770915e22940c5/roles/0449b3526e454e9ea05258c90de6de31 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:35:38.081837 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c395ced-15e1-4709-afdc-19cf5b85215b None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:38.082437 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c395ced-15e1-4709-afdc-19cf5b85215b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:38.082619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c395ced-15e1-4709-afdc-19cf5b85215b None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:38.084083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 556/1124] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:38.090169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bcee6-066d-43cc-9ced-592a01792473 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:38.090700 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bcee6-066d-43cc-9ced-592a01792473 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:38.090700 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bcee6-066d-43cc-9ced-592a01792473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:38.107942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e01bcee6-066d-43cc-9ced-592a01792473 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:38.109147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e01bcee6-066d-43cc-9ced-592a01792473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:38.174448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:38.192918 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 569/1125] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:38 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:35:38.217564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c395ced-15e1-4709-afdc-19cf5b85215b None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:38.351584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c395ced-15e1-4709-afdc-19cf5b85215b None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:38.398240 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14399550-3e44-45bd-a648-c9667f49d61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:38.399155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14399550-3e44-45bd-a648-c9667f49d61d None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:38.399435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14399550-3e44-45bd-a648-c9667f49d61d None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:38.399712 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14399550-3e44-45bd-a648-c9667f49d61d None admin] PATH_INFO: `/v3/roles/0449b3526e454e9ea05258c90de6de31` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:38.401266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14399550-3e44-45bd-a648-c9667f49d61d None admin] RBAC: Authorizing `identity:get_role(role_id=0449b3526e454e9ea05258c90de6de31)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:38.402709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14399550-3e44-45bd-a648-c9667f49d61d None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:38.404156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 557/1126] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:35:38 2022] GET /identity/v3/roles/0449b3526e454e9ea05258c90de6de31 => generated 224 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:38.410204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bcee6-066d-43cc-9ced-592a01792473 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:38.524479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bcee6-066d-43cc-9ced-592a01792473 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:38.563227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af99c4-5f01-46ce-95fe-651a950bf8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:38.564136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af99c4-5f01-46ce-95fe-651a950bf8f9 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:38.564425 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af99c4-5f01-46ce-95fe-651a950bf8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:38.564977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af99c4-5f01-46ce-95fe-651a950bf8f9 None admin] PATH_INFO: `/v3/users/abd904268e8546ef92770915e22940c5` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:38.566367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af99c4-5f01-46ce-95fe-651a950bf8f9 None admin] RBAC: Authorizing `identity:get_user(user_id=abd904268e8546ef92770915e22940c5)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:38.568066 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af99c4-5f01-46ce-95fe-651a950bf8f9 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:38.569866 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 570/1127] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:35:38 2022] GET /identity/v3/users/abd904268e8546ef92770915e22940c5 => generated 287 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:38.576046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14399550-3e44-45bd-a648-c9667f49d61d None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:38.643433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:38.687619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14399550-3e44-45bd-a648-c9667f49d61d None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:38.724524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca92e64-04fb-42db-a7a7-38665d7fbdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:38.725179 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca92e64-04fb-42db-a7a7-38665d7fbdc5 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:38.725469 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca92e64-04fb-42db-a7a7-38665d7fbdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:38.725752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca92e64-04fb-42db-a7a7-38665d7fbdc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:38.793455 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca92e64-04fb-42db-a7a7-38665d7fbdc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:38.795040 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca92e64-04fb-42db-a7a7-38665d7fbdc5 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:38.854672 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:38.901086 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 558/1128] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:35:38 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:35:38.907186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af99c4-5f01-46ce-95fe-651a950bf8f9 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:38.966225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:39.014434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af99c4-5f01-46ce-95fe-651a950bf8f9 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:39.067265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc792c-75c2-4bee-9f7f-d80341c5c772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:39.068134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc792c-75c2-4bee-9f7f-d80341c5c772 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:39.068407 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc792c-75c2-4bee-9f7f-d80341c5c772 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:39.068678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc792c-75c2-4bee-9f7f-d80341c5c772 None admin] PATH_INFO: `/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:39.069895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc792c-75c2-4bee-9f7f-d80341c5c772 None admin] RBAC: Authorizing `identity:get_project(project_id=ee863f05d02747d78f213a1cc7b0cdcf)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:39.071355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc792c-75c2-4bee-9f7f-d80341c5c772 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:39.073163 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 571/1129] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:35:38 2022] GET /identity/v3/projects/ee863f05d02747d78f213a1cc7b0cdcf => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:39.079976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca92e64-04fb-42db-a7a7-38665d7fbdc5 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:39.192496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca92e64-04fb-42db-a7a7-38665d7fbdc5 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:39.250227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaf2ea-1864-4c2e-83c4-edb0817911e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:39.251378 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaf2ea-1864-4c2e-83c4-edb0817911e8 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:39.251869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaf2ea-1864-4c2e-83c4-edb0817911e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:39.252356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaf2ea-1864-4c2e-83c4-edb0817911e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:39.254530 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbaf2ea-1864-4c2e-83c4-edb0817911e8 None admin] RBAC: Adding query filter params (role.id=0449b3526e454e9ea05258c90de6de31, scope.project.id=ee863f05d02747d78f213a1cc7b0cdcf, user.id=abd904268e8546ef92770915e22940c5) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:39.255234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbaf2ea-1864-4c2e-83c4-edb0817911e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:39.257796 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbaf2ea-1864-4c2e-83c4-edb0817911e8 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:39.268541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 559/1130] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:35:39 2022] GET /identity/v3/role_assignments?user.id=abd904268e8546ef92770915e22940c5&scope.project.id=ee863f05d02747d78f213a1cc7b0cdcf&role.id=0449b3526e454e9ea05258c90de6de31 => generated 610 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:41.593804 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37498f33-b0d8-4967-9698-12e32fb14c37 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:41.594389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37498f33-b0d8-4967-9698-12e32fb14c37 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:41.594389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37498f33-b0d8-4967-9698-12e32fb14c37 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:41.595676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 572/1131] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:41.601674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6729e-92bc-47ec-b803-e029993bd1ab None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:41.602102 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6729e-92bc-47ec-b803-e029993bd1ab None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:41.602410 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6729e-92bc-47ec-b803-e029993bd1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:41.620947 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-acf6729e-92bc-47ec-b803-e029993bd1ab None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:41.622155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-acf6729e-92bc-47ec-b803-e029993bd1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:41.639373 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:41.690734 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 560/1132] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:41 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:35:41.715490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37498f33-b0d8-4967-9698-12e32fb14c37 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:41.832981 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37498f33-b0d8-4967-9698-12e32fb14c37 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:41.865925 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:41.878212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2532119-2045-4c16-b27f-88e6c0e1d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:41.879372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2532119-2045-4c16-b27f-88e6c0e1d3c6 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:41.879761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2532119-2045-4c16-b27f-88e6c0e1d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:41.881541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2532119-2045-4c16-b27f-88e6c0e1d3c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:41.881782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2532119-2045-4c16-b27f-88e6c0e1d3c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:41.885500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2532119-2045-4c16-b27f-88e6c0e1d3c6 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:41.885500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 573/1133] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:41 2022] GET /identity/v3/domains/default => generated 200 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:41.892647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6729e-92bc-47ec-b803-e029993bd1ab None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:41.998820 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6729e-92bc-47ec-b803-e029993bd1ab None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:42.033490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37121a32-2265-4c60-a971-05b92988a8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:42.034155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37121a32-2265-4c60-a971-05b92988a8be None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:42.034483 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37121a32-2265-4c60-a971-05b92988a8be None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:42.035361 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37121a32-2265-4c60-a971-05b92988a8be None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:42.036357 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37121a32-2265-4c60-a971-05b92988a8be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:42.037834 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37121a32-2265-4c60-a971-05b92988a8be None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:42.188988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 561/1134] 10.222.0.112 () {60 vars in 1146 bytes} [Thu May 26 16:35:41 2022] POST /identity/v3/projects => generated 312 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:35:44.520930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e921da-fe43-49d9-b140-a7e1c66a8e97 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:44.521442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e921da-fe43-49d9-b140-a7e1c66a8e97 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:44.521442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e921da-fe43-49d9-b140-a7e1c66a8e97 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:44.522788 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 574/1135] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:44.528887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d11e4-1ddb-4bd6-a6d7-4aea432d38c3 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:44.529462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d11e4-1ddb-4bd6-a6d7-4aea432d38c3 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:44.529462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d11e4-1ddb-4bd6-a6d7-4aea432d38c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:44.536448 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:44.548543 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-7f4d11e4-1ddb-4bd6-a6d7-4aea432d38c3 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:44.551191 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7f4d11e4-1ddb-4bd6-a6d7-4aea432d38c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:44.638524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 562/1136] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:44 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:35:44.664829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e921da-fe43-49d9-b140-a7e1c66a8e97 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:44.802101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e921da-fe43-49d9-b140-a7e1c66a8e97 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:44.838204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3a2d5-0009-4c03-91b1-35e977a71b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:44.839037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a2d5-0009-4c03-91b1-35e977a71b3d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:44.839324 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a2d5-0009-4c03-91b1-35e977a71b3d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:44.839592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a2d5-0009-4c03-91b1-35e977a71b3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:44.840850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3a2d5-0009-4c03-91b1-35e977a71b3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:44.842294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3a2d5-0009-4c03-91b1-35e977a71b3d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:44.843971 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 575/1137] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:35:44 2022] GET /identity/v3/domains/default => generated 200 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:44.850699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d11e4-1ddb-4bd6-a6d7-4aea432d38c3 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:44.969640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d11e4-1ddb-4bd6-a6d7-4aea432d38c3 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:45.004955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a28cac-55ff-4199-aa7c-04df24fcc408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:45.005630 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a28cac-55ff-4199-aa7c-04df24fcc408 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:45.005912 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a28cac-55ff-4199-aa7c-04df24fcc408 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:45.006191 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a28cac-55ff-4199-aa7c-04df24fcc408 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:45.006941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a28cac-55ff-4199-aa7c-04df24fcc408 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:45.008368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a28cac-55ff-4199-aa7c-04df24fcc408 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:45.015046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:45.183319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 563/1138] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:35:44 2022] POST /identity/v3/users => generated 287 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:35:47.495928 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979015e-4b54-4408-bcaa-c88b7c9df0c0 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:47.496439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979015e-4b54-4408-bcaa-c88b7c9df0c0 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:47.496439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979015e-4b54-4408-bcaa-c88b7c9df0c0 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:47.497771 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 576/1139] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:47.504492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fe070-bbd3-4a85-b705-caf60713aca7 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:47.505233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fe070-bbd3-4a85-b705-caf60713aca7 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:47.505490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fe070-bbd3-4a85-b705-caf60713aca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:47.530276 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-829fe070-bbd3-4a85-b705-caf60713aca7 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:47.531509 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-829fe070-bbd3-4a85-b705-caf60713aca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:47.615462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 564/1140] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:47 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:35:47.641179 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979015e-4b54-4408-bcaa-c88b7c9df0c0 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:47.711041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:47.759122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979015e-4b54-4408-bcaa-c88b7c9df0c0 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:47.794984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03f74e-4a5c-4f12-baad-66881100e236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:47.795773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03f74e-4a5c-4f12-baad-66881100e236 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:47.796060 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03f74e-4a5c-4f12-baad-66881100e236 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:47.796337 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03f74e-4a5c-4f12-baad-66881100e236 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:47.807666 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03f74e-4a5c-4f12-baad-66881100e236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-fd03f74e-4a5c-4f12-baad-66881100e236 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:35:47.815905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:47.818220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:47.819748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:47.819748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:47.819748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:47.819748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:47.819748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:35:47.819748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:35:47.819748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:35:47.819748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:35:47.819748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:35:47.819748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:35:47.819748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:35:47.819748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:47.819748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 577/1141] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:35:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:47.823854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fe070-bbd3-4a85-b705-caf60713aca7 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:47.929388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fe070-bbd3-4a85-b705-caf60713aca7 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:47.952241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:47.966898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3dcc8-2155-4937-ab04-055c534dcb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:47.967568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3dcc8-2155-4937-ab04-055c534dcb93 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:47.967854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3dcc8-2155-4937-ab04-055c534dcb93 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:47.968132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3dcc8-2155-4937-ab04-055c534dcb93 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:47.968936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3dcc8-2155-4937-ab04-055c534dcb93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:47.969247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3dcc8-2155-4937-ab04-055c534dcb93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:47.970663 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3dcc8-2155-4937-ab04-055c534dcb93 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:47.982931 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 565/1142] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:35:47 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:47.990113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03f74e-4a5c-4f12-baad-66881100e236 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:48.101739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03f74e-4a5c-4f12-baad-66881100e236 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:48.120214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:48.139853 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecf9ca-1c7e-4749-b04c-d5002129fb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:48.140730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecf9ca-1c7e-4749-b04c-d5002129fb70 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:48.141017 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecf9ca-1c7e-4749-b04c-d5002129fb70 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:48.141285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecf9ca-1c7e-4749-b04c-d5002129fb70 None admin] PATH_INFO: `/v3/users/586966b1e3cc483ca3926b08c7071307` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:48.156287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecf9ca-1c7e-4749-b04c-d5002129fb70 None admin] RBAC: Authorizing `identity:get_user(user_id=586966b1e3cc483ca3926b08c7071307)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:48.157854 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecf9ca-1c7e-4749-b04c-d5002129fb70 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:48.159710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 578/1143] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:35:47 2022] GET /identity/v3/users/586966b1e3cc483ca3926b08c7071307 => generated 287 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:48.166208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3dcc8-2155-4937-ab04-055c534dcb93 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:48.301828 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3dcc8-2155-4937-ab04-055c534dcb93 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:48.341823 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b08ba-5a67-4978-be70-15a78cb8cb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:48.342518 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b08ba-5a67-4978-be70-15a78cb8cb20 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:48.342807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b08ba-5a67-4978-be70-15a78cb8cb20 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:48.343083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b08ba-5a67-4978-be70-15a78cb8cb20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:48.409152 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:48.436575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b08ba-5a67-4978-be70-15a78cb8cb20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:48.439388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b08ba-5a67-4978-be70-15a78cb8cb20 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:48.567392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 566/1144] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:35:48 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:35:48.573395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecf9ca-1c7e-4749-b04c-d5002129fb70 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:48.693339 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecf9ca-1c7e-4749-b04c-d5002129fb70 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:48.734415 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55da0b-bf6e-4ece-85b9-ac9eddd4f064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:48.735277 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55da0b-bf6e-4ece-85b9-ac9eddd4f064 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:48.735554 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55da0b-bf6e-4ece-85b9-ac9eddd4f064 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:48.735835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55da0b-bf6e-4ece-85b9-ac9eddd4f064 None admin] PATH_INFO: `/v3/projects/e63ac5b6df934b2cad2706ab9c82239e` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:48.737082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55da0b-bf6e-4ece-85b9-ac9eddd4f064 None admin] RBAC: Authorizing `identity:get_project(project_id=e63ac5b6df934b2cad2706ab9c82239e)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:48.738644 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55da0b-bf6e-4ece-85b9-ac9eddd4f064 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:48.740423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 579/1145] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:35:48 2022] GET /identity/v3/projects/e63ac5b6df934b2cad2706ab9c82239e => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:48.746893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b08ba-5a67-4978-be70-15a78cb8cb20 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:48.836790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:48.861583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b08ba-5a67-4978-be70-15a78cb8cb20 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:48.898207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b3862-1d7f-45bd-80bb-76df5686645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:48.898999 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b3862-1d7f-45bd-80bb-76df5686645f None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:48.899288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b3862-1d7f-45bd-80bb-76df5686645f None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:48.899570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b3862-1d7f-45bd-80bb-76df5686645f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:48.900416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b3862-1d7f-45bd-80bb-76df5686645f None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=e63ac5b6df934b2cad2706ab9c82239e, user.id=586966b1e3cc483ca3926b08c7071307) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:48.900735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b3862-1d7f-45bd-80bb-76df5686645f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:48.902289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b3862-1d7f-45bd-80bb-76df5686645f None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:48.908443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 567/1146] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:35:48 2022] GET /identity/v3/role_assignments?user.id=586966b1e3cc483ca3926b08c7071307&scope.project.id=e63ac5b6df934b2cad2706ab9c82239e&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:51.194078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872fc75-6637-451f-9047-5178fac0eb74 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:51.194762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872fc75-6637-451f-9047-5178fac0eb74 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:51.194762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872fc75-6637-451f-9047-5178fac0eb74 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:51.196062 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 580/1147] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:51.201637 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdab66e-ac38-4c26-ab66-d9176ceb55a0 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:51.202078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdab66e-ac38-4c26-ab66-d9176ceb55a0 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:51.202237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdab66e-ac38-4c26-ab66-d9176ceb55a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:51.221212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-9fdab66e-ac38-4c26-ab66-d9176ceb55a0 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:51.222495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9fdab66e-ac38-4c26-ab66-d9176ceb55a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:51.290314 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 568/1148] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:51 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:35:51.312648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872fc75-6637-451f-9047-5178fac0eb74 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:51.363391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:51.419446 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872fc75-6637-451f-9047-5178fac0eb74 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:51.454768 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a7cd1-0033-4c7b-b5d5-3ccad633149c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:51.455473 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a7cd1-0033-4c7b-b5d5-3ccad633149c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:51.455756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a7cd1-0033-4c7b-b5d5-3ccad633149c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:51.456054 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a7cd1-0033-4c7b-b5d5-3ccad633149c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:51.467420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a7cd1-0033-4c7b-b5d5-3ccad633149c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-8d9a7cd1-0033-4c7b-b5d5-3ccad633149c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:35:51.475545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:51.476744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:51.477739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:51.477739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:51.477739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:51.477739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:51.477739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:35:51.477739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:35:51.477739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:35:51.477739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:35:51.477739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:35:51.477739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:35:51.477739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:35:51.477739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:51.477739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 581/1149] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:35:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:51.483004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdab66e-ac38-4c26-ab66-d9176ceb55a0 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:51.562880 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:51.586680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdab66e-ac38-4c26-ab66-d9176ceb55a0 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:51.621630 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12018d8d-6095-447f-a2a1-27b127b77b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:51.622311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12018d8d-6095-447f-a2a1-27b127b77b92 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:51.622634 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12018d8d-6095-447f-a2a1-27b127b77b92 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:51.622914 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12018d8d-6095-447f-a2a1-27b127b77b92 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:51.623670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12018d8d-6095-447f-a2a1-27b127b77b92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:51.623985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12018d8d-6095-447f-a2a1-27b127b77b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:51.625376 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12018d8d-6095-447f-a2a1-27b127b77b92 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:51.634705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 569/1150] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:35:51 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:51.640726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a7cd1-0033-4c7b-b5d5-3ccad633149c None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:51.747377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a7cd1-0033-4c7b-b5d5-3ccad633149c None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:51.749610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:51.782533 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3599c87-637a-425e-954b-a16aa0d65ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:51.783407 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3599c87-637a-425e-954b-a16aa0d65ac8 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:51.783689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3599c87-637a-425e-954b-a16aa0d65ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:51.783960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3599c87-637a-425e-954b-a16aa0d65ac8 None admin] PATH_INFO: `/v3/users/586966b1e3cc483ca3926b08c7071307` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:51.785683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3599c87-637a-425e-954b-a16aa0d65ac8 None admin] RBAC: Authorizing `identity:get_user(user_id=586966b1e3cc483ca3926b08c7071307)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:51.787194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3599c87-637a-425e-954b-a16aa0d65ac8 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:51.788838 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 582/1151] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:35:51 2022] GET /identity/v3/users/586966b1e3cc483ca3926b08c7071307 => generated 287 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:51.794678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12018d8d-6095-447f-a2a1-27b127b77b92 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:51.906491 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12018d8d-6095-447f-a2a1-27b127b77b92 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:51.941967 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618d18b-3067-4ea3-ac8c-a84dac24e45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:51.942882 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618d18b-3067-4ea3-ac8c-a84dac24e45f None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:51.943168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618d18b-3067-4ea3-ac8c-a84dac24e45f None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:51.943448 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618d18b-3067-4ea3-ac8c-a84dac24e45f None admin] PATH_INFO: `/v3/projects/e63ac5b6df934b2cad2706ab9c82239e` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:51.944662 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618d18b-3067-4ea3-ac8c-a84dac24e45f None admin] RBAC: Authorizing `identity:get_project(project_id=e63ac5b6df934b2cad2706ab9c82239e)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:51.946114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618d18b-3067-4ea3-ac8c-a84dac24e45f None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:51.948005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 570/1152] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:35:51 2022] GET /identity/v3/projects/e63ac5b6df934b2cad2706ab9c82239e => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:51.954142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3599c87-637a-425e-954b-a16aa0d65ac8 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:52.078050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3599c87-637a-425e-954b-a16aa0d65ac8 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:52.119141 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779ac28-f00a-4710-a01c-beb7af632f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:52.120038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779ac28-f00a-4710-a01c-beb7af632f18 None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:52.120315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779ac28-f00a-4710-a01c-beb7af632f18 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:52.120583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779ac28-f00a-4710-a01c-beb7af632f18 None admin] PATH_INFO: `/v3/projects/e63ac5b6df934b2cad2706ab9c82239e/users/586966b1e3cc483ca3926b08c7071307/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:52.122585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779ac28-f00a-4710-a01c-beb7af632f18 None admin] RBAC: Authorizing `identity:create_grant(project_id=e63ac5b6df934b2cad2706ab9c82239e, user_id=586966b1e3cc483ca3926b08c7071307, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:52.124009 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779ac28-f00a-4710-a01c-beb7af632f18 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:52.234470 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 583/1153] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:35:51 2022] PUT /identity/v3/projects/e63ac5b6df934b2cad2706ab9c82239e/users/586966b1e3cc483ca3926b08c7071307/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:35:54.487237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41163242-0552-4e06-ae61-e10788df76ea None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:54.487755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41163242-0552-4e06-ae61-e10788df76ea None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:54.487755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41163242-0552-4e06-ae61-e10788df76ea None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:54.489345 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 571/1154] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:54.494861 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e66f6-1d2c-475b-b22a-62d786d49686 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:54.495570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e66f6-1d2c-475b-b22a-62d786d49686 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:54.495785 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e66f6-1d2c-475b-b22a-62d786d49686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:54.523230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-257e66f6-1d2c-475b-b22a-62d786d49686 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:54.524494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-257e66f6-1d2c-475b-b22a-62d786d49686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:54.557238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:54.601216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 584/1155] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:54 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:35:54.625231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41163242-0552-4e06-ae61-e10788df76ea None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:54.635720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:54.728851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41163242-0552-4e06-ae61-e10788df76ea None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:54.765194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b54de-2dd2-4c60-947a-e8662618359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:54.765914 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b54de-2dd2-4c60-947a-e8662618359a None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:54.766202 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b54de-2dd2-4c60-947a-e8662618359a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:54.766516 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b54de-2dd2-4c60-947a-e8662618359a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:54.776811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b54de-2dd2-4c60-947a-e8662618359a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-f99b54de-2dd2-4c60-947a-e8662618359a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:35:54.784704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:54.785893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:54.786979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:54.786979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:54.786979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:54.786979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:54.786979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:35:54.786979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:35:54.786979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:35:54.786979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:35:54.786979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:35:54.786979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:35:54.786979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:35:54.786979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:35:54.786979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 572/1156] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:35:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:54.792236 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e66f6-1d2c-475b-b22a-62d786d49686 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:54.908920 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e66f6-1d2c-475b-b22a-62d786d49686 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:54.945276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc32629-d90a-47c5-a6d3-2a6145a2660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:54.945944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc32629-d90a-47c5-a6d3-2a6145a2660f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:54.946228 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc32629-d90a-47c5-a6d3-2a6145a2660f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:54.946532 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc32629-d90a-47c5-a6d3-2a6145a2660f None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:54.947282 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc32629-d90a-47c5-a6d3-2a6145a2660f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:54.947589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc32629-d90a-47c5-a6d3-2a6145a2660f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:54.948958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc32629-d90a-47c5-a6d3-2a6145a2660f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:54.956994 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 585/1157] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:35:54 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:54.963024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b54de-2dd2-4c60-947a-e8662618359a None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:55.031073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:55.068732 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b54de-2dd2-4c60-947a-e8662618359a None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:55.102786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7045f-7f41-40ef-b32e-2d6e492b7b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:55.103664 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7045f-7f41-40ef-b32e-2d6e492b7b97 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:55.103949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7045f-7f41-40ef-b32e-2d6e492b7b97 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:55.104228 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7045f-7f41-40ef-b32e-2d6e492b7b97 None admin] PATH_INFO: `/v3/users/586966b1e3cc483ca3926b08c7071307` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:55.105409 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7045f-7f41-40ef-b32e-2d6e492b7b97 None admin] RBAC: Authorizing `identity:get_user(user_id=586966b1e3cc483ca3926b08c7071307)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:55.106919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7045f-7f41-40ef-b32e-2d6e492b7b97 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:55.108549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 573/1158] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:35:54 2022] GET /identity/v3/users/586966b1e3cc483ca3926b08c7071307 => generated 287 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:55.114884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc32629-d90a-47c5-a6d3-2a6145a2660f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:55.140038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:55.215362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc32629-d90a-47c5-a6d3-2a6145a2660f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:55.251292 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f5283-7471-4e80-b2bd-4d28a1aea7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:55.251937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f5283-7471-4e80-b2bd-4d28a1aea7b9 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:55.252221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f5283-7471-4e80-b2bd-4d28a1aea7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:55.252491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f5283-7471-4e80-b2bd-4d28a1aea7b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:55.321313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f5283-7471-4e80-b2bd-4d28a1aea7b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:55.322687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f5283-7471-4e80-b2bd-4d28a1aea7b9 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:55.346589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:55.421571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 586/1159] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:35:55 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:35:55.427492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7045f-7f41-40ef-b32e-2d6e492b7b97 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:55.528063 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7045f-7f41-40ef-b32e-2d6e492b7b97 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:55.563020 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91458e46-331b-4353-841d-dabf8f77d983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:55.563909 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91458e46-331b-4353-841d-dabf8f77d983 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:55.564565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91458e46-331b-4353-841d-dabf8f77d983 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:55.564565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91458e46-331b-4353-841d-dabf8f77d983 None admin] PATH_INFO: `/v3/projects/e63ac5b6df934b2cad2706ab9c82239e` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:55.565583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91458e46-331b-4353-841d-dabf8f77d983 None admin] RBAC: Authorizing `identity:get_project(project_id=e63ac5b6df934b2cad2706ab9c82239e)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:55.567376 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91458e46-331b-4353-841d-dabf8f77d983 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:55.569177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 574/1160] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:35:55 2022] GET /identity/v3/projects/e63ac5b6df934b2cad2706ab9c82239e => generated 312 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:35:55.575508 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f5283-7471-4e80-b2bd-4d28a1aea7b9 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:55.675996 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f5283-7471-4e80-b2bd-4d28a1aea7b9 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:55.702820 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:55.714446 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7a380-0736-48a2-85ba-e4c1f4b8b54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:55.715107 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7a380-0736-48a2-85ba-e4c1f4b8b54d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:55.717454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7a380-0736-48a2-85ba-e4c1f4b8b54d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:55.717454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7a380-0736-48a2-85ba-e4c1f4b8b54d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:55.717454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7a380-0736-48a2-85ba-e4c1f4b8b54d None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=e63ac5b6df934b2cad2706ab9c82239e, user.id=586966b1e3cc483ca3926b08c7071307) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:55.717454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7a380-0736-48a2-85ba-e4c1f4b8b54d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:55.718254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7a380-0736-48a2-85ba-e4c1f4b8b54d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:55.724525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 587/1161] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:35:55 2022] GET /identity/v3/role_assignments?user.id=586966b1e3cc483ca3926b08c7071307&scope.project.id=e63ac5b6df934b2cad2706ab9c82239e&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 610 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:35:58.014238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa76d8e-fc97-4b14-aa80-7bb93e58f1a1 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:58.014868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa76d8e-fc97-4b14-aa80-7bb93e58f1a1 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:58.014868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa76d8e-fc97-4b14-aa80-7bb93e58f1a1 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:58.016211 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 575/1162] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:35:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:58.022270 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab5894-601a-4833-9790-44958410c36c None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:58.023733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab5894-601a-4833-9790-44958410c36c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:58.023733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab5894-601a-4833-9790-44958410c36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:58.039378 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-70ab5894-601a-4833-9790-44958410c36c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:58.040606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-70ab5894-601a-4833-9790-44958410c36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:58.110916 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 588/1163] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:35:58 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:35:58.134995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa76d8e-fc97-4b14-aa80-7bb93e58f1a1 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:58.137884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:58.248393 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa76d8e-fc97-4b14-aa80-7bb93e58f1a1 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:58.284258 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa1686-eb3a-43df-937f-05417fca7a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:58.284846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa1686-eb3a-43df-937f-05417fca7a99 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:58.285132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa1686-eb3a-43df-937f-05417fca7a99 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:58.286186 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa1686-eb3a-43df-937f-05417fca7a99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:58.370875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa1686-eb3a-43df-937f-05417fca7a99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:58.372343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa1686-eb3a-43df-937f-05417fca7a99 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:58.374283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:58.478192 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 576/1164] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:35:58 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:35:58.484961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab5894-601a-4833-9790-44958410c36c None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:58.596255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab5894-601a-4833-9790-44958410c36c None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:58.614262 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:58.631685 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149819a0-8b8d-4a43-9121-92762d247db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:58.632498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149819a0-8b8d-4a43-9121-92762d247db3 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:58.632780 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149819a0-8b8d-4a43-9121-92762d247db3 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:58.633165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149819a0-8b8d-4a43-9121-92762d247db3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:58.640417 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149819a0-8b8d-4a43-9121-92762d247db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:58.641852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149819a0-8b8d-4a43-9121-92762d247db3 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-149819a0-8b8d-4a43-9121-92762d247db3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:35:58.659183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:35:58.661979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:35:58.663725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:35:58.663725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:35:58.663725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:35:58.663725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:35:58.663725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:35:58.663725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:35:58.663725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:35:58.663725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:35:58.663725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:35:58.663725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:35:58.663725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 16:35:58.663725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:35:58.663725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 16:35:58.663725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:35:58.663725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 589/1165] 10.222.0.112 () {56 vars in 1122 bytes} [Thu May 26 16:35:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:35:58.668022 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa1686-eb3a-43df-937f-05417fca7a99 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:58.771431 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa1686-eb3a-43df-937f-05417fca7a99 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:58.772998 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:58.807486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbed64b-da58-4ca2-b85a-d3d096896ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:58.808150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbed64b-da58-4ca2-b85a-d3d096896ae3 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:58.808437 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbed64b-da58-4ca2-b85a-d3d096896ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:58.808718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbed64b-da58-4ca2-b85a-d3d096896ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:58.809444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbed64b-da58-4ca2-b85a-d3d096896ae3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:35:58.809755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbed64b-da58-4ca2-b85a-d3d096896ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:58.811162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbed64b-da58-4ca2-b85a-d3d096896ae3 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:58.819314 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 577/1166] 10.222.0.112 () {56 vars in 1120 bytes} [Thu May 26 16:35:58 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:36:01.097563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf549b-7a09-4805-9210-5e62398e281f None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:01.098676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf549b-7a09-4805-9210-5e62398e281f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:01.098676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf549b-7a09-4805-9210-5e62398e281f None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:01.100144 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 590/1167] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:36:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:36:01.106058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198fc3d-b8fb-4483-875c-246c64af509f None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:01.106581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198fc3d-b8fb-4483-875c-246c64af509f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:01.106676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198fc3d-b8fb-4483-875c-246c64af509f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:01.126699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-1198fc3d-b8fb-4483-875c-246c64af509f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:36:01.127949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1198fc3d-b8fb-4483-875c-246c64af509f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:36:01.205233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 578/1168] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:36:01 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:36:01.228717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf549b-7a09-4805-9210-5e62398e281f None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:01.333897 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf549b-7a09-4805-9210-5e62398e281f None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:01.369222 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4f362-dad5-440f-bbf7-9845950cd826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:01.369797 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4f362-dad5-440f-bbf7-9845950cd826 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:01.370082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4f362-dad5-440f-bbf7-9845950cd826 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:01.370386 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4f362-dad5-440f-bbf7-9845950cd826 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:01.371127 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4f362-dad5-440f-bbf7-9845950cd826 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:01.372486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4f362-dad5-440f-bbf7-9845950cd826 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:01.465688 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 591/1169] 10.222.0.112 () {60 vars in 1143 bytes} [Thu May 26 16:36:01 2022] POST /identity/v3/domains => generated 268 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:36:03.804202 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c083f17-9ef5-4237-96f5-6e907c089b21 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:03.804773 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c083f17-9ef5-4237-96f5-6e907c089b21 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:03.804773 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c083f17-9ef5-4237-96f5-6e907c089b21 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:03.806127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 579/1170] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:36:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:36:03.811926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea30b1-0b45-4509-85da-59b314df036b None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:03.812368 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea30b1-0b45-4509-85da-59b314df036b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:03.812486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea30b1-0b45-4509-85da-59b314df036b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:03.830030 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-f1ea30b1-0b45-4509-85da-59b314df036b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:36:03.831255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-f1ea30b1-0b45-4509-85da-59b314df036b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:36:03.860344 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:03.896518 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 592/1171] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:36:03 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:36:03.920782 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c083f17-9ef5-4237-96f5-6e907c089b21 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:04.016634 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:04.025477 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c083f17-9ef5-4237-96f5-6e907c089b21 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:04.061457 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350e13d-d903-43f9-af49-26e990dab021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:04.063124 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350e13d-d903-43f9-af49-26e990dab021 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:04.063480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350e13d-d903-43f9-af49-26e990dab021 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:04.063943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350e13d-d903-43f9-af49-26e990dab021 None admin] PATH_INFO: `/v3/domains/46cb1ca68d774bd2bcfd7ab026b58e2f` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:04.076053 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350e13d-d903-43f9-af49-26e990dab021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=46cb1ca68d774bd2bcfd7ab026b58e2f)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:04.077536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350e13d-d903-43f9-af49-26e990dab021 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:04.079353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 580/1172] 10.222.0.112 () {56 vars in 1188 bytes} [Thu May 26 16:36:03 2022] GET /identity/v3/domains/46cb1ca68d774bd2bcfd7ab026b58e2f => generated 268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:36:04.088131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea30b1-0b45-4509-85da-59b314df036b None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:04.196676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea30b1-0b45-4509-85da-59b314df036b None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:04.234310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aca47-2781-44df-b344-6ce3c27efbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:04.235007 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aca47-2781-44df-b344-6ce3c27efbb7 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:04.235287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aca47-2781-44df-b344-6ce3c27efbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:04.235564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aca47-2781-44df-b344-6ce3c27efbb7 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:04.236272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aca47-2781-44df-b344-6ce3c27efbb7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:04.237708 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aca47-2781-44df-b344-6ce3c27efbb7 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:04.340393 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 593/1173] 10.222.0.112 () {60 vars in 1146 bytes} [Thu May 26 16:36:04 2022] POST /identity/v3/projects => generated 362 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:36:06.685657 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d79c9-fe38-451c-a6d0-215d794e0ec4 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:06.686232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d79c9-fe38-451c-a6d0-215d794e0ec4 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:06.686232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d79c9-fe38-451c-a6d0-215d794e0ec4 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:06.687631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 581/1174] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:36:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:36:06.694549 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528e491-2bf9-4cf4-960b-a51145a23d34 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:06.695026 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528e491-2bf9-4cf4-960b-a51145a23d34 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:06.695134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528e491-2bf9-4cf4-960b-a51145a23d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:06.712739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-1528e491-2bf9-4cf4-960b-a51145a23d34 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:36:06.713991 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1528e491-2bf9-4cf4-960b-a51145a23d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:36:06.729551 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:06.787864 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 594/1175] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:36:06 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:36:06.812791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d79c9-fe38-451c-a6d0-215d794e0ec4 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:06.923433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d79c9-fe38-451c-a6d0-215d794e0ec4 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:06.962809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c0cf2-be37-449c-a5a0-cf4745e28c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:06.963593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c0cf2-be37-449c-a5a0-cf4745e28c99 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:06.963883 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c0cf2-be37-449c-a5a0-cf4745e28c99 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:06.964161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c0cf2-be37-449c-a5a0-cf4745e28c99 None admin] PATH_INFO: `/v3/domains/46cb1ca68d774bd2bcfd7ab026b58e2f` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:06.965423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c0cf2-be37-449c-a5a0-cf4745e28c99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=46cb1ca68d774bd2bcfd7ab026b58e2f)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:06.966916 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c0cf2-be37-449c-a5a0-cf4745e28c99 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:06.968561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 582/1176] 10.222.0.112 () {56 vars in 1188 bytes} [Thu May 26 16:36:06 2022] GET /identity/v3/domains/46cb1ca68d774bd2bcfd7ab026b58e2f => generated 268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:36:06.975969 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528e491-2bf9-4cf4-960b-a51145a23d34 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:07.077421 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528e491-2bf9-4cf4-960b-a51145a23d34 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:07.112119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8a0d0-d5ab-4910-a9bc-ca48a3a62c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:07.112798 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8a0d0-d5ab-4910-a9bc-ca48a3a62c28 None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:07.113151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8a0d0-d5ab-4910-a9bc-ca48a3a62c28 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:07.113482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8a0d0-d5ab-4910-a9bc-ca48a3a62c28 None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:07.115106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8a0d0-d5ab-4910-a9bc-ca48a3a62c28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:07.116592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8a0d0-d5ab-4910-a9bc-ca48a3a62c28 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:07.230433 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 595/1177] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:36:06 2022] POST /identity/v3/users => generated 312 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:36:09.590571 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b6803-1db0-415b-80a1-dadc7b211c56 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:09.591156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b6803-1db0-415b-80a1-dadc7b211c56 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:09.591156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b6803-1db0-415b-80a1-dadc7b211c56 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:09.592408 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 583/1178] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:36:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:36:09.599025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a24f5d-9328-4188-a32d-39d1ff04aa03 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:09.599743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a24f5d-9328-4188-a32d-39d1ff04aa03 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:09.599743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a24f5d-9328-4188-a32d-39d1ff04aa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:09.611571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:09.617434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-01a24f5d-9328-4188-a32d-39d1ff04aa03 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:36:09.618671 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-01a24f5d-9328-4188-a32d-39d1ff04aa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:36:09.692670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 596/1179] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:36:09 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:36:09.719997 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b6803-1db0-415b-80a1-dadc7b211c56 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:09.750219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:09.850201 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b6803-1db0-415b-80a1-dadc7b211c56 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:09.887734 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28719a-c16b-4640-a983-2eff132f1b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:09.888532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28719a-c16b-4640-a983-2eff132f1b92 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:09.888820 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28719a-c16b-4640-a983-2eff132f1b92 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:09.889095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28719a-c16b-4640-a983-2eff132f1b92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:09.901483 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28719a-c16b-4640-a983-2eff132f1b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-0e28719a-c16b-4640-a983-2eff132f1b92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:36:09.909286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:36:09.911080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:36:09.912861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:36:09.912861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:36:09.912861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:36:09.912861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:36:09.912861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:36:09.912861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:36:09.912861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:36:09.912861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:36:09.912861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:36:09.912861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:36:09.912861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:36:09.912861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:36:09.912861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 584/1180] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:36:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:36:09.917743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a24f5d-9328-4188-a32d-39d1ff04aa03 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:10.025717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a24f5d-9328-4188-a32d-39d1ff04aa03 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:10.067784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1e089-ca7c-47e6-9bc9-a9e1073f45e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:10.068688 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1e089-ca7c-47e6-9bc9-a9e1073f45e4 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:10.068977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1e089-ca7c-47e6-9bc9-a9e1073f45e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:10.069259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1e089-ca7c-47e6-9bc9-a9e1073f45e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:10.070006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1e089-ca7c-47e6-9bc9-a9e1073f45e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:36:10.070314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1e089-ca7c-47e6-9bc9-a9e1073f45e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:10.071703 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1e089-ca7c-47e6-9bc9-a9e1073f45e4 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:10.074108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:10.083880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 597/1181] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:36:09 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:36:10.090077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28719a-c16b-4640-a983-2eff132f1b92 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:10.183878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:10.201646 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28719a-c16b-4640-a983-2eff132f1b92 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:10.242096 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba87fb-2c89-4a3d-b78d-49dbf213074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:10.243364 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba87fb-2c89-4a3d-b78d-49dbf213074b None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:10.243687 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba87fb-2c89-4a3d-b78d-49dbf213074b None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:10.244171 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba87fb-2c89-4a3d-b78d-49dbf213074b None admin] PATH_INFO: `/v3/users/87bba2e3546042b0a3a1ea5d1826bea3` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:10.259810 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba87fb-2c89-4a3d-b78d-49dbf213074b None admin] RBAC: Authorizing `identity:get_user(user_id=87bba2e3546042b0a3a1ea5d1826bea3)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:10.263542 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba87fb-2c89-4a3d-b78d-49dbf213074b None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:10.263542 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 585/1182] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:36:10 2022] GET /identity/v3/users/87bba2e3546042b0a3a1ea5d1826bea3 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:36:10.270006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1e089-ca7c-47e6-9bc9-a9e1073f45e4 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:10.391753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1e089-ca7c-47e6-9bc9-a9e1073f45e4 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:10.436074 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a36b3-2c07-4d4a-9955-5f9e0af34d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:10.436644 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a36b3-2c07-4d4a-9955-5f9e0af34d03 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:10.436926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a36b3-2c07-4d4a-9955-5f9e0af34d03 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:10.437206 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a36b3-2c07-4d4a-9955-5f9e0af34d03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:10.515992 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:10.520961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a36b3-2c07-4d4a-9955-5f9e0af34d03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:10.523232 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a36b3-2c07-4d4a-9955-5f9e0af34d03 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:10.637711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 598/1183] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:36:10 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 16:36:10.644208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba87fb-2c89-4a3d-b78d-49dbf213074b None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:10.759312 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba87fb-2c89-4a3d-b78d-49dbf213074b None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:10.800295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279414b-0027-42a8-ac1c-9ace82b4d8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:10.801166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279414b-0027-42a8-ac1c-9ace82b4d8db None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:10.801951 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279414b-0027-42a8-ac1c-9ace82b4d8db None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:10.802247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279414b-0027-42a8-ac1c-9ace82b4d8db None admin] PATH_INFO: `/v3/projects/551f6e9200a045b1adb680e2b7cdb33f` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:10.803493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279414b-0027-42a8-ac1c-9ace82b4d8db None admin] RBAC: Authorizing `identity:get_project(project_id=551f6e9200a045b1adb680e2b7cdb33f)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:10.804959 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279414b-0027-42a8-ac1c-9ace82b4d8db None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:10.806743 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 586/1184] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:36:10 2022] GET /identity/v3/projects/551f6e9200a045b1adb680e2b7cdb33f => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:36:10.813154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a36b3-2c07-4d4a-9955-5f9e0af34d03 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:10.920000 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:10.924186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a36b3-2c07-4d4a-9955-5f9e0af34d03 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:10.972404 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50d784-ad3a-4ed8-b7e3-68fd5b277343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:10.974259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50d784-ad3a-4ed8-b7e3-68fd5b277343 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:10.974754 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50d784-ad3a-4ed8-b7e3-68fd5b277343 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:10.975278 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50d784-ad3a-4ed8-b7e3-68fd5b277343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:10.976739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50d784-ad3a-4ed8-b7e3-68fd5b277343 None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=551f6e9200a045b1adb680e2b7cdb33f, user.id=87bba2e3546042b0a3a1ea5d1826bea3) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:36:10.977248 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50d784-ad3a-4ed8-b7e3-68fd5b277343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:10.979895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50d784-ad3a-4ed8-b7e3-68fd5b277343 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:10.989280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 599/1185] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:36:10 2022] GET /identity/v3/role_assignments?user.id=87bba2e3546042b0a3a1ea5d1826bea3&scope.project.id=551f6e9200a045b1adb680e2b7cdb33f&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:36:13.257546 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39cbcc-db64-4941-ad65-ebdad55b58a7 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:13.258100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39cbcc-db64-4941-ad65-ebdad55b58a7 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:13.258100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39cbcc-db64-4941-ad65-ebdad55b58a7 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:13.259621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 587/1186] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:36:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:36:13.265312 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806ed6b-2972-4fe2-b9e5-912d4657743b None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:13.266010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806ed6b-2972-4fe2-b9e5-912d4657743b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:13.266010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806ed6b-2972-4fe2-b9e5-912d4657743b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:13.285238 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-c806ed6b-2972-4fe2-b9e5-912d4657743b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:36:13.286793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c806ed6b-2972-4fe2-b9e5-912d4657743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:36:13.357679 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 600/1187] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:36:13 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:36:13.382456 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39cbcc-db64-4941-ad65-ebdad55b58a7 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:13.398295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:13.495995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39cbcc-db64-4941-ad65-ebdad55b58a7 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:13.532611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5947276-4c81-4302-b2ee-4b2961bd82a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:13.533404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5947276-4c81-4302-b2ee-4b2961bd82a6 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:13.533682 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5947276-4c81-4302-b2ee-4b2961bd82a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:13.533955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5947276-4c81-4302-b2ee-4b2961bd82a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:13.545414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5947276-4c81-4302-b2ee-4b2961bd82a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-d5947276-4c81-4302-b2ee-4b2961bd82a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:36:13.553267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:36:13.555001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:36:13.556025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:36:13.556025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:36:13.556025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:36:13.556025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:36:13.556025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:36:13.556025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:36:13.556025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:36:13.556025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:36:13.556025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:36:13.556025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:36:13.556025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:36:13.556025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:36:13.556025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 588/1188] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:36:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:36:13.563335 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806ed6b-2972-4fe2-b9e5-912d4657743b None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:13.667485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:13.675915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806ed6b-2972-4fe2-b9e5-912d4657743b None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:13.716138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b3123-4282-4989-a01a-3d0b38a70257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:13.717065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b3123-4282-4989-a01a-3d0b38a70257 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:13.717732 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b3123-4282-4989-a01a-3d0b38a70257 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:13.718048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b3123-4282-4989-a01a-3d0b38a70257 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:13.718902 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b3123-4282-4989-a01a-3d0b38a70257 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:36:13.719257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b3123-4282-4989-a01a-3d0b38a70257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:13.720676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b3123-4282-4989-a01a-3d0b38a70257 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:13.730966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 601/1189] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:36:13 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:36:13.737459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5947276-4c81-4302-b2ee-4b2961bd82a6 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:13.821306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:13.854254 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5947276-4c81-4302-b2ee-4b2961bd82a6 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:13.901824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae4886-54ca-4178-a26e-e639a0df3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:13.902744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae4886-54ca-4178-a26e-e639a0df3ced None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:13.903024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae4886-54ca-4178-a26e-e639a0df3ced None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:13.903308 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae4886-54ca-4178-a26e-e639a0df3ced None admin] PATH_INFO: `/v3/users/87bba2e3546042b0a3a1ea5d1826bea3` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:13.904505 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae4886-54ca-4178-a26e-e639a0df3ced None admin] RBAC: Authorizing `identity:get_user(user_id=87bba2e3546042b0a3a1ea5d1826bea3)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:13.905947 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae4886-54ca-4178-a26e-e639a0df3ced None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:13.907631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 589/1190] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:36:13 2022] GET /identity/v3/users/87bba2e3546042b0a3a1ea5d1826bea3 => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:36:13.916134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b3123-4282-4989-a01a-3d0b38a70257 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:14.041778 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b3123-4282-4989-a01a-3d0b38a70257 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:14.079905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d539cfb-b29b-4fb3-8933-5e8c8f8a34c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:14.080682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d539cfb-b29b-4fb3-8933-5e8c8f8a34c4 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:14.080970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d539cfb-b29b-4fb3-8933-5e8c8f8a34c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:14.081251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d539cfb-b29b-4fb3-8933-5e8c8f8a34c4 None admin] PATH_INFO: `/v3/projects/551f6e9200a045b1adb680e2b7cdb33f` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:14.082491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d539cfb-b29b-4fb3-8933-5e8c8f8a34c4 None admin] RBAC: Authorizing `identity:get_project(project_id=551f6e9200a045b1adb680e2b7cdb33f)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:14.083974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d539cfb-b29b-4fb3-8933-5e8c8f8a34c4 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:14.085723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 602/1191] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:36:13 2022] GET /identity/v3/projects/551f6e9200a045b1adb680e2b7cdb33f => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:36:14.091822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae4886-54ca-4178-a26e-e639a0df3ced None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:14.200733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae4886-54ca-4178-a26e-e639a0df3ced None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:14.242066 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64097019-f1f6-4b53-aedb-1a8f47776c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:14.242997 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097019-f1f6-4b53-aedb-1a8f47776c05 None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:14.243276 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097019-f1f6-4b53-aedb-1a8f47776c05 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:14.243619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097019-f1f6-4b53-aedb-1a8f47776c05 None admin] PATH_INFO: `/v3/projects/551f6e9200a045b1adb680e2b7cdb33f/users/87bba2e3546042b0a3a1ea5d1826bea3/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:14.245735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64097019-f1f6-4b53-aedb-1a8f47776c05 None admin] RBAC: Authorizing `identity:create_grant(project_id=551f6e9200a045b1adb680e2b7cdb33f, user_id=87bba2e3546042b0a3a1ea5d1826bea3, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:14.247213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64097019-f1f6-4b53-aedb-1a8f47776c05 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:14.327835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:14.333900 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 590/1192] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:36:14 2022] PUT /identity/v3/projects/551f6e9200a045b1adb680e2b7cdb33f/users/87bba2e3546042b0a3a1ea5d1826bea3/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:36:16.582249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c264b92-863a-4303-9bcd-f2d53427bbaf None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:16.583377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c264b92-863a-4303-9bcd-f2d53427bbaf None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:16.583377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c264b92-863a-4303-9bcd-f2d53427bbaf None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:16.584628 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 603/1193] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:36:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:36:16.590340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e11760-dca5-4952-90c1-646da3497a68 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:16.590807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e11760-dca5-4952-90c1-646da3497a68 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:16.590964 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e11760-dca5-4952-90c1-646da3497a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:16.608247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-d4e11760-dca5-4952-90c1-646da3497a68 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:36:16.609435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d4e11760-dca5-4952-90c1-646da3497a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:36:16.679533 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 591/1194] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:36:16 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:36:16.703998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c264b92-863a-4303-9bcd-f2d53427bbaf None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:16.743457 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:16.836936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c264b92-863a-4303-9bcd-f2d53427bbaf None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:16.881974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb495b3b-0de0-420b-bed3-1b7c36bf2735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:16.882798 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb495b3b-0de0-420b-bed3-1b7c36bf2735 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:16.883083 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb495b3b-0de0-420b-bed3-1b7c36bf2735 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:16.883357 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb495b3b-0de0-420b-bed3-1b7c36bf2735 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:16.893665 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb495b3b-0de0-420b-bed3-1b7c36bf2735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-eb495b3b-0de0-420b-bed3-1b7c36bf2735 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:36:16.902242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:36:16.903451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:36:16.904927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:36:16.904927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:36:16.904927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:36:16.904927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:36:16.904927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:36:16.904927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:36:16.904927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:36:16.904927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:36:16.904927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:36:16.904927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:36:16.904927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:36:16.904927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:36:16.904927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 604/1195] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:36:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:36:16.910136 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e11760-dca5-4952-90c1-646da3497a68 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:17.028069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e11760-dca5-4952-90c1-646da3497a68 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:17.060268 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:17.074700 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5c463-2efe-4030-ae01-329e19ffa85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:17.075380 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5c463-2efe-4030-ae01-329e19ffa85a None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:17.075665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5c463-2efe-4030-ae01-329e19ffa85a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:17.075940 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5c463-2efe-4030-ae01-329e19ffa85a None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:17.076683 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5c463-2efe-4030-ae01-329e19ffa85a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:36:17.076994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5c463-2efe-4030-ae01-329e19ffa85a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:17.078453 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5c463-2efe-4030-ae01-329e19ffa85a None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:17.086756 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 592/1196] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:36:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:36:17.093540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb495b3b-0de0-420b-bed3-1b7c36bf2735 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:17.184699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:17.208468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb495b3b-0de0-420b-bed3-1b7c36bf2735 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:17.246485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b728d-2dc0-46b4-8d49-cf2be232dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:17.247364 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b728d-2dc0-46b4-8d49-cf2be232dc9d None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:17.247645 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b728d-2dc0-46b4-8d49-cf2be232dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:17.247915 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b728d-2dc0-46b4-8d49-cf2be232dc9d None admin] PATH_INFO: `/v3/users/87bba2e3546042b0a3a1ea5d1826bea3` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:17.249112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b728d-2dc0-46b4-8d49-cf2be232dc9d None admin] RBAC: Authorizing `identity:get_user(user_id=87bba2e3546042b0a3a1ea5d1826bea3)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:17.250564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b728d-2dc0-46b4-8d49-cf2be232dc9d None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:17.252200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 605/1197] 10.222.0.112 () {56 vars in 1182 bytes} [Thu May 26 16:36:17 2022] GET /identity/v3/users/87bba2e3546042b0a3a1ea5d1826bea3 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:36:17.259128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5c463-2efe-4030-ae01-329e19ffa85a None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:17.378223 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5c463-2efe-4030-ae01-329e19ffa85a None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:17.419992 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea382bb9-8fd4-4016-b945-e3a1b22de54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:17.420993 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea382bb9-8fd4-4016-b945-e3a1b22de54e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:17.421328 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea382bb9-8fd4-4016-b945-e3a1b22de54e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:17.421642 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea382bb9-8fd4-4016-b945-e3a1b22de54e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:17.495444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:17.509052 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea382bb9-8fd4-4016-b945-e3a1b22de54e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:17.511456 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea382bb9-8fd4-4016-b945-e3a1b22de54e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:17.627110 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 593/1198] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:36:17 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:36:17.633860 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b728d-2dc0-46b4-8d49-cf2be232dc9d None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:17.750878 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b728d-2dc0-46b4-8d49-cf2be232dc9d None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:17.797355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735acce-fc0e-489e-863c-94436504185e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:17.798895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735acce-fc0e-489e-863c-94436504185e None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:17.799396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735acce-fc0e-489e-863c-94436504185e None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:17.799687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735acce-fc0e-489e-863c-94436504185e None admin] PATH_INFO: `/v3/projects/551f6e9200a045b1adb680e2b7cdb33f` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:17.801206 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735acce-fc0e-489e-863c-94436504185e None admin] RBAC: Authorizing `identity:get_project(project_id=551f6e9200a045b1adb680e2b7cdb33f)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:17.804339 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735acce-fc0e-489e-863c-94436504185e None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:17.806747 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 606/1199] 10.222.0.112 () {56 vars in 1191 bytes} [Thu May 26 16:36:17 2022] GET /identity/v3/projects/551f6e9200a045b1adb680e2b7cdb33f => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:36:17.813690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea382bb9-8fd4-4016-b945-e3a1b22de54e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:36:17.921559 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:17.932728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea382bb9-8fd4-4016-b945-e3a1b22de54e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:36:17.971253 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568048b-f15d-4e56-ba09-24b3e8f27749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:36:17.971923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568048b-f15d-4e56-ba09-24b3e8f27749 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:36:17.972208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568048b-f15d-4e56-ba09-24b3e8f27749 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:36:17.972472 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568048b-f15d-4e56-ba09-24b3e8f27749 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:36:17.973389 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568048b-f15d-4e56-ba09-24b3e8f27749 None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=551f6e9200a045b1adb680e2b7cdb33f, user.id=87bba2e3546042b0a3a1ea5d1826bea3) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:36:17.973705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568048b-f15d-4e56-ba09-24b3e8f27749 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:36:17.975348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568048b-f15d-4e56-ba09-24b3e8f27749 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:36:17.982266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 594/1200] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:36:17 2022] GET /identity/v3/role_assignments?user.id=87bba2e3546042b0a3a1ea5d1826bea3&scope.project.id=551f6e9200a045b1adb680e2b7cdb33f&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 610 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:36:27.791117 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=91 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:36:27.978949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=23 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:53.433907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c577-0b91-4a2d-8c2d-75cdf5b7dcef None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:53.435023 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c577-0b91-4a2d-8c2d-75cdf5b7dcef None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:53.435023 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c577-0b91-4a2d-8c2d-75cdf5b7dcef None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:53.435986 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 607/1201] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:37:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:37:53.441416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feac004-310c-480f-a931-dc2ff1d45789 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:53.441878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feac004-310c-480f-a931-dc2ff1d45789 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:53.442006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feac004-310c-480f-a931-dc2ff1d45789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:53.461263 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-7feac004-310c-480f-a931-dc2ff1d45789 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:37:53.462423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7feac004-310c-480f-a931-dc2ff1d45789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:37:53.540553 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 595/1202] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:37:53 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:37:53.567145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004c577-0b91-4a2d-8c2d-75cdf5b7dcef None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:53.687666 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004c577-0b91-4a2d-8c2d-75cdf5b7dcef None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:53.729285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41779b13-1523-4f30-af4c-1a4cdc5b12f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:53.730015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41779b13-1523-4f30-af4c-1a4cdc5b12f4 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:53.730306 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41779b13-1523-4f30-af4c-1a4cdc5b12f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:53.730616 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41779b13-1523-4f30-af4c-1a4cdc5b12f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:53.744802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41779b13-1523-4f30-af4c-1a4cdc5b12f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:53.746747 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41779b13-1523-4f30-af4c-1a4cdc5b12f4 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:53.767180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-41779b13-1523-4f30-af4c-1a4cdc5b12f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:37:53.767180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:37:53.767180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:37:53.767180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:37:53.767180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:37:53.767180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:37:53.767180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:37:53.767180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:37:53.767180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:37:53.767180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:37:53.767180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:37:53.767180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:37:53.767180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:37:53.767180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:37:53.767180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:37:53.768435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:37:53.769543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:37:53.769543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:37:53.769543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:37:53.769543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:37:53.769543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 608/1203] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:37:53.775184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feac004-310c-480f-a931-dc2ff1d45789 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:53.889615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feac004-310c-480f-a931-dc2ff1d45789 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:53.921697 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:53.927995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066ee04-b26a-40d8-83e3-48be097b86f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:53.928666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066ee04-b26a-40d8-83e3-48be097b86f8 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:53.928949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066ee04-b26a-40d8-83e3-48be097b86f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:53.929279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066ee04-b26a-40d8-83e3-48be097b86f8 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:53.930199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066ee04-b26a-40d8-83e3-48be097b86f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:37:53.930585 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066ee04-b26a-40d8-83e3-48be097b86f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:53.932085 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066ee04-b26a-40d8-83e3-48be097b86f8 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:53.943899 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 596/1204] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:37:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:37:53.950173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41779b13-1523-4f30-af4c-1a4cdc5b12f4 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:54.010202 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:54.060594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41779b13-1523-4f30-af4c-1a4cdc5b12f4 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:54.103442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4388323-d574-41aa-ab99-10e19455a4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:54.104113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4388323-d574-41aa-ab99-10e19455a4cc None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:54.104391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4388323-d574-41aa-ab99-10e19455a4cc None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:54.104667 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4388323-d574-41aa-ab99-10e19455a4cc None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:54.105481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4388323-d574-41aa-ab99-10e19455a4cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:54.106967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4388323-d574-41aa-ab99-10e19455a4cc None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:54.313568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 609/1205] 10.222.0.112 () {60 vars in 1137 bytes} [Thu May 26 16:37:53 2022] POST /identity/v3/users => generated 252 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:37:56.591672 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95244b4-aefa-405f-b662-e3445652de75 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:56.592184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95244b4-aefa-405f-b662-e3445652de75 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:56.592184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95244b4-aefa-405f-b662-e3445652de75 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:56.593583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 597/1206] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:37:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:37:56.598891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b71816-86b5-45ec-b8f1-7b825a2589f2 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:56.599396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b71816-86b5-45ec-b8f1-7b825a2589f2 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:56.599837 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b71816-86b5-45ec-b8f1-7b825a2589f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:56.617908 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-77b71816-86b5-45ec-b8f1-7b825a2589f2 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:37:56.619146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-77b71816-86b5-45ec-b8f1-7b825a2589f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:37:56.687210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 610/1207] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:37:56 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:37:56.712895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95244b4-aefa-405f-b662-e3445652de75 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:56.828008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95244b4-aefa-405f-b662-e3445652de75 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:56.871333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a033f7-3d78-40ef-b756-d90c888a80d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:56.871333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a033f7-3d78-40ef-b756-d90c888a80d0 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:56.871333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a033f7-3d78-40ef-b756-d90c888a80d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:56.871333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a033f7-3d78-40ef-b756-d90c888a80d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:56.878247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a033f7-3d78-40ef-b756-d90c888a80d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-c8a033f7-3d78-40ef-b756-d90c888a80d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:37:56.886988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:37:56.888929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:37:56.890065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:37:56.890065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:37:56.890065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:37:56.890065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:37:56.890065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:37:56.890065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:37:56.890065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:37:56.890065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:37:56.890065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:37:56.890065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:37:56.890065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:37:56.890065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:37:56.890065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 598/1208] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:37:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:37:56.895042 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b71816-86b5-45ec-b8f1-7b825a2589f2 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:56.935479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:56.995863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b71816-86b5-45ec-b8f1-7b825a2589f2 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:57.031820 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb69b22-ba12-414f-ae08-d722aa6eddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:57.032490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb69b22-ba12-414f-ae08-d722aa6eddfc None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:57.032774 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb69b22-ba12-414f-ae08-d722aa6eddfc None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:57.033046 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb69b22-ba12-414f-ae08-d722aa6eddfc None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:57.033783 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb69b22-ba12-414f-ae08-d722aa6eddfc None admin] RBAC: Adding query filter params (name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:37:57.034087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb69b22-ba12-414f-ae08-d722aa6eddfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:57.035485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb69b22-ba12-414f-ae08-d722aa6eddfc None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:57.043619 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 611/1209] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:37:56 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:37:57.049674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a033f7-3d78-40ef-b756-d90c888a80d0 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:57.105313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:57.156599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a033f7-3d78-40ef-b756-d90c888a80d0 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:57.192406 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5af4ff-1e25-4ac6-812e-7a1173ecd22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:57.193897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5af4ff-1e25-4ac6-812e-7a1173ecd22e None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:57.194185 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5af4ff-1e25-4ac6-812e-7a1173ecd22e None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:57.194489 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5af4ff-1e25-4ac6-812e-7a1173ecd22e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:57.205707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5af4ff-1e25-4ac6-812e-7a1173ecd22e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:57.207218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5af4ff-1e25-4ac6-812e-7a1173ecd22e None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:57.225692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-3f5af4ff-1e25-4ac6-812e-7a1173ecd22e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:37:57.225692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:37:57.225692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:37:57.225692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:37:57.225692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:37:57.225692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:37:57.225692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:37:57.225692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:37:57.225692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:37:57.225692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:37:57.225692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:37:57.225692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:37:57.225692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:37:57.225692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:37:57.225692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:37:57.226885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:37:57.227851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:37:57.227851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:37:57.227851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:37:57.227851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:37:57.227851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 599/1210] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:37:57.232380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb69b22-ba12-414f-ae08-d722aa6eddfc None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:57.342567 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:57.345541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb69b22-ba12-414f-ae08-d722aa6eddfc None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:57.387030 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfd554-955e-4feb-a60c-fc15c7384637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:57.387698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfd554-955e-4feb-a60c-fc15c7384637 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:57.387984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfd554-955e-4feb-a60c-fc15c7384637 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:57.388268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfd554-955e-4feb-a60c-fc15c7384637 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:57.388996 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfd554-955e-4feb-a60c-fc15c7384637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:37:57.389305 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfd554-955e-4feb-a60c-fc15c7384637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:57.390732 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfd554-955e-4feb-a60c-fc15c7384637 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:57.403002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 612/1211] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:37:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:37:57.408810 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5af4ff-1e25-4ac6-812e-7a1173ecd22e None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:57.520505 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5af4ff-1e25-4ac6-812e-7a1173ecd22e None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:57.522749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:57.557277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc03b2-b94a-47cd-8377-1b47fc91a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:57.558080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc03b2-b94a-47cd-8377-1b47fc91a048 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:57.558389 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc03b2-b94a-47cd-8377-1b47fc91a048 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:57.558667 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc03b2-b94a-47cd-8377-1b47fc91a048 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:57.568374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc03b2-b94a-47cd-8377-1b47fc91a048 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:57.574441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc03b2-b94a-47cd-8377-1b47fc91a048 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-46cc03b2-b94a-47cd-8377-1b47fc91a048 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:37:57.588640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:37:57.590538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:37:57.592867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:37:57.592867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:37:57.592867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:37:57.592867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:37:57.592867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:37:57.592867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:37:57.592867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:37:57.592867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:37:57.592867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:37:57.592867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:37:57.592867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 600/1212] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:37:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:37:57.595898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfd554-955e-4feb-a60c-fc15c7384637 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:57.707208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfd554-955e-4feb-a60c-fc15c7384637 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:57.758180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e008bba-ea25-4c5a-87bd-e2ffa3151a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:57.758894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e008bba-ea25-4c5a-87bd-e2ffa3151a95 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:57.759184 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e008bba-ea25-4c5a-87bd-e2ffa3151a95 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:57.759463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e008bba-ea25-4c5a-87bd-e2ffa3151a95 None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:57.760303 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e008bba-ea25-4c5a-87bd-e2ffa3151a95 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:37:57.760624 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e008bba-ea25-4c5a-87bd-e2ffa3151a95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:57.762073 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e008bba-ea25-4c5a-87bd-e2ffa3151a95 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:57.782171 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 613/1213] 10.222.0.112 () {56 vars in 1148 bytes} [Thu May 26 16:37:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:37:57.788252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc03b2-b94a-47cd-8377-1b47fc91a048 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:57.898278 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc03b2-b94a-47cd-8377-1b47fc91a048 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:57.934221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad3cc0-c7e7-49cb-82f6-ff9ca5952a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:57.934905 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad3cc0-c7e7-49cb-82f6-ff9ca5952a75 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:57.935187 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad3cc0-c7e7-49cb-82f6-ff9ca5952a75 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:57.935463 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad3cc0-c7e7-49cb-82f6-ff9ca5952a75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:57.967597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:58.010721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad3cc0-c7e7-49cb-82f6-ff9ca5952a75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:58.012200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad3cc0-c7e7-49cb-82f6-ff9ca5952a75 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:58.117458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 601/1214] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:37:57 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:37:58.123473 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e008bba-ea25-4c5a-87bd-e2ffa3151a95 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:58.144453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:58.257901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e008bba-ea25-4c5a-87bd-e2ffa3151a95 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:58.310498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1403d8c-4e02-4347-93a3-d596fc71ac59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:58.311311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1403d8c-4e02-4347-93a3-d596fc71ac59 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:58.311579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1403d8c-4e02-4347-93a3-d596fc71ac59 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:58.311851 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1403d8c-4e02-4347-93a3-d596fc71ac59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:58.324737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1403d8c-4e02-4347-93a3-d596fc71ac59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:58.326221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1403d8c-4e02-4347-93a3-d596fc71ac59 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:58.347873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-f1403d8c-4e02-4347-93a3-d596fc71ac59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:37:58.347873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:37:58.347873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:37:58.347873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:37:58.347873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:37:58.347873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:37:58.347873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:37:58.347873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:37:58.347873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:37:58.347873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:37:58.347873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:37:58.347873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:37:58.347873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:37:58.347873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:37:58.347873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:37:58.352464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:37:58.353595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:37:58.353595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:37:58.353595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:37:58.353595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:37:58.353595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 614/1215] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:37:58.357084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad3cc0-c7e7-49cb-82f6-ff9ca5952a75 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:58.435512 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:58.477420 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad3cc0-c7e7-49cb-82f6-ff9ca5952a75 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:58.525352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba1aeb-1b69-4c14-b7d1-b304067d70c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:58.525908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba1aeb-1b69-4c14-b7d1-b304067d70c0 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:58.526194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba1aeb-1b69-4c14-b7d1-b304067d70c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:58.526537 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba1aeb-1b69-4c14-b7d1-b304067d70c0 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:58.527269 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba1aeb-1b69-4c14-b7d1-b304067d70c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:37:58.527581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba1aeb-1b69-4c14-b7d1-b304067d70c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:58.528999 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba1aeb-1b69-4c14-b7d1-b304067d70c0 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:58.542204 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 602/1216] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:37:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:37:58.547539 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1403d8c-4e02-4347-93a3-d596fc71ac59 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:58.626579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:58.672120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1403d8c-4e02-4347-93a3-d596fc71ac59 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:58.720882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523b5e-7b57-4002-9c3b-d2f5ec3ce6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:58.721691 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b523b5e-7b57-4002-9c3b-d2f5ec3ce6fe None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:58.721978 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b523b5e-7b57-4002-9c3b-d2f5ec3ce6fe None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:58.722248 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b523b5e-7b57-4002-9c3b-d2f5ec3ce6fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:58.731293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b523b5e-7b57-4002-9c3b-d2f5ec3ce6fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:58.733011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b523b5e-7b57-4002-9c3b-d2f5ec3ce6fe None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:58.753880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-8b523b5e-7b57-4002-9c3b-d2f5ec3ce6fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:37:58.753880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:37:58.753880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:37:58.753880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:37:58.753880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:37:58.753880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:37:58.753880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:37:58.753880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:37:58.753880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:37:58.753880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:37:58.753880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:37:58.753880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:37:58.753880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:37:58.753880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:37:58.753880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:37:58.755898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:37:58.757195 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:37:58.757195 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:37:58.757195 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:37:58.757195 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:37:58.757195 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:37:58.757195 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:37:58.757195 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:37:58.757195 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:37:58.757195 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 615/1217] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:37:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:37:58.762234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba1aeb-1b69-4c14-b7d1-b304067d70c0 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:58.886901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba1aeb-1b69-4c14-b7d1-b304067d70c0 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:58.913367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:58.930919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b44a87-2805-4cd7-8764-e652178ec902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:58.931616 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b44a87-2805-4cd7-8764-e652178ec902 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:58.932015 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b44a87-2805-4cd7-8764-e652178ec902 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:58.932498 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b44a87-2805-4cd7-8764-e652178ec902 None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:58.933963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b44a87-2805-4cd7-8764-e652178ec902 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:37:58.934544 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b44a87-2805-4cd7-8764-e652178ec902 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:58.936832 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b44a87-2805-4cd7-8764-e652178ec902 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:58.951839 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 603/1218] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:37:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:37:58.958413 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523b5e-7b57-4002-9c3b-d2f5ec3ce6fe None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:59.077175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523b5e-7b57-4002-9c3b-d2f5ec3ce6fe None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:59.109097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:59.115638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91be21-7580-4007-9bb9-f9694d596362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:59.116355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91be21-7580-4007-9bb9-f9694d596362 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:59.116632 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91be21-7580-4007-9bb9-f9694d596362 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:59.116901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91be21-7580-4007-9bb9-f9694d596362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:59.117731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91be21-7580-4007-9bb9-f9694d596362 None admin] RBAC: Adding query filter params (role.id=64acd9118f3d4931be8ca4bfa4ae907e, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=b415e7fca03e4602b3d711436d47f46d) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:37:59.118042 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91be21-7580-4007-9bb9-f9694d596362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:59.119545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91be21-7580-4007-9bb9-f9694d596362 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:59.128335 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 616/1219] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:37:58 2022] GET /identity/v3/role_assignments?user.id=b415e7fca03e4602b3d711436d47f46d&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=64acd9118f3d4931be8ca4bfa4ae907e => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:01.372457 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da6deb-4754-414a-8e2e-4c154d88ac93 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:01.373236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da6deb-4754-414a-8e2e-4c154d88ac93 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:01.373236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da6deb-4754-414a-8e2e-4c154d88ac93 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:01.374446 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 604/1220] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:38:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:38:01.380456 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96bab8-43d5-415d-9d6d-9bdb04fa2758 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:01.381152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96bab8-43d5-415d-9d6d-9bdb04fa2758 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:01.381152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96bab8-43d5-415d-9d6d-9bdb04fa2758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:01.398681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-ae96bab8-43d5-415d-9d6d-9bdb04fa2758 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:01.399891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ae96bab8-43d5-415d-9d6d-9bdb04fa2758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:01.473903 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 617/1221] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:38:01 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:38:01.497246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da6deb-4754-414a-8e2e-4c154d88ac93 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:01.619199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da6deb-4754-414a-8e2e-4c154d88ac93 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:01.662963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775fb66-c3ae-4172-beaa-955337bdcb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:01.664033 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775fb66-c3ae-4172-beaa-955337bdcb71 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:01.664320 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775fb66-c3ae-4172-beaa-955337bdcb71 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:01.664716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775fb66-c3ae-4172-beaa-955337bdcb71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:01.679660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775fb66-c3ae-4172-beaa-955337bdcb71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-9775fb66-c3ae-4172-beaa-955337bdcb71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:38:01.687604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:01.688660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:01.689566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:01.689566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:01.689566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:01.689566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:01.689566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:38:01.689566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:38:01.689566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:38:01.689566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:38:01.689566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:38:01.689566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:38:01.689566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:38:01.689566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:01.689566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 605/1222] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:38:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:01.696445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96bab8-43d5-415d-9d6d-9bdb04fa2758 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:01.805327 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96bab8-43d5-415d-9d6d-9bdb04fa2758 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:01.836432 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:01.846872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55146f-7e30-4670-bb24-91d97b6c96c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:01.847538 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55146f-7e30-4670-bb24-91d97b6c96c9 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:01.847862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55146f-7e30-4670-bb24-91d97b6c96c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:01.848136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55146f-7e30-4670-bb24-91d97b6c96c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:01.848876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55146f-7e30-4670-bb24-91d97b6c96c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:01.849176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55146f-7e30-4670-bb24-91d97b6c96c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:01.850567 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55146f-7e30-4670-bb24-91d97b6c96c9 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:01.858975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 618/1223] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:38:01 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:01.865562 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775fb66-c3ae-4172-beaa-955337bdcb71 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:01.911135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:01.967599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775fb66-c3ae-4172-beaa-955337bdcb71 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:02.002175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc29d3-6dcd-4b2b-96b0-b31260983337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:02.003001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc29d3-6dcd-4b2b-96b0-b31260983337 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:02.003285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc29d3-6dcd-4b2b-96b0-b31260983337 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:02.003563 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc29d3-6dcd-4b2b-96b0-b31260983337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:02.014861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc29d3-6dcd-4b2b-96b0-b31260983337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:02.016324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc29d3-6dcd-4b2b-96b0-b31260983337 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:02.033709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-f4bc29d3-6dcd-4b2b-96b0-b31260983337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:02.033709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:02.033709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:02.033709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:02.033709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:02.033709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:02.033709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:02.033709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:02.033709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:02.033709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:02.033709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:02.033709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:02.033709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:38:02.033709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:38:02.033709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:02.034804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:02.035737 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:38:02.035737 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:38:02.035737 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:02.035737 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:02.035737 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 606/1224] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:02.041232 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55146f-7e30-4670-bb24-91d97b6c96c9 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:02.145934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55146f-7e30-4670-bb24-91d97b6c96c9 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:02.180831 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73634-1804-4a70-922b-e80c5003f4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:02.181514 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73634-1804-4a70-922b-e80c5003f4ea None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:02.181803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73634-1804-4a70-922b-e80c5003f4ea None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:02.182080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73634-1804-4a70-922b-e80c5003f4ea None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:02.182831 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac73634-1804-4a70-922b-e80c5003f4ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:02.183141 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac73634-1804-4a70-922b-e80c5003f4ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:02.184545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac73634-1804-4a70-922b-e80c5003f4ea None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:02.197643 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 619/1225] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:38:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:02.203586 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc29d3-6dcd-4b2b-96b0-b31260983337 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:02.301145 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:02.308337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc29d3-6dcd-4b2b-96b0-b31260983337 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:02.342594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f78814-fc33-40a5-8f73-fd0c2286e196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:02.343402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f78814-fc33-40a5-8f73-fd0c2286e196 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:02.343688 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f78814-fc33-40a5-8f73-fd0c2286e196 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:02.343965 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f78814-fc33-40a5-8f73-fd0c2286e196 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:02.352182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f78814-fc33-40a5-8f73-fd0c2286e196 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:02.353635 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f78814-fc33-40a5-8f73-fd0c2286e196 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-13f78814-fc33-40a5-8f73-fd0c2286e196 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:38:02.369367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:02.376736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:02.378430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:02.378430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:02.378430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:38:02.378430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:38:02.378430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:38:02.378430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:38:02.378430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:38:02.378430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:38:02.378430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:38:02.378430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:02.378430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 607/1226] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:38:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:02.379242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73634-1804-4a70-922b-e80c5003f4ea None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:02.435191 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:02.494056 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73634-1804-4a70-922b-e80c5003f4ea None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:02.532217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fec479-9115-487e-8658-70441250c18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:02.532894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fec479-9115-487e-8658-70441250c18f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:02.533178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fec479-9115-487e-8658-70441250c18f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:02.533459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fec479-9115-487e-8658-70441250c18f None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:02.534299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fec479-9115-487e-8658-70441250c18f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:02.534642 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fec479-9115-487e-8658-70441250c18f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:02.536088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fec479-9115-487e-8658-70441250c18f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:02.556070 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 620/1227] 10.222.0.112 () {56 vars in 1148 bytes} [Thu May 26 16:38:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:38:02.562239 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f78814-fc33-40a5-8f73-fd0c2286e196 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:02.673338 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f78814-fc33-40a5-8f73-fd0c2286e196 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:02.722987 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aae945-32cc-48a1-88e7-2f76f2c3a6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:02.723741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aae945-32cc-48a1-88e7-2f76f2c3a6b4 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:02.724028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aae945-32cc-48a1-88e7-2f76f2c3a6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:02.725031 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aae945-32cc-48a1-88e7-2f76f2c3a6b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:02.737982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aae945-32cc-48a1-88e7-2f76f2c3a6b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:02.739504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aae945-32cc-48a1-88e7-2f76f2c3a6b4 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:02.757884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-a8aae945-32cc-48a1-88e7-2f76f2c3a6b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:02.757884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:02.757884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:02.757884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:02.757884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:02.757884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:02.757884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:02.757884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:02.757884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:02.757884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:02.757884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:02.757884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:02.757884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:38:02.757884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:38:02.757884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:02.759475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:02.760578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:38:02.760578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:38:02.760578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:02.760578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:02.760578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 608/1228] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:02.765090 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fec479-9115-487e-8658-70441250c18f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:02.872131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fec479-9115-487e-8658-70441250c18f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:02.874564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:02.909680 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a66472-badd-4256-a874-65bc5f8c8292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:02.910434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a66472-badd-4256-a874-65bc5f8c8292 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:02.917379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a66472-badd-4256-a874-65bc5f8c8292 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:02.917379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a66472-badd-4256-a874-65bc5f8c8292 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:02.917379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a66472-badd-4256-a874-65bc5f8c8292 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:02.917379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a66472-badd-4256-a874-65bc5f8c8292 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:02.917379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a66472-badd-4256-a874-65bc5f8c8292 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:02.924648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 621/1229] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:38:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:02.931044 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aae945-32cc-48a1-88e7-2f76f2c3a6b4 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:02.940997 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:03.048214 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aae945-32cc-48a1-88e7-2f76f2c3a6b4 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:03.088582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb67a77-cdd7-41f5-ac33-09869132ef95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:03.089517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb67a77-cdd7-41f5-ac33-09869132ef95 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:03.089805 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb67a77-cdd7-41f5-ac33-09869132ef95 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:03.090086 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb67a77-cdd7-41f5-ac33-09869132ef95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:03.097396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb67a77-cdd7-41f5-ac33-09869132ef95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:03.098908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb67a77-cdd7-41f5-ac33-09869132ef95 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:03.115341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-9fb67a77-cdd7-41f5-ac33-09869132ef95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:38:03.115341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:03.115341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:03.115341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:03.115341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:03.115341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:03.115341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:03.115341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:03.115341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:03.115341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:03.115341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:03.115341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:03.115341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:38:03.115341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:38:03.115341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:03.116659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:03.117744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:38:03.117744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:38:03.117744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:38:03.117744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:38:03.117744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:38:03.117744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:38:03.117744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:38:03.117744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:03.117744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 609/1230] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:38:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:03.123535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a66472-badd-4256-a874-65bc5f8c8292 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:03.234919 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a66472-badd-4256-a874-65bc5f8c8292 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:03.275911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30f04a-0969-4489-b7d4-7b2d8a44e35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:03.277121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30f04a-0969-4489-b7d4-7b2d8a44e35f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:03.277121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30f04a-0969-4489-b7d4-7b2d8a44e35f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:03.277121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30f04a-0969-4489-b7d4-7b2d8a44e35f None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:03.277923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30f04a-0969-4489-b7d4-7b2d8a44e35f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:03.278233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30f04a-0969-4489-b7d4-7b2d8a44e35f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:03.279703 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30f04a-0969-4489-b7d4-7b2d8a44e35f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:03.293324 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 622/1231] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:38:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:03.299683 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb67a77-cdd7-41f5-ac33-09869132ef95 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:03.373231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:03.410582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb67a77-cdd7-41f5-ac33-09869132ef95 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:03.448332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840953f0-2849-4570-882f-ef654e434f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:03.449228 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840953f0-2849-4570-882f-ef654e434f2d None admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:03.449507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840953f0-2849-4570-882f-ef654e434f2d None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:03.449781 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840953f0-2849-4570-882f-ef654e434f2d None admin] PATH_INFO: `/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/b415e7fca03e4602b3d711436d47f46d/roles/64acd9118f3d4931be8ca4bfa4ae907e` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:03.466216 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840953f0-2849-4570-882f-ef654e434f2d None admin] RBAC: Authorizing `identity:create_grant(project_id=9be90db8d7ee4bd0b01444d1eab83ad8, user_id=b415e7fca03e4602b3d711436d47f46d, role_id=64acd9118f3d4931be8ca4bfa4ae907e)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:03.467763 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840953f0-2849-4570-882f-ef654e434f2d None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:03.609930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 610/1232] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:38:03 2022] PUT /identity/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/b415e7fca03e4602b3d711436d47f46d/roles/64acd9118f3d4931be8ca4bfa4ae907e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:38:05.938928 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426a38d-29c8-4a77-87ee-6ec2b6579f89 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:05.939467 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426a38d-29c8-4a77-87ee-6ec2b6579f89 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:05.939467 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426a38d-29c8-4a77-87ee-6ec2b6579f89 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:05.940850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 623/1233] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:38:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:38:05.948282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69868420-81e9-4d25-9ed4-167d760e1085 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:05.948804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69868420-81e9-4d25-9ed4-167d760e1085 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:05.948900 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69868420-81e9-4d25-9ed4-167d760e1085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:05.968287 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-69868420-81e9-4d25-9ed4-167d760e1085 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:05.969484 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-69868420-81e9-4d25-9ed4-167d760e1085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:06.041824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 611/1234] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:38:05 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:38:06.065981 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426a38d-29c8-4a77-87ee-6ec2b6579f89 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:06.092481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:06.171757 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426a38d-29c8-4a77-87ee-6ec2b6579f89 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:06.209450 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8151fe6-c9c0-4eea-ac33-fe5308a78715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:06.210252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8151fe6-c9c0-4eea-ac33-fe5308a78715 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:06.217476 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8151fe6-c9c0-4eea-ac33-fe5308a78715 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:06.217476 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8151fe6-c9c0-4eea-ac33-fe5308a78715 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:06.221382 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8151fe6-c9c0-4eea-ac33-fe5308a78715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-d8151fe6-c9c0-4eea-ac33-fe5308a78715 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:38:06.229961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:06.231178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:06.232217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:06.232217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:06.232217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:06.232217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:06.232217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:38:06.232217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:38:06.232217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:38:06.232217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:38:06.232217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:38:06.232217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:38:06.232217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:38:06.232217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:38:06.232217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 624/1235] 10.222.0.112 () {56 vars in 1107 bytes} [Thu May 26 16:38:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:06.237349 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69868420-81e9-4d25-9ed4-167d760e1085 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:06.290526 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:06.343962 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69868420-81e9-4d25-9ed4-167d760e1085 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:06.378635 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084643a-d3f3-4596-bd7c-919240d4f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:06.379314 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084643a-d3f3-4596-bd7c-919240d4f779 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:06.379599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084643a-d3f3-4596-bd7c-919240d4f779 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:06.379878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084643a-d3f3-4596-bd7c-919240d4f779 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:06.380890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084643a-d3f3-4596-bd7c-919240d4f779 None admin] RBAC: Adding query filter params (name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:06.381203 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084643a-d3f3-4596-bd7c-919240d4f779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:06.382609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084643a-d3f3-4596-bd7c-919240d4f779 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:06.391160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 612/1236] 10.222.0.112 () {56 vars in 1108 bytes} [Thu May 26 16:38:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:06.402524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8151fe6-c9c0-4eea-ac33-fe5308a78715 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:06.509322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:06.528911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8151fe6-c9c0-4eea-ac33-fe5308a78715 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:06.563768 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd1621-cb9b-4c15-8d26-e24fc134f02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:06.564573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd1621-cb9b-4c15-8d26-e24fc134f02b None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:06.564851 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd1621-cb9b-4c15-8d26-e24fc134f02b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:06.565123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd1621-cb9b-4c15-8d26-e24fc134f02b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:06.577026 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd1621-cb9b-4c15-8d26-e24fc134f02b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:06.578509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd1621-cb9b-4c15-8d26-e24fc134f02b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:06.596401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-40cd1621-cb9b-4c15-8d26-e24fc134f02b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:06.596401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:06.596401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:06.596401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:06.596401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:06.596401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:06.596401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:06.596401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:06.596401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:06.596401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:06.596401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:06.596401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:06.596401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:38:06.596401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:38:06.596401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:06.597618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:06.598641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:38:06.598641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:38:06.598641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:06.598641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:38:06.598641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 625/1237] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:06.604296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084643a-d3f3-4596-bd7c-919240d4f779 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:06.705165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084643a-d3f3-4596-bd7c-919240d4f779 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:06.715354 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:06.741693 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2a0d9-bb21-423e-acfa-27ff78fb45f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:06.742525 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2a0d9-bb21-423e-acfa-27ff78fb45f9 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:06.742915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2a0d9-bb21-423e-acfa-27ff78fb45f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:06.743288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2a0d9-bb21-423e-acfa-27ff78fb45f9 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:06.744123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2a0d9-bb21-423e-acfa-27ff78fb45f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:06.744526 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2a0d9-bb21-423e-acfa-27ff78fb45f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:06.746119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2a0d9-bb21-423e-acfa-27ff78fb45f9 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:06.759036 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 613/1238] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:38:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:06.774291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd1621-cb9b-4c15-8d26-e24fc134f02b None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:06.871112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd1621-cb9b-4c15-8d26-e24fc134f02b None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:06.905110 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fca6f5-8eca-4929-bff3-d1187b88453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:06.905935 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fca6f5-8eca-4929-bff3-d1187b88453b None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:06.906201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fca6f5-8eca-4929-bff3-d1187b88453b None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:06.906518 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fca6f5-8eca-4929-bff3-d1187b88453b None admin] PATH_INFO: `/v3/users/placement` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:06.909196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:06.915344 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fca6f5-8eca-4929-bff3-d1187b88453b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:06.916802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fca6f5-8eca-4929-bff3-d1187b88453b None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-41fca6f5-8eca-4929-bff3-d1187b88453b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:38:06.931848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:06.932979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:06.933973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:06.933973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:06.933973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:38:06.933973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:38:06.933973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:38:06.933973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:38:06.933973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:38:06.933973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:38:06.933973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:38:06.933973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:38:06.933973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 626/1239] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:38:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:06.939067 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2a0d9-bb21-423e-acfa-27ff78fb45f9 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:07.043321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2a0d9-bb21-423e-acfa-27ff78fb45f9 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:07.077000 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431bd64-3478-494d-a64d-594a8e8e8b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:07.078057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431bd64-3478-494d-a64d-594a8e8e8b2a None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:07.078057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431bd64-3478-494d-a64d-594a8e8e8b2a None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:07.078247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431bd64-3478-494d-a64d-594a8e8e8b2a None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:07.079078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431bd64-3478-494d-a64d-594a8e8e8b2a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:07.079390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431bd64-3478-494d-a64d-594a8e8e8b2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:07.080825 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431bd64-3478-494d-a64d-594a8e8e8b2a None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:07.101877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 614/1240] 10.222.0.112 () {56 vars in 1148 bytes} [Thu May 26 16:38:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:07.107710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fca6f5-8eca-4929-bff3-d1187b88453b None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:07.235301 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fca6f5-8eca-4929-bff3-d1187b88453b None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:07.275618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0f3d9-adf4-4300-86dc-712fa8b933ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:07.276436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0f3d9-adf4-4300-86dc-712fa8b933ee None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:07.276722 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0f3d9-adf4-4300-86dc-712fa8b933ee None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:07.277002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0f3d9-adf4-4300-86dc-712fa8b933ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:07.340353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:07.348862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0f3d9-adf4-4300-86dc-712fa8b933ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:07.350345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0f3d9-adf4-4300-86dc-712fa8b933ee None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:07.452806 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 627/1241] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:38:07 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:38:07.459174 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431bd64-3478-494d-a64d-594a8e8e8b2a None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:07.486717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:07.566292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431bd64-3478-494d-a64d-594a8e8e8b2a None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:07.606430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6781b-e97a-4425-a698-2f92743f2a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:07.607230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6781b-e97a-4425-a698-2f92743f2a6c None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:07.607512 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6781b-e97a-4425-a698-2f92743f2a6c None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:07.607789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6781b-e97a-4425-a698-2f92743f2a6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:07.619101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6781b-e97a-4425-a698-2f92743f2a6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:07.620611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6781b-e97a-4425-a698-2f92743f2a6c None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:07.639694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-59e6781b-e97a-4425-a698-2f92743f2a6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:07.639694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:07.639694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:07.639694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:07.639694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:07.639694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:07.639694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:07.639694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:07.639694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:07.639694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:07.639694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:07.639694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:07.639694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:38:07.639694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:38:07.639694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:07.640877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:07.642026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:38:07.642026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:38:07.642026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:07.642026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:07.642026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 615/1242] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:07.647542 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0f3d9-adf4-4300-86dc-712fa8b933ee None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:07.750848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:07.758422 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0f3d9-adf4-4300-86dc-712fa8b933ee None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:07.793462 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc2538-cbab-4e8d-b893-4fbc4d1b4a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:07.794127 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc2538-cbab-4e8d-b893-4fbc4d1b4a7f None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:07.794464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc2538-cbab-4e8d-b893-4fbc4d1b4a7f None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:07.794746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc2538-cbab-4e8d-b893-4fbc4d1b4a7f None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:07.795563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc2538-cbab-4e8d-b893-4fbc4d1b4a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:07.795871 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc2538-cbab-4e8d-b893-4fbc4d1b4a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:07.797246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc2538-cbab-4e8d-b893-4fbc4d1b4a7f None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:07.809342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 628/1243] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:38:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:07.815367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6781b-e97a-4425-a698-2f92743f2a6c None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:07.900366 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:07.923178 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6781b-e97a-4425-a698-2f92743f2a6c None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:07.957502 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ed8af-0e05-4c7a-8e6e-734ded9541c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:07.958976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ed8af-0e05-4c7a-8e6e-734ded9541c9 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:07.959306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ed8af-0e05-4c7a-8e6e-734ded9541c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:07.959613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ed8af-0e05-4c7a-8e6e-734ded9541c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:07.966184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ed8af-0e05-4c7a-8e6e-734ded9541c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:07.967660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ed8af-0e05-4c7a-8e6e-734ded9541c9 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:07.981423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-a73ed8af-0e05-4c7a-8e6e-734ded9541c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:38:07.981423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:07.981423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:07.981423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:07.981423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:07.981423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:07.981423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:07.981423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:07.981423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:07.981423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:07.981423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:07.981423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:07.981423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:38:07.981423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:38:07.981423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:07.982558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:07.983475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:38:07.983475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:38:07.983475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:38:07.983475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:38:07.983475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:38:07.983475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:38:07.983475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:38:07.983475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:07.983475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 616/1244] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:38:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:07.988696 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc2538-cbab-4e8d-b893-4fbc4d1b4a7f None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:08.090866 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc2538-cbab-4e8d-b893-4fbc4d1b4a7f None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:08.129726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478c056-5ea3-420b-b1f5-fbd42373a7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:08.131171 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478c056-5ea3-420b-b1f5-fbd42373a7f9 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:08.131619 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478c056-5ea3-420b-b1f5-fbd42373a7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:08.131977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478c056-5ea3-420b-b1f5-fbd42373a7f9 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:08.132766 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478c056-5ea3-420b-b1f5-fbd42373a7f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:08.133079 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478c056-5ea3-420b-b1f5-fbd42373a7f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:08.134531 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478c056-5ea3-420b-b1f5-fbd42373a7f9 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:08.147440 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 629/1245] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:38:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:08.153777 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ed8af-0e05-4c7a-8e6e-734ded9541c9 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:08.259987 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ed8af-0e05-4c7a-8e6e-734ded9541c9 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:08.301466 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1aa3ca-5447-4627-9180-ae7c2e019469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:08.302156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1aa3ca-5447-4627-9180-ae7c2e019469 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:08.302575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1aa3ca-5447-4627-9180-ae7c2e019469 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:08.302728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1aa3ca-5447-4627-9180-ae7c2e019469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:08.303647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1aa3ca-5447-4627-9180-ae7c2e019469 None admin] RBAC: Adding query filter params (role.id=64acd9118f3d4931be8ca4bfa4ae907e, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=b415e7fca03e4602b3d711436d47f46d) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:08.303962 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1aa3ca-5447-4627-9180-ae7c2e019469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:08.305483 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1aa3ca-5447-4627-9180-ae7c2e019469 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:08.311419 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 617/1246] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:38:08 2022] GET /identity/v3/role_assignments?user.id=b415e7fca03e4602b3d711436d47f46d&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=64acd9118f3d4931be8ca4bfa4ae907e => generated 610 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:38:10.609381 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec420c7-e289-4c90-a252-0e439b25d3f6 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:10.609881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec420c7-e289-4c90-a252-0e439b25d3f6 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:10.610017 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec420c7-e289-4c90-a252-0e439b25d3f6 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:10.611370 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 630/1247] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:38:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:38:10.617462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512d9d2-1c9d-4b30-9390-8d0877d58134 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:10.617886 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512d9d2-1c9d-4b30-9390-8d0877d58134 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:10.618033 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512d9d2-1c9d-4b30-9390-8d0877d58134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:10.623223 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:10.636427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-a512d9d2-1c9d-4b30-9390-8d0877d58134 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:10.637626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a512d9d2-1c9d-4b30-9390-8d0877d58134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:10.710991 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 618/1248] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:38:10 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:38:10.734876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec420c7-e289-4c90-a252-0e439b25d3f6 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:10.753055 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:10.839338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec420c7-e289-4c90-a252-0e439b25d3f6 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:10.873529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9f196-5e97-460c-859e-5d5ca411fe9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:10.874239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9f196-5e97-460c-859e-5d5ca411fe9e None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:10.874548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9f196-5e97-460c-859e-5d5ca411fe9e None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:10.874821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9f196-5e97-460c-859e-5d5ca411fe9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:10.885536 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9f196-5e97-460c-859e-5d5ca411fe9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-69f9f196-5e97-460c-859e-5d5ca411fe9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:38:10.893182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:10.894293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:10.895411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:10.895411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:10.895411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:10.895411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:10.895411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:38:10.895411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:38:10.895411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:38:10.895411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:38:10.895411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:38:10.895411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:38:10.895411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:38:10.895411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:38:10.895411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 631/1249] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:38:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:10.901675 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512d9d2-1c9d-4b30-9390-8d0877d58134 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:11.001564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512d9d2-1c9d-4b30-9390-8d0877d58134 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:11.033750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:11.041738 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd0efe-4cb9-48c5-b423-df76d80ae4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:11.042462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd0efe-4cb9-48c5-b423-df76d80ae4ef None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:11.042749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd0efe-4cb9-48c5-b423-df76d80ae4ef None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:11.043029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd0efe-4cb9-48c5-b423-df76d80ae4ef None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:11.043784 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd0efe-4cb9-48c5-b423-df76d80ae4ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:11.044096 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd0efe-4cb9-48c5-b423-df76d80ae4ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:11.045478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd0efe-4cb9-48c5-b423-df76d80ae4ef None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:11.055121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 619/1250] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:38:10 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:11.061017 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9f196-5e97-460c-859e-5d5ca411fe9e None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:11.144683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:11.170656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9f196-5e97-460c-859e-5d5ca411fe9e None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:11.204861 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc936667-2b97-470e-838f-26327a18e9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:11.205657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc936667-2b97-470e-838f-26327a18e9b1 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:11.205944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc936667-2b97-470e-838f-26327a18e9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:11.206222 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc936667-2b97-470e-838f-26327a18e9b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:11.217701 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc936667-2b97-470e-838f-26327a18e9b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:11.219240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc936667-2b97-470e-838f-26327a18e9b1 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:11.237572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-cc936667-2b97-470e-838f-26327a18e9b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:11.237572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:11.237572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:11.237572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:11.237572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:11.237572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:11.237572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:11.237572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:11.237572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:11.237572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:11.237572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:11.237572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:11.237572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:38:11.237572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:38:11.237572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:11.238894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:11.240314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:38:11.240314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:38:11.240314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:11.240314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:38:11.240314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 632/1251] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:11.245384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd0efe-4cb9-48c5-b423-df76d80ae4ef None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:11.353118 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd0efe-4cb9-48c5-b423-df76d80ae4ef None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:11.388316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d03b0-48d4-4f96-a8b0-0fc383ce8d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:11.388980 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d03b0-48d4-4f96-a8b0-0fc383ce8d55 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:11.389265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d03b0-48d4-4f96-a8b0-0fc383ce8d55 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:11.389541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d03b0-48d4-4f96-a8b0-0fc383ce8d55 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:11.390259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d03b0-48d4-4f96-a8b0-0fc383ce8d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:11.390622 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d03b0-48d4-4f96-a8b0-0fc383ce8d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:11.391994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d03b0-48d4-4f96-a8b0-0fc383ce8d55 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:11.403724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 620/1252] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:38:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:38:11.409433 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc936667-2b97-470e-838f-26327a18e9b1 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:11.515514 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc936667-2b97-470e-838f-26327a18e9b1 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:11.543075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:11.550973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0cc56-9991-49af-9be2-e4c742e1b75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:11.551714 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0cc56-9991-49af-9be2-e4c742e1b75a None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:11.553156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0cc56-9991-49af-9be2-e4c742e1b75a None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:11.553440 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0cc56-9991-49af-9be2-e4c742e1b75a None admin] PATH_INFO: `/v3/users/placement` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:11.562428 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0cc56-9991-49af-9be2-e4c742e1b75a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:11.569546 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0cc56-9991-49af-9be2-e4c742e1b75a None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-eeb0cc56-9991-49af-9be2-e4c742e1b75a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:38:11.579137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:11.580334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:11.581731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:11.581731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:11.581731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:38:11.581731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:38:11.581731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:38:11.581731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:38:11.581731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:38:11.581731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:38:11.581731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:38:11.581731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:38:11.581731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 633/1253] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:38:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:11.586749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d03b0-48d4-4f96-a8b0-0fc383ce8d55 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:11.644660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:11.694632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d03b0-48d4-4f96-a8b0-0fc383ce8d55 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:11.729874 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f414507-9f29-4a15-9b2b-aa3aefd4bf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:11.730579 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f414507-9f29-4a15-9b2b-aa3aefd4bf81 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:11.735489 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f414507-9f29-4a15-9b2b-aa3aefd4bf81 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:11.735489 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f414507-9f29-4a15-9b2b-aa3aefd4bf81 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:11.735489 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f414507-9f29-4a15-9b2b-aa3aefd4bf81 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:11.735489 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f414507-9f29-4a15-9b2b-aa3aefd4bf81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:11.735489 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f414507-9f29-4a15-9b2b-aa3aefd4bf81 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:11.752207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 621/1254] 10.222.0.112 () {56 vars in 1148 bytes} [Thu May 26 16:38:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:11.758993 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0cc56-9991-49af-9be2-e4c742e1b75a None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:11.861480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0cc56-9991-49af-9be2-e4c742e1b75a None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:11.894500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6757ea2-0673-486f-be82-010c222fe3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:11.895140 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6757ea2-0673-486f-be82-010c222fe3d9 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:11.895423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6757ea2-0673-486f-be82-010c222fe3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:11.896257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6757ea2-0673-486f-be82-010c222fe3d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:11.952775 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:11.967265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6757ea2-0673-486f-be82-010c222fe3d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:11.968853 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6757ea2-0673-486f-be82-010c222fe3d9 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:12.072316 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 634/1255] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:38:11 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:38:12.078207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f414507-9f29-4a15-9b2b-aa3aefd4bf81 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:12.181419 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f414507-9f29-4a15-9b2b-aa3aefd4bf81 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:12.196217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:12.218262 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433376-f6ab-4d04-8c42-c452bbcc6929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:12.219026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433376-f6ab-4d04-8c42-c452bbcc6929 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:12.219311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433376-f6ab-4d04-8c42-c452bbcc6929 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:12.219592 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433376-f6ab-4d04-8c42-c452bbcc6929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:12.230188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59433376-f6ab-4d04-8c42-c452bbcc6929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:12.231671 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59433376-f6ab-4d04-8c42-c452bbcc6929 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:12.249644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-59433376-f6ab-4d04-8c42-c452bbcc6929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:12.249644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:12.249644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:12.249644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:12.249644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:12.249644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:12.249644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:12.249644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:12.249644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:12.249644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:12.249644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:12.249644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:12.249644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:38:12.249644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:38:12.249644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:12.250887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:12.252058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:38:12.252058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:38:12.252058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:12.252058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:12.252058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 622/1256] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:12.257229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6757ea2-0673-486f-be82-010c222fe3d9 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:12.346068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:12.358728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6757ea2-0673-486f-be82-010c222fe3d9 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:12.393339 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758d970-33e7-4917-b1b5-4518dc21d2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:12.394001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758d970-33e7-4917-b1b5-4518dc21d2b2 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:12.394284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758d970-33e7-4917-b1b5-4518dc21d2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:12.394627 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758d970-33e7-4917-b1b5-4518dc21d2b2 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:12.395380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758d970-33e7-4917-b1b5-4518dc21d2b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:12.396311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758d970-33e7-4917-b1b5-4518dc21d2b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:12.397678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758d970-33e7-4917-b1b5-4518dc21d2b2 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:12.409149 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 635/1257] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:38:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:12.416518 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433376-f6ab-4d04-8c42-c452bbcc6929 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:12.524261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433376-f6ab-4d04-8c42-c452bbcc6929 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:12.558339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5db55-f345-48e1-a881-4a283524d049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:12.559387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5db55-f345-48e1-a881-4a283524d049 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:12.559616 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5db55-f345-48e1-a881-4a283524d049 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:12.559838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5db55-f345-48e1-a881-4a283524d049 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:12.570059 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5db55-f345-48e1-a881-4a283524d049 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:12.571591 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5db55-f345-48e1-a881-4a283524d049 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:12.588398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-ece5db55-f345-48e1-a881-4a283524d049 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:38:12.588398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:12.588398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:12.588398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:12.588398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:12.588398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:12.588398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:12.588398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:12.588398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:12.588398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:12.588398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:12.588398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:12.588398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:38:12.588398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:38:12.588398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:12.589504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:12.590748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:38:12.590748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:38:12.590748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:38:12.590748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:38:12.590748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:38:12.590748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:38:12.590748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:38:12.590748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:12.590748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 623/1258] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:38:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:12.595670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758d970-33e7-4917-b1b5-4518dc21d2b2 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:12.699729 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758d970-33e7-4917-b1b5-4518dc21d2b2 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:12.733591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb538934-2fdf-4942-b957-c2ca21c8efa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:12.734266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb538934-2fdf-4942-b957-c2ca21c8efa4 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:12.734581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb538934-2fdf-4942-b957-c2ca21c8efa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:12.734863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb538934-2fdf-4942-b957-c2ca21c8efa4 None admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:12.735659 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb538934-2fdf-4942-b957-c2ca21c8efa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:12.735991 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb538934-2fdf-4942-b957-c2ca21c8efa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:12.737608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb538934-2fdf-4942-b957-c2ca21c8efa4 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:12.751352 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 636/1259] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:38:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:12.758491 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5db55-f345-48e1-a881-4a283524d049 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:12.786951 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:12.873539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5db55-f345-48e1-a881-4a283524d049 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:12.911675 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713843e-e050-4779-881f-9ebb0a3b2ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:12.912339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713843e-e050-4779-881f-9ebb0a3b2ae8 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:12.912628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713843e-e050-4779-881f-9ebb0a3b2ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:12.912906 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713843e-e050-4779-881f-9ebb0a3b2ae8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:12.917800 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713843e-e050-4779-881f-9ebb0a3b2ae8 None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=b415e7fca03e4602b3d711436d47f46d) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:12.917800 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713843e-e050-4779-881f-9ebb0a3b2ae8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:12.917800 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713843e-e050-4779-881f-9ebb0a3b2ae8 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:12.921691 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 624/1260] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:38:12 2022] GET /identity/v3/role_assignments?user.id=b415e7fca03e4602b3d711436d47f46d&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:15.187088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e4111-b967-4a60-8118-2fba38d2de18 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:15.187621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e4111-b967-4a60-8118-2fba38d2de18 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:15.187621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e4111-b967-4a60-8118-2fba38d2de18 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:15.189019 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 637/1261] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:38:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:38:15.195168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d8f12-f680-4316-b9d2-d543d631e5a6 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:15.195607 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d8f12-f680-4316-b9d2-d543d631e5a6 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:15.195729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d8f12-f680-4316-b9d2-d543d631e5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:15.213252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-2a9d8f12-f680-4316-b9d2-d543d631e5a6 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:15.214557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2a9d8f12-f680-4316-b9d2-d543d631e5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:15.290299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 625/1262] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:38:15 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:38:15.316348 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e4111-b967-4a60-8118-2fba38d2de18 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:15.329807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:15.428468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e4111-b967-4a60-8118-2fba38d2de18 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:15.467749 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287e874-7f07-4edb-91e4-72f36ddd7e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:15.468463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287e874-7f07-4edb-91e4-72f36ddd7e0c None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:15.468792 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287e874-7f07-4edb-91e4-72f36ddd7e0c None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:15.469080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287e874-7f07-4edb-91e4-72f36ddd7e0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:15.479678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287e874-7f07-4edb-91e4-72f36ddd7e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-e287e874-7f07-4edb-91e4-72f36ddd7e0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:38:15.487284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:15.488229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:15.489089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:15.489089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:15.489089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:15.489089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:15.489089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:38:15.489089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:38:15.489089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:38:15.489089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:38:15.489089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:38:15.489089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:38:15.489089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:38:15.489089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:38:15.489089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 638/1263] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:38:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:15.494844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d8f12-f680-4316-b9d2-d543d631e5a6 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:15.514750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:15.602027 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d8f12-f680-4316-b9d2-d543d631e5a6 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:15.649249 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4bc6c-296b-4041-93bb-1bf7a77e9977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:15.649934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4bc6c-296b-4041-93bb-1bf7a77e9977 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:15.650221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4bc6c-296b-4041-93bb-1bf7a77e9977 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:15.650606 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4bc6c-296b-4041-93bb-1bf7a77e9977 None admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:15.651395 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4bc6c-296b-4041-93bb-1bf7a77e9977 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:15.651704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4bc6c-296b-4041-93bb-1bf7a77e9977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:15.653092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4bc6c-296b-4041-93bb-1bf7a77e9977 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:15.667306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 626/1264] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:38:15 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:38:15.673258 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287e874-7f07-4edb-91e4-72f36ddd7e0c None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:15.749106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:15.785346 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287e874-7f07-4edb-91e4-72f36ddd7e0c None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:15.822832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f018e-b82d-4c3f-840e-12a8c47604c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:15.823618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f018e-b82d-4c3f-840e-12a8c47604c4 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:15.823898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f018e-b82d-4c3f-840e-12a8c47604c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:15.824166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f018e-b82d-4c3f-840e-12a8c47604c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:15.835040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f018e-b82d-4c3f-840e-12a8c47604c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:15.836489 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f018e-b82d-4c3f-840e-12a8c47604c4 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:15.853245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-d86f018e-b82d-4c3f-840e-12a8c47604c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:15.853245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:15.853245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:15.853245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:15.853245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:15.853245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:15.853245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:15.853245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:15.853245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:15.853245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:15.853245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:15.853245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:15.853245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:38:15.853245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:38:15.853245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:15.854194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:15.855145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:38:15.855145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:38:15.855145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:15.855145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:38:15.855145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 639/1265] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:15.861148 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4bc6c-296b-4041-93bb-1bf7a77e9977 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:15.958089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:15.979070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4bc6c-296b-4041-93bb-1bf7a77e9977 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:16.018447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc336504-0677-4c23-b3cb-6e1b2346f3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:16.019046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc336504-0677-4c23-b3cb-6e1b2346f3a9 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:16.019421 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc336504-0677-4c23-b3cb-6e1b2346f3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:16.019699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc336504-0677-4c23-b3cb-6e1b2346f3a9 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:16.020465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc336504-0677-4c23-b3cb-6e1b2346f3a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:16.020800 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc336504-0677-4c23-b3cb-6e1b2346f3a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:16.022389 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc336504-0677-4c23-b3cb-6e1b2346f3a9 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:16.034782 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 627/1266] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:38:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:16.041167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f018e-b82d-4c3f-840e-12a8c47604c4 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:16.146906 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f018e-b82d-4c3f-840e-12a8c47604c4 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:16.167683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:16.182156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e0302-711f-46b2-9224-2d3afc92c6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:16.183068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e0302-711f-46b2-9224-2d3afc92c6b1 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:16.183387 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e0302-711f-46b2-9224-2d3afc92c6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:16.183714 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e0302-711f-46b2-9224-2d3afc92c6b1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:16.191340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e0302-711f-46b2-9224-2d3afc92c6b1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:16.192805 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e0302-711f-46b2-9224-2d3afc92c6b1 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-409e0302-711f-46b2-9224-2d3afc92c6b1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:38:16.208123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:16.209724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:16.210786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:16.210786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:16.210786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:38:16.210786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:38:16.210786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:38:16.210786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:38:16.210786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:38:16.210786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:38:16.210786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:38:16.210786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:38:16.210786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 640/1267] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:38:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:16.222793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc336504-0677-4c23-b3cb-6e1b2346f3a9 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:16.347181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc336504-0677-4c23-b3cb-6e1b2346f3a9 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:16.385375 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28cf31-b0e6-4e42-b18d-b4a854aee728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:16.386047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28cf31-b0e6-4e42-b18d-b4a854aee728 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:16.386340 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28cf31-b0e6-4e42-b18d-b4a854aee728 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:16.386635 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28cf31-b0e6-4e42-b18d-b4a854aee728 None admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:16.387472 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28cf31-b0e6-4e42-b18d-b4a854aee728 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:16.387782 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28cf31-b0e6-4e42-b18d-b4a854aee728 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:16.389209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28cf31-b0e6-4e42-b18d-b4a854aee728 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:16.400009 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:16.409268 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 628/1268] 10.222.0.112 () {56 vars in 1148 bytes} [Thu May 26 16:38:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:16.421453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e0302-711f-46b2-9224-2d3afc92c6b1 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:16.545062 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e0302-711f-46b2-9224-2d3afc92c6b1 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:16.582866 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7f61f-3004-40e5-81e0-554979cbadf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:16.584190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7f61f-3004-40e5-81e0-554979cbadf6 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:16.584453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7f61f-3004-40e5-81e0-554979cbadf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:16.584724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7f61f-3004-40e5-81e0-554979cbadf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:16.595872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7f61f-3004-40e5-81e0-554979cbadf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:16.598351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7f61f-3004-40e5-81e0-554979cbadf6 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:16.615591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-c3e7f61f-3004-40e5-81e0-554979cbadf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:16.615591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:16.615591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:16.615591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:16.615591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:16.615591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:16.615591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:16.615591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:16.615591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:16.615591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:16.615591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:16.615591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:16.615591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:38:16.615591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:38:16.615591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:16.616790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:16.618499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:38:16.618499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:38:16.618499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:16.618499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:38:16.618499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 641/1269] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:16.626213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28cf31-b0e6-4e42-b18d-b4a854aee728 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:16.740361 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28cf31-b0e6-4e42-b18d-b4a854aee728 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:16.786803 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac6e55-fe29-48aa-a207-9eb0cd041553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:16.787609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac6e55-fe29-48aa-a207-9eb0cd041553 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:16.787901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac6e55-fe29-48aa-a207-9eb0cd041553 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:16.788184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac6e55-fe29-48aa-a207-9eb0cd041553 None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:16.788920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac6e55-fe29-48aa-a207-9eb0cd041553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:16.789233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac6e55-fe29-48aa-a207-9eb0cd041553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:16.790825 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac6e55-fe29-48aa-a207-9eb0cd041553 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:16.803579 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 629/1270] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:38:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:16.809525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7f61f-3004-40e5-81e0-554979cbadf6 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:16.847779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:16.924622 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7f61f-3004-40e5-81e0-554979cbadf6 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:16.962368 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb8f7c-fec1-4348-bb0b-cbb97c4dafda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:16.963154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb8f7c-fec1-4348-bb0b-cbb97c4dafda None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:16.963439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb8f7c-fec1-4348-bb0b-cbb97c4dafda None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:16.963708 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb8f7c-fec1-4348-bb0b-cbb97c4dafda None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:16.970879 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb8f7c-fec1-4348-bb0b-cbb97c4dafda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:16.972334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb8f7c-fec1-4348-bb0b-cbb97c4dafda None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:16.988596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-efdb8f7c-fec1-4348-bb0b-cbb97c4dafda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:38:16.988596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:16.988596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:16.988596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:16.988596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:16.988596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:16.988596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:16.988596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:16.988596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:16.988596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:16.988596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:16.988596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:16.988596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:38:16.988596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:38:16.988596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:16.990389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:16.995809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:38:16.995809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:38:16.995809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:38:16.995809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:38:16.995809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:38:16.995809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:38:16.995809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:38:16.995809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:38:16.995809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 642/1271] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:38:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:16.996556 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac6e55-fe29-48aa-a207-9eb0cd041553 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:17.059667 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:17.110232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac6e55-fe29-48aa-a207-9eb0cd041553 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:17.145206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e848d-66e9-4d5c-bf71-e90475459704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:17.146498 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e848d-66e9-4d5c-bf71-e90475459704 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:17.146792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e848d-66e9-4d5c-bf71-e90475459704 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:17.147067 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e848d-66e9-4d5c-bf71-e90475459704 None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:17.147856 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e848d-66e9-4d5c-bf71-e90475459704 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:17.148167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e848d-66e9-4d5c-bf71-e90475459704 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:17.149615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e848d-66e9-4d5c-bf71-e90475459704 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:17.164289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 630/1272] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:38:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:17.173452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb8f7c-fec1-4348-bb0b-cbb97c4dafda None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:17.271179 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:17.283760 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb8f7c-fec1-4348-bb0b-cbb97c4dafda None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:17.326677 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a903527-0c24-4323-ac13-6d38705696fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:17.327569 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a903527-0c24-4323-ac13-6d38705696fb None admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:17.327973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a903527-0c24-4323-ac13-6d38705696fb None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:17.328133 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a903527-0c24-4323-ac13-6d38705696fb None admin] PATH_INFO: `/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/b415e7fca03e4602b3d711436d47f46d/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:17.330106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a903527-0c24-4323-ac13-6d38705696fb None admin] RBAC: Authorizing `identity:create_grant(project_id=9be90db8d7ee4bd0b01444d1eab83ad8, user_id=b415e7fca03e4602b3d711436d47f46d, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:17.331598 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a903527-0c24-4323-ac13-6d38705696fb None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:17.525693 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 643/1273] 10.222.0.112 () {58 vars in 1444 bytes} [Thu May 26 16:38:17 2022] PUT /identity/v3/projects/9be90db8d7ee4bd0b01444d1eab83ad8/users/b415e7fca03e4602b3d711436d47f46d/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:38:19.797568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cc78b-e727-4d6c-86c9-f56fc9f7d81c None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:19.798150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cc78b-e727-4d6c-86c9-f56fc9f7d81c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:19.798150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cc78b-e727-4d6c-86c9-f56fc9f7d81c None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:19.799783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 631/1274] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:38:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:38:19.805340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09840739-370e-427f-a377-1e44d6a47ed1 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:19.805754 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09840739-370e-427f-a377-1e44d6a47ed1 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:19.805992 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09840739-370e-427f-a377-1e44d6a47ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:19.824605 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-09840739-370e-427f-a377-1e44d6a47ed1 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:19.825819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-09840739-370e-427f-a377-1e44d6a47ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:19.900327 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 644/1275] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:38:19 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:38:19.925961 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cc78b-e727-4d6c-86c9-f56fc9f7d81c None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:20.033923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cc78b-e727-4d6c-86c9-f56fc9f7d81c None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:20.054154 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:20.070593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22ab05-bcc4-4b7d-b6f5-5a1e01832968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:20.071412 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22ab05-bcc4-4b7d-b6f5-5a1e01832968 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:20.071729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22ab05-bcc4-4b7d-b6f5-5a1e01832968 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:20.072012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22ab05-bcc4-4b7d-b6f5-5a1e01832968 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:20.082424 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22ab05-bcc4-4b7d-b6f5-5a1e01832968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-de22ab05-bcc4-4b7d-b6f5-5a1e01832968 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:38:20.090801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:20.091863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:20.094012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:20.094012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:20.094012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:20.094012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:20.094012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:38:20.094012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:38:20.094012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:38:20.094012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:38:20.094012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:38:20.094012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:38:20.094012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:38:20.094012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:20.094012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 632/1276] 10.222.0.112 () {56 vars in 1101 bytes} [Thu May 26 16:38:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:20.098123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09840739-370e-427f-a377-1e44d6a47ed1 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:20.181149 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:20.201302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09840739-370e-427f-a377-1e44d6a47ed1 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:20.235516 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9e70f-070a-45f8-ac18-7d67998aee15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:20.236254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9e70f-070a-45f8-ac18-7d67998aee15 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:20.236646 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9e70f-070a-45f8-ac18-7d67998aee15 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:20.236936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9e70f-070a-45f8-ac18-7d67998aee15 None admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:20.237760 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9e70f-070a-45f8-ac18-7d67998aee15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:20.238108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9e70f-070a-45f8-ac18-7d67998aee15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:20.240141 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9e70f-070a-45f8-ac18-7d67998aee15 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:20.248358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 645/1277] 10.222.0.112 () {56 vars in 1104 bytes} [Thu May 26 16:38:20 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:38:20.256443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22ab05-bcc4-4b7d-b6f5-5a1e01832968 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:20.386978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22ab05-bcc4-4b7d-b6f5-5a1e01832968 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:20.421982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4111d-eb0e-425c-b70a-967bd77573b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:20.425937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4111d-eb0e-425c-b70a-967bd77573b3 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:20.425937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4111d-eb0e-425c-b70a-967bd77573b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:20.425937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4111d-eb0e-425c-b70a-967bd77573b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:20.434735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4111d-eb0e-425c-b70a-967bd77573b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:20.436240 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4111d-eb0e-425c-b70a-967bd77573b3 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:20.454302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-9ed4111d-eb0e-425c-b70a-967bd77573b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:20.454302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:20.454302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:20.454302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:20.454302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:20.454302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:20.454302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:20.454302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:20.454302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:20.454302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:20.454302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:20.454302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:20.454302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:38:20.454302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:38:20.454302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:20.455552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:20.456638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:38:20.456638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:38:20.456638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:20.456638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:20.456638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 633/1278] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:38:20.462620 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9e70f-070a-45f8-ac18-7d67998aee15 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:20.568325 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9e70f-070a-45f8-ac18-7d67998aee15 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:20.606894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb23ff-8476-40a1-b3ce-3a79f3f8dfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:20.606894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb23ff-8476-40a1-b3ce-3a79f3f8dfb5 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:20.606894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb23ff-8476-40a1-b3ce-3a79f3f8dfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:20.606894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb23ff-8476-40a1-b3ce-3a79f3f8dfb5 None admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:20.608070 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb23ff-8476-40a1-b3ce-3a79f3f8dfb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:20.608070 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb23ff-8476-40a1-b3ce-3a79f3f8dfb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:20.609393 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb23ff-8476-40a1-b3ce-3a79f3f8dfb5 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:20.622577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 646/1279] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:38:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:20.630961 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4111d-eb0e-425c-b70a-967bd77573b3 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:20.663782 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:20.740879 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4111d-eb0e-425c-b70a-967bd77573b3 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:20.779773 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be2eb6-280f-49e7-8195-103ad734c0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:20.780652 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be2eb6-280f-49e7-8195-103ad734c0a0 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:20.780962 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be2eb6-280f-49e7-8195-103ad734c0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:20.781280 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be2eb6-280f-49e7-8195-103ad734c0a0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:20.790816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be2eb6-280f-49e7-8195-103ad734c0a0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:20.792279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be2eb6-280f-49e7-8195-103ad734c0a0 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-56be2eb6-280f-49e7-8195-103ad734c0a0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:38:20.808235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:20.809749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:20.810750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:20.810750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:20.810750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:38:20.810750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:38:20.810750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:38:20.810750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:38:20.810750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:38:20.810750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:38:20.810750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:38:20.810750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:20.810750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 634/1280] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:38:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:20.815673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb23ff-8476-40a1-b3ce-3a79f3f8dfb5 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:20.819757 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:20.916875 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb23ff-8476-40a1-b3ce-3a79f3f8dfb5 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:20.959808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af7180-6853-4859-85e1-d9b5f9d3f136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:20.960749 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af7180-6853-4859-85e1-d9b5f9d3f136 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:20.961105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af7180-6853-4859-85e1-d9b5f9d3f136 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:20.961538 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af7180-6853-4859-85e1-d9b5f9d3f136 None admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:20.962839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af7180-6853-4859-85e1-d9b5f9d3f136 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:20.963274 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af7180-6853-4859-85e1-d9b5f9d3f136 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:20.965322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af7180-6853-4859-85e1-d9b5f9d3f136 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:20.988787 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 647/1281] 10.222.0.112 () {56 vars in 1148 bytes} [Thu May 26 16:38:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:38:20.996125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be2eb6-280f-49e7-8195-103ad734c0a0 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:21.108666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:21.119287 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be2eb6-280f-49e7-8195-103ad734c0a0 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:21.153035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46685493-deb1-41be-85bb-0e8392612ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:21.153691 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46685493-deb1-41be-85bb-0e8392612ae0 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:21.153972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46685493-deb1-41be-85bb-0e8392612ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:21.154247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46685493-deb1-41be-85bb-0e8392612ae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:21.229895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46685493-deb1-41be-85bb-0e8392612ae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:21.231411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46685493-deb1-41be-85bb-0e8392612ae0 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:21.323603 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:21.334391 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 635/1282] 10.222.0.112 () {58 vars in 1287 bytes} [Thu May 26 16:38:20 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:38:21.341737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af7180-6853-4859-85e1-d9b5f9d3f136 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:21.411632 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:21.459739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af7180-6853-4859-85e1-d9b5f9d3f136 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:21.496398 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b5fe0-f5dd-4914-aa3f-14a8493883fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:21.497179 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b5fe0-f5dd-4914-aa3f-14a8493883fb None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:21.497455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b5fe0-f5dd-4914-aa3f-14a8493883fb None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:21.498618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b5fe0-f5dd-4914-aa3f-14a8493883fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:21.508956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b5fe0-f5dd-4914-aa3f-14a8493883fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:21.510529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b5fe0-f5dd-4914-aa3f-14a8493883fb None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:21.530041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-2d1b5fe0-f5dd-4914-aa3f-14a8493883fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:21.530041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:21.530041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:21.530041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:21.530041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:21.530041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:21.530041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:21.530041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:21.530041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:21.530041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:21.530041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:21.530041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:21.530041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:38:21.530041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:38:21.530041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:21.533938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:21.535096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:38:21.535096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:38:21.535096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:38:21.535096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:38:21.535096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 648/1283] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:21.537653 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46685493-deb1-41be-85bb-0e8392612ae0 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:21.655801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46685493-deb1-41be-85bb-0e8392612ae0 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:21.694995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8c8ff-d997-4175-96ef-e8cdbddb2abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:21.695720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8c8ff-d997-4175-96ef-e8cdbddb2abd None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:21.696038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8c8ff-d997-4175-96ef-e8cdbddb2abd None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:21.696355 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8c8ff-d997-4175-96ef-e8cdbddb2abd None admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:21.697118 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8c8ff-d997-4175-96ef-e8cdbddb2abd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:21.697727 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8c8ff-d997-4175-96ef-e8cdbddb2abd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:21.699178 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8c8ff-d997-4175-96ef-e8cdbddb2abd None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:21.711092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 636/1284] 10.222.0.112 () {56 vars in 1114 bytes} [Thu May 26 16:38:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:21.716822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b5fe0-f5dd-4914-aa3f-14a8493883fb None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:21.820765 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b5fe0-f5dd-4914-aa3f-14a8493883fb None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:21.836333 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:21.857302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5201f-fd91-4d56-8025-c47dc0736b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:21.858098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5201f-fd91-4d56-8025-c47dc0736b95 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:21.858409 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5201f-fd91-4d56-8025-c47dc0736b95 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:21.858691 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5201f-fd91-4d56-8025-c47dc0736b95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:21.865743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5201f-fd91-4d56-8025-c47dc0736b95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:21.867221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5201f-fd91-4d56-8025-c47dc0736b95 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:21.881345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application [None req-79f5201f-fd91-4d56-8025-c47dc0736b95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:38:21.881345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:21.881345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:21.881345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:21.881345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:21.881345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:21.881345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:21.881345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:21.881345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:21.881345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:21.881345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:21.881345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:21.881345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:38:21.881345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:38:21.881345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application with Lock( May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:21.887662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:21.888914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:38:21.888914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:38:21.888914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:38:21.888914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:38:21.888914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:38:21.888914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:38:21.888914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:38:21.888914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: ERROR keystone.server.flask.application May 26 16:38:21.888914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 649/1285] 10.222.0.112 () {56 vars in 1116 bytes} [Thu May 26 16:38:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:38:21.889538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8c8ff-d997-4175-96ef-e8cdbddb2abd None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:21.949183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:22.009750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8c8ff-d997-4175-96ef-e8cdbddb2abd None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:22.043801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81a6e4-7d4d-4edf-86d8-df29a587d3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:22.044465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81a6e4-7d4d-4edf-86d8-df29a587d3eb None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:22.044750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81a6e4-7d4d-4edf-86d8-df29a587d3eb None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:22.045030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81a6e4-7d4d-4edf-86d8-df29a587d3eb None admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:22.045813 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81a6e4-7d4d-4edf-86d8-df29a587d3eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:22.046125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81a6e4-7d4d-4edf-86d8-df29a587d3eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:22.047597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81a6e4-7d4d-4edf-86d8-df29a587d3eb None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:22.059933 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 637/1286] 10.222.0.112 () {56 vars in 1153 bytes} [Thu May 26 16:38:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:38:22.066279 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5201f-fd91-4d56-8025-c47dc0736b95 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:22.177630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5201f-fd91-4d56-8025-c47dc0736b95 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:22.215048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fadfe-f8a8-4cb5-b31b-a1972507f8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:22.215707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fadfe-f8a8-4cb5-b31b-a1972507f8c2 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:22.215992 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fadfe-f8a8-4cb5-b31b-a1972507f8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:22.216276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fadfe-f8a8-4cb5-b31b-a1972507f8c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:22.217108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fadfe-f8a8-4cb5-b31b-a1972507f8c2 None admin] RBAC: Adding query filter params (role.id=232cb450030f4f48943ecfcb88dcd7d2, scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8, user.id=b415e7fca03e4602b3d711436d47f46d) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:22.217420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fadfe-f8a8-4cb5-b31b-a1972507f8c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:22.219025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fadfe-f8a8-4cb5-b31b-a1972507f8c2 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:22.226558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 650/1287] 10.222.0.112 () {56 vars in 1379 bytes} [Thu May 26 16:38:22 2022] GET /identity/v3/role_assignments?user.id=b415e7fca03e4602b3d711436d47f46d&scope.project.id=9be90db8d7ee4bd0b01444d1eab83ad8&role.id=232cb450030f4f48943ecfcb88dcd7d2 => generated 610 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:38:24.587445 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c32df-f57a-44a0-9ba7-308e01c9ae8e None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:24.588019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c32df-f57a-44a0-9ba7-308e01c9ae8e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:24.588019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c32df-f57a-44a0-9ba7-308e01c9ae8e None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:24.589315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 638/1288] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:38:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:38:24.594924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bafa0-c008-43a6-bc17-8b9a9fcd26c9 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:24.595372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bafa0-c008-43a6-bc17-8b9a9fcd26c9 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:24.595510 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bafa0-c008-43a6-bc17-8b9a9fcd26c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:24.612793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-8e5bafa0-c008-43a6-bc17-8b9a9fcd26c9 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:24.614624 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8e5bafa0-c008-43a6-bc17-8b9a9fcd26c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:24.646552 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:24.683865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 651/1289] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:38:24 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:38:24.706596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c32df-f57a-44a0-9ba7-308e01c9ae8e None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:24.811593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c32df-f57a-44a0-9ba7-308e01c9ae8e None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:24.824369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:24.847116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7c200-d8fb-480b-b1df-44d51f887fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:24.847869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7c200-d8fb-480b-b1df-44d51f887fe1 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:24.848155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7c200-d8fb-480b-b1df-44d51f887fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:24.848467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7c200-d8fb-480b-b1df-44d51f887fe1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:24.849118 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7c200-d8fb-480b-b1df-44d51f887fe1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:24.850545 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7c200-d8fb-480b-b1df-44d51f887fe1 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-0ed7c200-d8fb-480b-b1df-44d51f887fe1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:24.862415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:24.866243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:24.867356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:24.867356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:38:24.867356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:24.867356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:24.867356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:24.867356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:24.867356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:24.867356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:24.867356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:24.867356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:24.867356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:38:24.867356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:38:24.867356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:38:24.867356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:24.867356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 639/1290] 10.222.0.112 () {56 vars in 1122 bytes} [Thu May 26 16:38:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:24.871798 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bafa0-c008-43a6-bc17-8b9a9fcd26c9 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:24.979541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bafa0-c008-43a6-bc17-8b9a9fcd26c9 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:25.015304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407425d-10b9-4383-bd14-b5891ecf6067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:25.015972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407425d-10b9-4383-bd14-b5891ecf6067 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:25.016262 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407425d-10b9-4383-bd14-b5891ecf6067 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:25.016540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407425d-10b9-4383-bd14-b5891ecf6067 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:25.017241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407425d-10b9-4383-bd14-b5891ecf6067 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:25.017548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407425d-10b9-4383-bd14-b5891ecf6067 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:25.018962 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407425d-10b9-4383-bd14-b5891ecf6067 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:25.023976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 652/1291] 10.222.0.112 () {56 vars in 1121 bytes} [Thu May 26 16:38:24 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:25.029934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7c200-d8fb-480b-b1df-44d51f887fe1 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:25.132184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7c200-d8fb-480b-b1df-44d51f887fe1 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:25.168537 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e94d90-da67-4285-8a7d-55041cf308f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:25.169218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e94d90-da67-4285-8a7d-55041cf308f6 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:25.169501 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e94d90-da67-4285-8a7d-55041cf308f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:25.169773 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e94d90-da67-4285-8a7d-55041cf308f6 None admin] PATH_INFO: `/v3/services` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:25.170525 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e94d90-da67-4285-8a7d-55041cf308f6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:25.170832 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e94d90-da67-4285-8a7d-55041cf308f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:25.172207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e94d90-da67-4285-8a7d-55041cf308f6 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:25.177720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 640/1292] 10.222.0.112 () {56 vars in 1121 bytes} [Thu May 26 16:38:25 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:27.478284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321c93e-02c6-4642-a7c1-c8b47153e08e None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:27.478862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321c93e-02c6-4642-a7c1-c8b47153e08e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:27.479122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321c93e-02c6-4642-a7c1-c8b47153e08e None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:27.481656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 653/1293] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:38:27 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:38:27.488399 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0abc7f-410f-40dd-a97b-3f2b62135569 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:27.488929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0abc7f-410f-40dd-a97b-3f2b62135569 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:27.489901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0abc7f-410f-40dd-a97b-3f2b62135569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:27.518447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-ae0abc7f-410f-40dd-a97b-3f2b62135569 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:27.519728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-ae0abc7f-410f-40dd-a97b-3f2b62135569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:27.559386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:27.613746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 641/1294] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:38:27 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:38:27.638189 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321c93e-02c6-4642-a7c1-c8b47153e08e None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:27.678935 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:27.762478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321c93e-02c6-4642-a7c1-c8b47153e08e None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:27.802778 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edbbac-37a1-4087-bbfe-b21ec6629edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:27.803444 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edbbac-37a1-4087-bbfe-b21ec6629edf None admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:27.803721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edbbac-37a1-4087-bbfe-b21ec6629edf None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:27.803996 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edbbac-37a1-4087-bbfe-b21ec6629edf None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:27.804727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edbbac-37a1-4087-bbfe-b21ec6629edf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:27.806089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edbbac-37a1-4087-bbfe-b21ec6629edf None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:28.035670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 654/1295] 10.222.0.112 () {60 vars in 1146 bytes} [Thu May 26 16:38:27 2022] POST /identity/v3/services => generated 247 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:38:30.363917 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb2a9e-bbde-49ca-9ffb-5d98de1b6657 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:30.364753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb2a9e-bbde-49ca-9ffb-5d98de1b6657 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:30.364950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb2a9e-bbde-49ca-9ffb-5d98de1b6657 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:30.369418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 642/1296] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:38:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:38:30.372901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff893ef-db84-40ac-a6bc-c64494c1d6c7 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:30.373527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff893ef-db84-40ac-a6bc-c64494c1d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:30.373527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff893ef-db84-40ac-a6bc-c64494c1d6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:30.394829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-9ff893ef-db84-40ac-a6bc-c64494c1d6c7 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:30.397531 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-9ff893ef-db84-40ac-a6bc-c64494c1d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:30.497781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 655/1297] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:38:30 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:38:30.534579 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb2a9e-bbde-49ca-9ffb-5d98de1b6657 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:30.673278 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb2a9e-bbde-49ca-9ffb-5d98de1b6657 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:30.718435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f0bfd-5078-49ea-9243-f371762b4db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:30.719255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0bfd-5078-49ea-9243-f371762b4db9 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:30.719537 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0bfd-5078-49ea-9243-f371762b4db9 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:30.719818 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0bfd-5078-49ea-9243-f371762b4db9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:30.720481 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f0bfd-5078-49ea-9243-f371762b4db9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:30.721920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f0bfd-5078-49ea-9243-f371762b4db9 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-764f0bfd-5078-49ea-9243-f371762b4db9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:30.735021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:30.740363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:30.741325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:30.741325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:38:30.741325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:30.741325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:30.741325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:30.741325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:30.741325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:30.741325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:30.741325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:30.741325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:30.741325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:38:30.741325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:38:30.741325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:38:30.741325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:30.741325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 643/1298] 10.222.0.112 () {56 vars in 1122 bytes} [Thu May 26 16:38:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:38:30.743412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff893ef-db84-40ac-a6bc-c64494c1d6c7 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:30.762561 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:30.883239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff893ef-db84-40ac-a6bc-c64494c1d6c7 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:30.933482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b4e7-2514-41ee-aa42-d6a510093730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:30.934565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b4e7-2514-41ee-aa42-d6a510093730 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:30.934862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b4e7-2514-41ee-aa42-d6a510093730 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:30.935145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b4e7-2514-41ee-aa42-d6a510093730 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:30.935865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90b4e7-2514-41ee-aa42-d6a510093730 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:30.936370 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90b4e7-2514-41ee-aa42-d6a510093730 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:30.938196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90b4e7-2514-41ee-aa42-d6a510093730 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:30.948886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 656/1299] 10.222.0.112 () {56 vars in 1121 bytes} [Thu May 26 16:38:30 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:30.955910 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f0bfd-5078-49ea-9243-f371762b4db9 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:30.999995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:31.076250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f0bfd-5078-49ea-9243-f371762b4db9 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:31.118839 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a15773-49cd-4d7d-8f85-7431dc43d5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:31.121293 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a15773-49cd-4d7d-8f85-7431dc43d5df None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:31.121998 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a15773-49cd-4d7d-8f85-7431dc43d5df None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:31.122525 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a15773-49cd-4d7d-8f85-7431dc43d5df None admin] PATH_INFO: `/v3/endpoints` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:31.123341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a15773-49cd-4d7d-8f85-7431dc43d5df None admin] RBAC: Adding query filter params (interface=public, service_id=18d24460cd9244cb9dd2244777fb3326, region_id=RegionOne) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:31.123661 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a15773-49cd-4d7d-8f85-7431dc43d5df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:31.125051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a15773-49cd-4d7d-8f85-7431dc43d5df None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:31.131138 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 644/1300] 10.222.0.112 () {56 vars in 1256 bytes} [Thu May 26 16:38:30 2022] GET /identity/v3/endpoints?service_id=18d24460cd9244cb9dd2244777fb3326&interface=public®ion_id=RegionOne => generated 195 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:31.138129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b4e7-2514-41ee-aa42-d6a510093730 None admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:31.248168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:31.267391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b4e7-2514-41ee-aa42-d6a510093730 None admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:31.305968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bcf14-37c8-4851-9cc3-2b06fa095f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:31.306666 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bcf14-37c8-4851-9cc3-2b06fa095f06 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:31.306950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bcf14-37c8-4851-9cc3-2b06fa095f06 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:31.307224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bcf14-37c8-4851-9cc3-2b06fa095f06 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:31.307892 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bcf14-37c8-4851-9cc3-2b06fa095f06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:31.309254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bcf14-37c8-4851-9cc3-2b06fa095f06 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:31.316285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 657/1301] 10.222.0.112 () {56 vars in 1092 bytes} [Thu May 26 16:38:31 2022] GET /identity/v3/services => generated 2201 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:38:33.582154 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec861063-56ac-4af7-9062-dbd6e4707023 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:33.582970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec861063-56ac-4af7-9062-dbd6e4707023 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:33.582970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec861063-56ac-4af7-9062-dbd6e4707023 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:33.584499 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 645/1302] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:38:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:38:33.590690 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10715b07-a351-4461-869c-ffc41f34293d None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:33.591188 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10715b07-a351-4461-869c-ffc41f34293d None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:33.591330 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10715b07-a351-4461-869c-ffc41f34293d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:33.611184 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-10715b07-a351-4461-869c-ffc41f34293d None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:33.612419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-10715b07-a351-4461-869c-ffc41f34293d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:33.687280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 658/1303] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:38:33 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:38:33.713463 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec861063-56ac-4af7-9062-dbd6e4707023 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:33.821413 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:33.828658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec861063-56ac-4af7-9062-dbd6e4707023 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:33.866995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55956787-71bb-466c-8838-898503b42ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:33.867710 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55956787-71bb-466c-8838-898503b42ce9 None admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:33.867998 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55956787-71bb-466c-8838-898503b42ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:33.868282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55956787-71bb-466c-8838-898503b42ce9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:33.868949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55956787-71bb-466c-8838-898503b42ce9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:33.870373 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55956787-71bb-466c-8838-898503b42ce9 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application [None req-55956787-71bb-466c-8838-898503b42ce9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:38:33.882686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:38:33.883920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:38:33.884872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:38:33.884872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application with Lock( May 26 16:38:33.884872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:38:33.884872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self._enter() May 26 16:38:33.884872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:38:33.884872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:38:33.884872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:38:33.884872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application return self.creator() May 26 16:38:33.884872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:38:33.884872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application created_value = creator( May 26 16:38:33.884872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:38:33.884872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:38:33.884872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:38:33.884872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: ERROR keystone.server.flask.application May 26 16:38:33.884872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 646/1304] 10.222.0.112 () {56 vars in 1122 bytes} [Thu May 26 16:38:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:38:33.890076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10715b07-a351-4461-869c-ffc41f34293d None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:33.973039 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:34.001016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10715b07-a351-4461-869c-ffc41f34293d None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:34.045011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f9e50-3343-472e-8178-ea37ac79d408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:34.045703 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f9e50-3343-472e-8178-ea37ac79d408 None admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:34.045989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f9e50-3343-472e-8178-ea37ac79d408 None admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:34.046270 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f9e50-3343-472e-8178-ea37ac79d408 None admin] PATH_INFO: `/v3/services` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:34.047028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f9e50-3343-472e-8178-ea37ac79d408 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:38:34.047342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f9e50-3343-472e-8178-ea37ac79d408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:34.048984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f9e50-3343-472e-8178-ea37ac79d408 None admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:34.055536 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 659/1305] 10.222.0.112 () {56 vars in 1121 bytes} [Thu May 26 16:38:33 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:34.061798 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55956787-71bb-466c-8838-898503b42ce9 None admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:34.187137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55956787-71bb-466c-8838-898503b42ce9 None admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:34.234712 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3cbb7-70bd-4865-afd3-21ddff2a60c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:34.235670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3cbb7-70bd-4865-afd3-21ddff2a60c4 None admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:34.236091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3cbb7-70bd-4865-afd3-21ddff2a60c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:34.236506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3cbb7-70bd-4865-afd3-21ddff2a60c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:34.237638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3cbb7-70bd-4865-afd3-21ddff2a60c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:34.239815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3cbb7-70bd-4865-afd3-21ddff2a60c4 None admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:34.337093 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 647/1306] 10.222.0.112 () {60 vars in 1149 bytes} [Thu May 26 16:38:34 2022] POST /identity/v3/endpoints => generated 333 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:38:44.072940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=30 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:44.331411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:55.935511 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda9dc0-83e5-41fc-9ab8-092954c926ff None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:55.936092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda9dc0-83e5-41fc-9ab8-092954c926ff None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:55.936424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda9dc0-83e5-41fc-9ab8-092954c926ff None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:55.937698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 660/1307] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:47:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:47:55.943447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8e5d2-4bf9-4be4-86a5-4a9d0802f0b1 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:55.944374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8e5d2-4bf9-4be4-86a5-4a9d0802f0b1 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:55.944894 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8e5d2-4bf9-4be4-86a5-4a9d0802f0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:56.049326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-64d8e5d2-4bf9-4be4-86a5-4a9d0802f0b1 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:56.051301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-64d8e5d2-4bf9-4be4-86a5-4a9d0802f0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:56.272864 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 648/1308] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:47:56.346252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37877ba4-eb26-4bff-8479-14eebe73ff32 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:56.346664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37877ba4-eb26-4bff-8479-14eebe73ff32 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:56.346948 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37877ba4-eb26-4bff-8479-14eebe73ff32 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:56.348775 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 661/1309] 10.222.0.112 () {54 vars in 969 bytes} [Thu May 26 16:47:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:47:56.355788 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8998ac-8541-4607-b720-2517093c9aa8 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:56.356102 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8998ac-8541-4607-b720-2517093c9aa8 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:56.356385 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8998ac-8541-4607-b720-2517093c9aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:56.524166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-8a8998ac-8541-4607-b720-2517093c9aa8 None None] MFA Rules not processed for user `0288901db0244eab9a737af460ce1bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:56.527827 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8a8998ac-8541-4607-b720-2517093c9aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:56.578290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:56.665623 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 649/1310] 10.222.0.112 () {58 vars in 1066 bytes} [Thu May 26 16:47:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:47:56.676577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37877ba4-eb26-4bff-8479-14eebe73ff32 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:56.678503 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-37877ba4-eb26-4bff-8479-14eebe73ff32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:56.837753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37877ba4-eb26-4bff-8479-14eebe73ff32 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:56.941618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ec195-c43f-4c96-8dd5-e308ec9f2543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:56.942315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ec195-c43f-4c96-8dd5-e308ec9f2543 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:56.942618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ec195-c43f-4c96-8dd5-e308ec9f2543 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:56.942901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ec195-c43f-4c96-8dd5-e308ec9f2543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:56.944677 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-872ec195-c43f-4c96-8dd5-e308ec9f2543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:57.013841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:57.086823 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ec195-c43f-4c96-8dd5-e308ec9f2543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:57.088197 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ec195-c43f-4c96-8dd5-e308ec9f2543 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:57.110111 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 662/1311] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:47:59.790768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e09a07-79fc-4de8-9374-91d6fce7f687 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:59.791296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e09a07-79fc-4de8-9374-91d6fce7f687 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:59.791296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e09a07-79fc-4de8-9374-91d6fce7f687 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:59.792657 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 650/1312] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:47:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:47:59.797929 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7301e05-7306-4ad7-9e99-291777284565 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:59.798408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7301e05-7306-4ad7-9e99-291777284565 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:59.798725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7301e05-7306-4ad7-9e99-291777284565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:59.887862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-d7301e05-7306-4ad7-9e99-291777284565 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:59.888996 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d7301e05-7306-4ad7-9e99-291777284565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:59.994072 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 663/1313] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:00.046861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a9ab0-6745-4326-825a-e58b6f6fafd2 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:00.047148 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a9ab0-6745-4326-825a-e58b6f6fafd2 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:00.047500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a9ab0-6745-4326-825a-e58b6f6fafd2 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:00.049463 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 651/1314] 10.222.0.112 () {54 vars in 969 bytes} [Thu May 26 16:48:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:00.055871 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40072262-3cfe-4210-a6b7-1616c4f36f45 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:00.056158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40072262-3cfe-4210-a6b7-1616c4f36f45 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:00.056434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40072262-3cfe-4210-a6b7-1616c4f36f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:00.068420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:00.158015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-40072262-3cfe-4210-a6b7-1616c4f36f45 None None] MFA Rules not processed for user `0288901db0244eab9a737af460ce1bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:00.159454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-40072262-3cfe-4210-a6b7-1616c4f36f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:00.242539 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 664/1315] 10.222.0.112 () {58 vars in 1066 bytes} [Thu May 26 16:48:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:00.252083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a9ab0-6745-4326-825a-e58b6f6fafd2 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:00.253731 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-394a9ab0-6745-4326-825a-e58b6f6fafd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:00.388809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a9ab0-6745-4326-825a-e58b6f6fafd2 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:00.477347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:00.480060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6fba2-5d00-483b-961d-ee31c4587970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:00.481040 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6fba2-5d00-483b-961d-ee31c4587970 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:00.481514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6fba2-5d00-483b-961d-ee31c4587970 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:00.481972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6fba2-5d00-483b-961d-ee31c4587970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:00.484939 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-53e6fba2-5d00-483b-961d-ee31c4587970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:00.620027 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6fba2-5d00-483b-961d-ee31c4587970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:00.621610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6fba2-5d00-483b-961d-ee31c4587970 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:00.651666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 652/1316] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:03.809235 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a73090-0d78-4fe7-9ea4-d6d77e41868c None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:03.809763 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a73090-0d78-4fe7-9ea4-d6d77e41868c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:03.809886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a73090-0d78-4fe7-9ea4-d6d77e41868c None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:03.811254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 665/1317] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:48:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:03.816852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc255b-901a-463c-b04d-0df431c19b08 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:03.817312 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc255b-901a-463c-b04d-0df431c19b08 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:03.817412 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc255b-901a-463c-b04d-0df431c19b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:03.882473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-0bcc255b-901a-463c-b04d-0df431c19b08 None None] MFA Rules not processed for user `75a051b2e49849fb9c162fa672f54248`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:03.883676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0bcc255b-901a-463c-b04d-0df431c19b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:03.935435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:03.980699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 653/1318] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:48:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:48:04.020495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a73090-0d78-4fe7-9ea4-d6d77e41868c None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:04.022036 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-49a73090-0d78-4fe7-9ea4-d6d77e41868c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:04.130306 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a73090-0d78-4fe7-9ea4-d6d77e41868c None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:04.133168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:04.206993 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bc91f-1d98-4199-bc29-4c8dada5fdcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:04.207650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bc91f-1d98-4199-bc29-4c8dada5fdcc service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:04.207938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bc91f-1d98-4199-bc29-4c8dada5fdcc service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:04.208212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bc91f-1d98-4199-bc29-4c8dada5fdcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:04.209889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ef2bc91f-1d98-4199-bc29-4c8dada5fdcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:04.318872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bc91f-1d98-4199-bc29-4c8dada5fdcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:04.320405 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bc91f-1d98-4199-bc29-4c8dada5fdcc service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:04.340393 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 666/1319] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:48:04 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:07.563841 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360f590-e257-47a8-b29b-24770a5d4312 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:07.564401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360f590-e257-47a8-b29b-24770a5d4312 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:07.564401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360f590-e257-47a8-b29b-24770a5d4312 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:07.565701 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 654/1320] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:48:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:07.571144 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dced13c-ff8d-4527-8b10-bd3e21d1e7f0 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:07.571578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dced13c-ff8d-4527-8b10-bd3e21d1e7f0 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:07.571709 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dced13c-ff8d-4527-8b10-bd3e21d1e7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:07.612705 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:07.636857 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-8dced13c-ff8d-4527-8b10-bd3e21d1e7f0 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:07.638062 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8dced13c-ff8d-4527-8b10-bd3e21d1e7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:07.736312 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 667/1321] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:48:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:07.776313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360f590-e257-47a8-b29b-24770a5d4312 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:07.777867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9360f590-e257-47a8-b29b-24770a5d4312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:07.887362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360f590-e257-47a8-b29b-24770a5d4312 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:07.963847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622166a-b0a8-4981-9136-efd11f2921a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:07.964505 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622166a-b0a8-4981-9136-efd11f2921a3 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:07.964790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622166a-b0a8-4981-9136-efd11f2921a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:07.965075 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622166a-b0a8-4981-9136-efd11f2921a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:07.966759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4622166a-b0a8-4981-9136-efd11f2921a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:07.976524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:08.079091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622166a-b0a8-4981-9136-efd11f2921a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:08.080540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622166a-b0a8-4981-9136-efd11f2921a3 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:08.100169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 655/1322] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:48:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:11.557984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860dedd-b40e-4cea-9d68-a97586f08c26 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:11.558526 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860dedd-b40e-4cea-9d68-a97586f08c26 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:11.558526 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860dedd-b40e-4cea-9d68-a97586f08c26 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:11.559872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 668/1323] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:48:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:11.565930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fad81-7706-410a-81ae-51191a86217b None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:11.566412 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fad81-7706-410a-81ae-51191a86217b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:11.566677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fad81-7706-410a-81ae-51191a86217b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:11.634307 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-0f5fad81-7706-410a-81ae-51191a86217b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:11.635551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0f5fad81-7706-410a-81ae-51191a86217b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:11.697368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:11.739997 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 656/1324] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:11.776045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860dedd-b40e-4cea-9d68-a97586f08c26 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:11.777840 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-9860dedd-b40e-4cea-9d68-a97586f08c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:11.891207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860dedd-b40e-4cea-9d68-a97586f08c26 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:11.903545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:11.974204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637df01-cafc-4c1a-a3f7-f49889394e2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:11.974891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637df01-cafc-4c1a-a3f7-f49889394e2e service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:11.975177 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637df01-cafc-4c1a-a3f7-f49889394e2e service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:11.975454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637df01-cafc-4c1a-a3f7-f49889394e2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:11.977129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-2637df01-cafc-4c1a-a3f7-f49889394e2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:12.095014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637df01-cafc-4c1a-a3f7-f49889394e2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:12.096464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637df01-cafc-4c1a-a3f7-f49889394e2e service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:12.116801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 669/1325] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:14.494934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8ee21-51c2-4a2d-8fa8-98275ce3efe5 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:14.495574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8ee21-51c2-4a2d-8fa8-98275ce3efe5 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:14.495574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8ee21-51c2-4a2d-8fa8-98275ce3efe5 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:14.496875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 657/1326] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:48:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:14.502896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10e743-32f5-48e1-8d70-c108fa3d55ff None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:14.503710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10e743-32f5-48e1-8d70-c108fa3d55ff None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:14.503710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10e743-32f5-48e1-8d70-c108fa3d55ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:14.557564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:14.575300 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-be10e743-32f5-48e1-8d70-c108fa3d55ff None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:14.576495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-be10e743-32f5-48e1-8d70-c108fa3d55ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:14.678188 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 670/1327] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:14.714488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8ee21-51c2-4a2d-8fa8-98275ce3efe5 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:14.716163 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-56a8ee21-51c2-4a2d-8fa8-98275ce3efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:14.836182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8ee21-51c2-4a2d-8fa8-98275ce3efe5 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:14.920698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa878f9-22a6-43d0-8fdf-7e266d3b3346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:14.921334 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa878f9-22a6-43d0-8fdf-7e266d3b3346 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:14.921650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa878f9-22a6-43d0-8fdf-7e266d3b3346 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:14.922147 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa878f9-22a6-43d0-8fdf-7e266d3b3346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:14.923974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-6aa878f9-22a6-43d0-8fdf-7e266d3b3346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:14.942264 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:15.049489 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa878f9-22a6-43d0-8fdf-7e266d3b3346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:15.050990 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa878f9-22a6-43d0-8fdf-7e266d3b3346 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:15.070460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 658/1328] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:17.356460 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afe23b-babc-46e7-bf21-a18e84d50809 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:17.357038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afe23b-babc-46e7-bf21-a18e84d50809 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:17.357038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afe23b-babc-46e7-bf21-a18e84d50809 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:17.358423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 671/1329] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:48:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:17.364630 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e84766-f2f5-4d93-a8b6-b45b3a693d5a None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:17.365150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e84766-f2f5-4d93-a8b6-b45b3a693d5a None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:17.365248 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e84766-f2f5-4d93-a8b6-b45b3a693d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:17.433123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-98e84766-f2f5-4d93-a8b6-b45b3a693d5a None None] MFA Rules not processed for user `75a051b2e49849fb9c162fa672f54248`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:17.434350 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-98e84766-f2f5-4d93-a8b6-b45b3a693d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:17.502013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:17.534710 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 659/1330] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:48:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:17.572126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afe23b-babc-46e7-bf21-a18e84d50809 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:17.573646 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-27afe23b-babc-46e7-bf21-a18e84d50809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:17.685060 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afe23b-babc-46e7-bf21-a18e84d50809 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:17.704586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:17.758147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84046fd-e09b-4cc7-9684-f452df6cc861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:17.758932 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84046fd-e09b-4cc7-9684-f452df6cc861 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:17.759216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84046fd-e09b-4cc7-9684-f452df6cc861 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:17.759541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84046fd-e09b-4cc7-9684-f452df6cc861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:17.761753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b84046fd-e09b-4cc7-9684-f452df6cc861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:17.874091 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84046fd-e09b-4cc7-9684-f452df6cc861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:17.875848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84046fd-e09b-4cc7-9684-f452df6cc861 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:17.895019 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 672/1331] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:48:17 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:20.679484 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecfc41-c521-4661-8100-81169989572d None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:20.680042 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecfc41-c521-4661-8100-81169989572d None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:20.680139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecfc41-c521-4661-8100-81169989572d None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:20.681764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 660/1332] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:48:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:20.687577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e70dc2-10bd-4b51-8b9d-4fdc273985dd None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:20.688051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e70dc2-10bd-4b51-8b9d-4fdc273985dd None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:20.688167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e70dc2-10bd-4b51-8b9d-4fdc273985dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:20.757569 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:20.760289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-93e70dc2-10bd-4b51-8b9d-4fdc273985dd None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:20.761501 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-93e70dc2-10bd-4b51-8b9d-4fdc273985dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:20.867794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 673/1333] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:20.903434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecfc41-c521-4661-8100-81169989572d None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:20.904958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-89ecfc41-c521-4661-8100-81169989572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:21.025172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecfc41-c521-4661-8100-81169989572d None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:21.106785 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91519254-6a9b-4498-8572-b23b93f3d420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:21.107453 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91519254-6a9b-4498-8572-b23b93f3d420 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:21.107741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91519254-6a9b-4498-8572-b23b93f3d420 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:21.108025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91519254-6a9b-4498-8572-b23b93f3d420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:21.109785 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-91519254-6a9b-4498-8572-b23b93f3d420 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:21.142982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:21.235650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91519254-6a9b-4498-8572-b23b93f3d420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:21.237211 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91519254-6a9b-4498-8572-b23b93f3d420 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:21.256595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 661/1334] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:48:23.612638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a764c5-1e22-4e41-a36f-2e147e437306 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:23.613150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a764c5-1e22-4e41-a36f-2e147e437306 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:23.613150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a764c5-1e22-4e41-a36f-2e147e437306 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:23.614522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 674/1335] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:48:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:23.622527 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7dccc-5e51-4d5d-90bd-75efdc2a1a23 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:23.623029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7dccc-5e51-4d5d-90bd-75efdc2a1a23 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:23.623123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7dccc-5e51-4d5d-90bd-75efdc2a1a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:23.694273 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-37b7dccc-5e51-4d5d-90bd-75efdc2a1a23 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:23.695644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-37b7dccc-5e51-4d5d-90bd-75efdc2a1a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:23.773334 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:23.796729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 662/1336] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:23.837729 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a764c5-1e22-4e41-a36f-2e147e437306 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:23.839280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-25a764c5-1e22-4e41-a36f-2e147e437306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:23.947676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a764c5-1e22-4e41-a36f-2e147e437306 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:23.975631 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:24.024048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfb17a-979c-41c2-84c3-5d4231a9f6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:24.024694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfb17a-979c-41c2-84c3-5d4231a9f6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:24.024977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfb17a-979c-41c2-84c3-5d4231a9f6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:24.025254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfb17a-979c-41c2-84c3-5d4231a9f6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:24.026960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d8dfb17a-979c-41c2-84c3-5d4231a9f6c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:24.146175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfb17a-979c-41c2-84c3-5d4231a9f6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:24.147660 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfb17a-979c-41c2-84c3-5d4231a9f6c4 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:24.169753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 675/1337] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:27.227577 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e6146-cfd0-40d3-a695-663a5eb44fde None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:27.228116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e6146-cfd0-40d3-a695-663a5eb44fde None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:27.228214 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e6146-cfd0-40d3-a695-663a5eb44fde None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:27.229595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 663/1338] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:48:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:27.235590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab484c6-13d7-4dd6-8ba7-0bcd02599cf4 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:27.236300 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab484c6-13d7-4dd6-8ba7-0bcd02599cf4 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:27.236558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab484c6-13d7-4dd6-8ba7-0bcd02599cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:27.306546 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-fab484c6-13d7-4dd6-8ba7-0bcd02599cf4 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:27.307770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-fab484c6-13d7-4dd6-8ba7-0bcd02599cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:27.317025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:27.414392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 676/1339] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:48:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:27.450871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e6146-cfd0-40d3-a695-663a5eb44fde None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:27.453614 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-6e9e6146-cfd0-40d3-a695-663a5eb44fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:27.552953 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e6146-cfd0-40d3-a695-663a5eb44fde None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:27.556743 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b9b3f-c96e-4495-bf2d-13b87c24e9d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:27.557388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b9b3f-c96e-4495-bf2d-13b87c24e9d0 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:27.557671 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b9b3f-c96e-4495-bf2d-13b87c24e9d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:27.557946 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b9b3f-c96e-4495-bf2d-13b87c24e9d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:27.567089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b9b3f-c96e-4495-bf2d-13b87c24e9d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:27.568515 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b9b3f-c96e-4495-bf2d-13b87c24e9d0 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:27.577762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 664/1340] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:48:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:32.261100 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47288ed2-f682-48bf-ad15-45665f9fea7f None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:32.261609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47288ed2-f682-48bf-ad15-45665f9fea7f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:32.261609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47288ed2-f682-48bf-ad15-45665f9fea7f None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:32.263195 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 677/1341] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:48:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:48:32.268610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ab4d9-6479-4188-a31b-5a14ebcfb3ca None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:32.269080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ab4d9-6479-4188-a31b-5a14ebcfb3ca None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:32.269176 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ab4d9-6479-4188-a31b-5a14ebcfb3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:32.300471 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-065ab4d9-6479-4188-a31b-5a14ebcfb3ca None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:32.301707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-065ab4d9-6479-4188-a31b-5a14ebcfb3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:32.386473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 665/1342] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:32.423810 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47288ed2-f682-48bf-ad15-45665f9fea7f None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:32.439417 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47288ed2-f682-48bf-ad15-45665f9fea7f None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:32.442997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a36f5-5f9a-4d27-82e0-7ebba8c53988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:32.443643 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a36f5-5f9a-4d27-82e0-7ebba8c53988 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:32.443930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a36f5-5f9a-4d27-82e0-7ebba8c53988 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:32.444211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a36f5-5f9a-4d27-82e0-7ebba8c53988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:32.453917 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a36f5-5f9a-4d27-82e0-7ebba8c53988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:32.455395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a36f5-5f9a-4d27-82e0-7ebba8c53988 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:32.465139 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 678/1343] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:35.843722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49614295-f438-4855-b17a-7acd9fbb87fb None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:35.844317 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49614295-f438-4855-b17a-7acd9fbb87fb None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:35.844317 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49614295-f438-4855-b17a-7acd9fbb87fb None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:35.845768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 666/1344] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:48:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:35.851248 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d290c9-c970-47b0-a155-894cbed35a56 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:35.851691 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d290c9-c970-47b0-a155-894cbed35a56 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:35.851832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d290c9-c970-47b0-a155-894cbed35a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:35.871011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-b5d290c9-c970-47b0-a155-894cbed35a56 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:35.872224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b5d290c9-c970-47b0-a155-894cbed35a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:35.881339 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 679/1345] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:48:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:35.918669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49614295-f438-4855-b17a-7acd9fbb87fb None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:35.930126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49614295-f438-4855-b17a-7acd9fbb87fb None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:35.933952 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e889cf-050d-4347-bce8-51925e5914f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:35.934658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e889cf-050d-4347-bce8-51925e5914f6 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:35.934949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e889cf-050d-4347-bce8-51925e5914f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:35.935232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e889cf-050d-4347-bce8-51925e5914f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:35.945516 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e889cf-050d-4347-bce8-51925e5914f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:35.947006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e889cf-050d-4347-bce8-51925e5914f6 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:35.957423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 667/1346] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:48:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:40.566921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f4259-31a5-4220-8ec7-7de48810ef9a None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:40.567545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f4259-31a5-4220-8ec7-7de48810ef9a None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:40.567545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f4259-31a5-4220-8ec7-7de48810ef9a None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:40.568762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 680/1347] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:48:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:40.574293 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc00a33-014c-433b-a424-e5bacc2fedac None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:40.574793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc00a33-014c-433b-a424-e5bacc2fedac None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:40.574906 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc00a33-014c-433b-a424-e5bacc2fedac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:40.595518 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-cbc00a33-014c-433b-a424-e5bacc2fedac None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:40.597198 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-cbc00a33-014c-433b-a424-e5bacc2fedac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:40.607555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 668/1348] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:40.649904 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f4259-31a5-4220-8ec7-7de48810ef9a None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:40.651999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-679f4259-31a5-4220-8ec7-7de48810ef9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:40.668863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f4259-31a5-4220-8ec7-7de48810ef9a None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:40.674138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74795dd-f17f-492f-9f0b-d73648ecbcc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:40.674829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74795dd-f17f-492f-9f0b-d73648ecbcc6 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:40.675115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74795dd-f17f-492f-9f0b-d73648ecbcc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:40.675391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74795dd-f17f-492f-9f0b-d73648ecbcc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:40.686774 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74795dd-f17f-492f-9f0b-d73648ecbcc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:40.688237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74795dd-f17f-492f-9f0b-d73648ecbcc6 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:40.702908 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 681/1349] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:46.374127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ace031-3b8f-4ad6-90cd-f3dd51aa5947 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:46.375079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ace031-3b8f-4ad6-90cd-f3dd51aa5947 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:46.375499 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ace031-3b8f-4ad6-90cd-f3dd51aa5947 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:46.377528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 669/1350] 10.222.0.112 () {54 vars in 926 bytes} [Thu May 26 16:48:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:46.383210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673b517-5b9b-4ea7-9745-181fa25a481f None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:46.384031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673b517-5b9b-4ea7-9745-181fa25a481f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:46.384514 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673b517-5b9b-4ea7-9745-181fa25a481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:46.471613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-b673b517-5b9b-4ea7-9745-181fa25a481f None None] MFA Rules not processed for user `b415e7fca03e4602b3d711436d47f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:46.471613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b673b517-5b9b-4ea7-9745-181fa25a481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:46.546771 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:46.573576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 682/1351] 10.222.0.112 () {58 vars in 1023 bytes} [Thu May 26 16:48:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:50.588390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=98 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:51.023574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0715cd2-9871-4443-9fe1-550d9c4f0ff9 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:51.024224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0715cd2-9871-4443-9fe1-550d9c4f0ff9 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:51.024710 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0715cd2-9871-4443-9fe1-550d9c4f0ff9 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:51.026293 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 670/1352] 10.222.0.112 () {54 vars in 926 bytes} [Thu May 26 16:48:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:51.031818 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f42c39-5f27-4863-8df0-c3793a533df0 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:51.032713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f42c39-5f27-4863-8df0-c3793a533df0 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:51.033217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f42c39-5f27-4863-8df0-c3793a533df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:51.056141 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-54f42c39-5f27-4863-8df0-c3793a533df0 None None] MFA Rules not processed for user `b415e7fca03e4602b3d711436d47f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:51.057870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-54f42c39-5f27-4863-8df0-c3793a533df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:51.068712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 683/1353] 10.222.0.112 () {58 vars in 1023 bytes} [Thu May 26 16:48:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:52.625973 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fa143-971b-4796-9b76-329b61352fbd None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:52.626481 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fa143-971b-4796-9b76-329b61352fbd None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:52.626601 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fa143-971b-4796-9b76-329b61352fbd None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:52.628288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 671/1354] 10.222.0.112 () {54 vars in 926 bytes} [Thu May 26 16:48:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:52.633566 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491a7fb-2b47-4283-a8bd-f8f52949726e None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:52.634069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491a7fb-2b47-4283-a8bd-f8f52949726e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:52.634257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491a7fb-2b47-4283-a8bd-f8f52949726e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:52.653345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e491a7fb-2b47-4283-a8bd-f8f52949726e None None] MFA Rules not processed for user `b415e7fca03e4602b3d711436d47f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:52.654665 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e491a7fb-2b47-4283-a8bd-f8f52949726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:52.663348 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 684/1355] 10.222.0.112 () {58 vars in 1023 bytes} [Thu May 26 16:48:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:56.647978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af74819-9934-4bd4-bc4c-7be4bf64e970 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:56.648523 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af74819-9934-4bd4-bc4c-7be4bf64e970 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:56.648523 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af74819-9934-4bd4-bc4c-7be4bf64e970 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:56.650100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 672/1356] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:48:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:56.655406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7af62-29f4-436f-bb72-7004443521c5 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:56.656202 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7af62-29f4-436f-bb72-7004443521c5 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:56.656650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7af62-29f4-436f-bb72-7004443521c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:56.675049 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-a7f7af62-29f4-436f-bb72-7004443521c5 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:56.676246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a7f7af62-29f4-436f-bb72-7004443521c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:56.685131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 685/1357] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:56.739779 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252dbc7-84c0-4057-9109-8a0961e65590 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:56.740074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252dbc7-84c0-4057-9109-8a0961e65590 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:56.740361 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252dbc7-84c0-4057-9109-8a0961e65590 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:56.741884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 673/1358] 10.222.0.112 () {54 vars in 966 bytes} [Thu May 26 16:48:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:56.748166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8938-7b55-47cc-882b-c08d489def1d None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:56.748787 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8938-7b55-47cc-882b-c08d489def1d None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:56.749555 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8938-7b55-47cc-882b-c08d489def1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:56.813649 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-8fcc8938-7b55-47cc-882b-c08d489def1d None None] MFA Rules not processed for user `5f2ec4c76f8f4d858bce53f30cc198fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:56.819615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8fcc8938-7b55-47cc-882b-c08d489def1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:56.914122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 686/1359] 10.222.0.112 () {58 vars in 1063 bytes} [Thu May 26 16:48:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:56.923289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252dbc7-84c0-4057-9109-8a0961e65590 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:56.939439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252dbc7-84c0-4057-9109-8a0961e65590 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:56.945256 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78265698-9d39-4dbd-8434-f7e4c729b6c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:56.945977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78265698-9d39-4dbd-8434-f7e4c729b6c6 service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:56.946352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78265698-9d39-4dbd-8434-f7e4c729b6c6 service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:56.946868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78265698-9d39-4dbd-8434-f7e4c729b6c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:56.958492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78265698-9d39-4dbd-8434-f7e4c729b6c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:56.960342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78265698-9d39-4dbd-8434-f7e4c729b6c6 service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:56.973760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 674/1360] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:48:59.596803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695c480-9d76-40f0-945e-37b873a15cb3 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:59.597325 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695c480-9d76-40f0-945e-37b873a15cb3 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:59.597552 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695c480-9d76-40f0-945e-37b873a15cb3 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:59.598884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 687/1361] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:48:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:48:59.604109 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d14e51-86bf-44b6-8b3a-ece3a796ae88 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:59.604538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d14e51-86bf-44b6-8b3a-ece3a796ae88 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:59.604658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d14e51-86bf-44b6-8b3a-ece3a796ae88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:59.625725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-22d14e51-86bf-44b6-8b3a-ece3a796ae88 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:59.626974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-22d14e51-86bf-44b6-8b3a-ece3a796ae88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:59.638464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 675/1362] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:59.686291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695c480-9d76-40f0-945e-37b873a15cb3 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:59.701371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695c480-9d76-40f0-945e-37b873a15cb3 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:59.706934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a72582-c601-49ca-8f3b-aa9f28c32a86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:59.707577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a72582-c601-49ca-8f3b-aa9f28c32a86 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:59.707862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a72582-c601-49ca-8f3b-aa9f28c32a86 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:59.708141 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a72582-c601-49ca-8f3b-aa9f28c32a86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:59.717312 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a72582-c601-49ca-8f3b-aa9f28c32a86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:59.718847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a72582-c601-49ca-8f3b-aa9f28c32a86 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:59.728873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 688/1363] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:02.497797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b33b-2afd-42a2-9932-c7aa7eb682b9 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:02.498302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b33b-2afd-42a2-9932-c7aa7eb682b9 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:02.498302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b33b-2afd-42a2-9932-c7aa7eb682b9 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:02.499655 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 676/1364] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:49:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:02.505000 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485570f8-48a2-4412-b8c7-ccb8c28677e8 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:02.505419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485570f8-48a2-4412-b8c7-ccb8c28677e8 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:02.505570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485570f8-48a2-4412-b8c7-ccb8c28677e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:02.524277 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-485570f8-48a2-4412-b8c7-ccb8c28677e8 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:02.525463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-485570f8-48a2-4412-b8c7-ccb8c28677e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:02.533414 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 689/1365] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:02.581347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06b7bb-4008-4f0c-bd46-1149dc4e27cd None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:02.581943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06b7bb-4008-4f0c-bd46-1149dc4e27cd None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:02.582550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06b7bb-4008-4f0c-bd46-1149dc4e27cd None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:02.584011 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 677/1366] 10.222.0.112 () {54 vars in 966 bytes} [Thu May 26 16:49:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:02.589676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328bc4b-ff98-4028-ad70-1a6f0fa2e41a None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:02.589967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328bc4b-ff98-4028-ad70-1a6f0fa2e41a None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:02.590251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328bc4b-ff98-4028-ad70-1a6f0fa2e41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:02.608810 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-2328bc4b-ff98-4028-ad70-1a6f0fa2e41a None None] MFA Rules not processed for user `5f2ec4c76f8f4d858bce53f30cc198fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:02.610008 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-2328bc4b-ff98-4028-ad70-1a6f0fa2e41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:02.620239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 690/1367] 10.222.0.112 () {58 vars in 1063 bytes} [Thu May 26 16:49:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:02.629698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06b7bb-4008-4f0c-bd46-1149dc4e27cd None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:02.648036 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06b7bb-4008-4f0c-bd46-1149dc4e27cd None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:02.654072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815a511-76aa-4ef6-85e8-db7a45a559d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:02.654851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815a511-76aa-4ef6-85e8-db7a45a559d6 service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:02.655140 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815a511-76aa-4ef6-85e8-db7a45a559d6 service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:02.655421 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815a511-76aa-4ef6-85e8-db7a45a559d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:02.663827 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815a511-76aa-4ef6-85e8-db7a45a559d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:02.665430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815a511-76aa-4ef6-85e8-db7a45a559d6 service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:02.675255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 678/1368] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:05.141361 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659eff1-8eea-41dd-a027-f421a19c5b18 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:05.142365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659eff1-8eea-41dd-a027-f421a19c5b18 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:05.142666 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659eff1-8eea-41dd-a027-f421a19c5b18 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:05.144113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 691/1369] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:49:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:05.149819 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b65eae-5b87-46ac-9033-23b3cc5ed15c None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:05.150350 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b65eae-5b87-46ac-9033-23b3cc5ed15c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:05.150439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b65eae-5b87-46ac-9033-23b3cc5ed15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:05.171866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-f5b65eae-5b87-46ac-9033-23b3cc5ed15c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:05.173617 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f5b65eae-5b87-46ac-9033-23b3cc5ed15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:05.184206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 679/1370] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:05.250029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287fc9b-2c1e-406c-aed8-1fefd884e4e6 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:05.250434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287fc9b-2c1e-406c-aed8-1fefd884e4e6 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:05.250630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287fc9b-2c1e-406c-aed8-1fefd884e4e6 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:05.254445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 692/1371] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:49:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:05.257723 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afc2da-da5d-423c-8c10-a3cc6364718a None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:05.258025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afc2da-da5d-423c-8c10-a3cc6364718a None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:05.258309 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afc2da-da5d-423c-8c10-a3cc6364718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:05.277474 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-10afc2da-da5d-423c-8c10-a3cc6364718a None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:05.279150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-10afc2da-da5d-423c-8c10-a3cc6364718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:05.287564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 680/1372] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:05.332847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287fc9b-2c1e-406c-aed8-1fefd884e4e6 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:05.348576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287fc9b-2c1e-406c-aed8-1fefd884e4e6 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:05.354067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac7fb0-fdfe-4f41-a2ed-f8b471774cb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:05.355350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac7fb0-fdfe-4f41-a2ed-f8b471774cb5 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:05.355785 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac7fb0-fdfe-4f41-a2ed-f8b471774cb5 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:05.356077 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac7fb0-fdfe-4f41-a2ed-f8b471774cb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:05.364932 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac7fb0-fdfe-4f41-a2ed-f8b471774cb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:05.366584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac7fb0-fdfe-4f41-a2ed-f8b471774cb5 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:05.377972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 693/1373] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:05.500183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a6a3c-6982-4e54-9b25-a84710568a08 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:05.500479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a6a3c-6982-4e54-9b25-a84710568a08 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:05.500945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a6a3c-6982-4e54-9b25-a84710568a08 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:05.502313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 681/1374] 10.222.0.112 () {54 vars in 968 bytes} [Thu May 26 16:49:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:05.508699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcc522-1b15-4806-876d-c1ce0ff34b6e None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:05.508990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcc522-1b15-4806-876d-c1ce0ff34b6e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:05.509266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcc522-1b15-4806-876d-c1ce0ff34b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:05.566314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e7bcc522-1b15-4806-876d-c1ce0ff34b6e None None] MFA Rules not processed for user `53822ebd38c94a729591cb270e0459ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:05.567581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e7bcc522-1b15-4806-876d-c1ce0ff34b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:05.588134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:05.648653 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 694/1375] 10.222.0.112 () {58 vars in 1065 bytes} [Thu May 26 16:49:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:05.657081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a6a3c-6982-4e54-9b25-a84710568a08 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:05.669189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a6a3c-6982-4e54-9b25-a84710568a08 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:05.673885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fbdf3-05fe-4934-b43c-dc71171eb41b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:05.674610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fbdf3-05fe-4934-b43c-dc71171eb41b service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:05.675170 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fbdf3-05fe-4934-b43c-dc71171eb41b service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:05.675524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fbdf3-05fe-4934-b43c-dc71171eb41b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:05.686735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fbdf3-05fe-4934-b43c-dc71171eb41b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:05.688257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fbdf3-05fe-4934-b43c-dc71171eb41b service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:05.699733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 682/1376] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:07.796874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb80e79-185e-4d82-a1a5-771c4db29e75 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:07.797394 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb80e79-185e-4d82-a1a5-771c4db29e75 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:07.797394 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb80e79-185e-4d82-a1a5-771c4db29e75 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:07.798741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 695/1377] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:49:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:07.804424 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e3251-770d-46d7-8470-06623c9467be None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:07.804887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e3251-770d-46d7-8470-06623c9467be None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:07.804986 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e3251-770d-46d7-8470-06623c9467be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:07.824792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-884e3251-770d-46d7-8470-06623c9467be None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:07.826017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-884e3251-770d-46d7-8470-06623c9467be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:07.834158 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 683/1378] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:07.879199 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb80e79-185e-4d82-a1a5-771c4db29e75 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:07.896295 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb80e79-185e-4d82-a1a5-771c4db29e75 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:07.902469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e614c1-52fe-488f-b07e-c9c1534bcd37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:07.903123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e614c1-52fe-488f-b07e-c9c1534bcd37 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:07.903502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e614c1-52fe-488f-b07e-c9c1534bcd37 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:07.903775 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e614c1-52fe-488f-b07e-c9c1534bcd37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:07.912825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e614c1-52fe-488f-b07e-c9c1534bcd37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:07.914434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e614c1-52fe-488f-b07e-c9c1534bcd37 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:07.925128 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 696/1379] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:10.485281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcc689-d1d7-41c8-80ba-cbe9b0484448 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:10.485871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcc689-d1d7-41c8-80ba-cbe9b0484448 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:10.485871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcc689-d1d7-41c8-80ba-cbe9b0484448 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:10.487250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 684/1380] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:49:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:10.492703 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0e57c-d8ec-4f34-8241-2ba92911c7c9 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:10.493139 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0e57c-d8ec-4f34-8241-2ba92911c7c9 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:10.493260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0e57c-d8ec-4f34-8241-2ba92911c7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:10.513984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-97c0e57c-d8ec-4f34-8241-2ba92911c7c9 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:10.515457 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-97c0e57c-d8ec-4f34-8241-2ba92911c7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:10.524271 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 697/1381] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:10.570270 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcc689-d1d7-41c8-80ba-cbe9b0484448 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:10.585766 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcc689-d1d7-41c8-80ba-cbe9b0484448 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:10.592127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf9a5f-0513-4734-b088-1bde7f1003fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:10.592774 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf9a5f-0513-4734-b088-1bde7f1003fc service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:10.593057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf9a5f-0513-4734-b088-1bde7f1003fc service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:10.593331 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf9a5f-0513-4734-b088-1bde7f1003fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:10.602214 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf9a5f-0513-4734-b088-1bde7f1003fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:10.603835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf9a5f-0513-4734-b088-1bde7f1003fc service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:10.615561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 685/1382] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:13.091984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd83818-5c2e-4c96-bd57-7c13706c327c None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:13.092931 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd83818-5c2e-4c96-bd57-7c13706c327c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:13.093325 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd83818-5c2e-4c96-bd57-7c13706c327c None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:13.095372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 698/1383] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:49:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:13.100714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dda053-b0c7-4338-bf2e-138c695c4c06 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:13.101201 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dda053-b0c7-4338-bf2e-138c695c4c06 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:13.101294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dda053-b0c7-4338-bf2e-138c695c4c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:13.121104 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-f1dda053-b0c7-4338-bf2e-138c695c4c06 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:13.122368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f1dda053-b0c7-4338-bf2e-138c695c4c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:13.130241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 686/1384] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:13.172346 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd83818-5c2e-4c96-bd57-7c13706c327c None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:13.188340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd83818-5c2e-4c96-bd57-7c13706c327c None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:13.194004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc17f83-3063-4ca3-b0e8-f86e7e9037ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:13.194695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17f83-3063-4ca3-b0e8-f86e7e9037ef service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:13.195175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17f83-3063-4ca3-b0e8-f86e7e9037ef service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:13.195603 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17f83-3063-4ca3-b0e8-f86e7e9037ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:13.211263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc17f83-3063-4ca3-b0e8-f86e7e9037ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:13.213035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc17f83-3063-4ca3-b0e8-f86e7e9037ef service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:13.224316 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 699/1385] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:15.753724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f9919-9266-4fbe-a175-9cdcd6dbc54b None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:15.754285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f9919-9266-4fbe-a175-9cdcd6dbc54b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:15.754285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f9919-9266-4fbe-a175-9cdcd6dbc54b None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:15.755707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 687/1386] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:49:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:15.763249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b30b4e-a4d9-456c-b5e1-a601ab0b6778 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:15.764168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b30b4e-a4d9-456c-b5e1-a601ab0b6778 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:15.764168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b30b4e-a4d9-456c-b5e1-a601ab0b6778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:15.782781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-d6b30b4e-a4d9-456c-b5e1-a601ab0b6778 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:15.786855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d6b30b4e-a4d9-456c-b5e1-a601ab0b6778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:15.792153 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 700/1387] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:15.849881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f9919-9266-4fbe-a175-9cdcd6dbc54b None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:15.865748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f9919-9266-4fbe-a175-9cdcd6dbc54b None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:15.871854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e1694-fe71-4edc-abc7-bafbcd50f800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:15.872533 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e1694-fe71-4edc-abc7-bafbcd50f800 service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:15.872824 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e1694-fe71-4edc-abc7-bafbcd50f800 service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:15.873112 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e1694-fe71-4edc-abc7-bafbcd50f800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:15.882646 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e1694-fe71-4edc-abc7-bafbcd50f800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:15.884343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e1694-fe71-4edc-abc7-bafbcd50f800 service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:15.895063 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 688/1388] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:19.078736 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2af51c-cd16-4bbe-a6d0-abd75e5bb373 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:19.079359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2af51c-cd16-4bbe-a6d0-abd75e5bb373 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:19.079498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2af51c-cd16-4bbe-a6d0-abd75e5bb373 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:19.081348 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 701/1389] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:49:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:49:19.087980 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1edf5d-5e04-4a0c-9918-80ef41c7934e None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:19.088584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1edf5d-5e04-4a0c-9918-80ef41c7934e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:19.088813 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1edf5d-5e04-4a0c-9918-80ef41c7934e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:19.106574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-ca1edf5d-5e04-4a0c-9918-80ef41c7934e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:19.107802 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-ca1edf5d-5e04-4a0c-9918-80ef41c7934e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:19.115816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 689/1390] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:19.175974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2af51c-cd16-4bbe-a6d0-abd75e5bb373 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:19.193300 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2af51c-cd16-4bbe-a6d0-abd75e5bb373 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:19.199985 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e2aa2-2fb2-4bc6-9cf0-76536897a57a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:19.200643 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e2aa2-2fb2-4bc6-9cf0-76536897a57a service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:19.201693 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e2aa2-2fb2-4bc6-9cf0-76536897a57a service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:19.201693 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e2aa2-2fb2-4bc6-9cf0-76536897a57a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:19.211010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e2aa2-2fb2-4bc6-9cf0-76536897a57a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:19.212811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e2aa2-2fb2-4bc6-9cf0-76536897a57a service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:19.224124 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 702/1391] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:21.825023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c92da-d2b2-4a1e-99df-ed2c269a76f6 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.825651 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c92da-d2b2-4a1e-99df-ed2c269a76f6 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.825651 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c92da-d2b2-4a1e-99df-ed2c269a76f6 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.826999 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 690/1392] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:49:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:21.832468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537c027-5770-4924-aa46-b133ea3b789c None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.832919 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537c027-5770-4924-aa46-b133ea3b789c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.833103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537c027-5770-4924-aa46-b133ea3b789c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.852425 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-8537c027-5770-4924-aa46-b133ea3b789c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:21.854246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8537c027-5770-4924-aa46-b133ea3b789c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:21.862144 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 703/1393] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:21.907787 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c92da-d2b2-4a1e-99df-ed2c269a76f6 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.916435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=49 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:21.923126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c92da-d2b2-4a1e-99df-ed2c269a76f6 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.928797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f744f2-dd57-4c1e-ab5d-61bb17be96dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.933219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f744f2-dd57-4c1e-ab5d-61bb17be96dd service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.933219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f744f2-dd57-4c1e-ab5d-61bb17be96dd service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.933219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f744f2-dd57-4c1e-ab5d-61bb17be96dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.939077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f744f2-dd57-4c1e-ab5d-61bb17be96dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.940670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f744f2-dd57-4c1e-ab5d-61bb17be96dd service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.951296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 691/1394] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:22.171755 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbabf4-7284-4312-9fa8-43342852141a None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.172056 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbabf4-7284-4312-9fa8-43342852141a None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.172341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbabf4-7284-4312-9fa8-43342852141a None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.173800 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 704/1395] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:49:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:22.180173 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c1d71-5a06-4dc3-9513-d4dee322390e None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.185396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c1d71-5a06-4dc3-9513-d4dee322390e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.185396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c1d71-5a06-4dc3-9513-d4dee322390e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.202065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-b01c1d71-5a06-4dc3-9513-d4dee322390e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:22.203446 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b01c1d71-5a06-4dc3-9513-d4dee322390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:22.212172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 692/1396] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:22.272602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a0e6-99dc-46d3-b1a9-07c7180d0cf4 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.275767 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a0e6-99dc-46d3-b1a9-07c7180d0cf4 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.275767 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a0e6-99dc-46d3-b1a9-07c7180d0cf4 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.275767 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 705/1397] 10.222.0.112 () {54 vars in 967 bytes} [Thu May 26 16:49:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:22.280977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949acd83-29de-4e3e-a594-34609c03dcf1 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.281275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949acd83-29de-4e3e-a594-34609c03dcf1 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.281553 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949acd83-29de-4e3e-a594-34609c03dcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.340028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-949acd83-29de-4e3e-a594-34609c03dcf1 None None] MFA Rules not processed for user `adf32c811ead4fd0b69c83890a56509d`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:22.341247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-949acd83-29de-4e3e-a594-34609c03dcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:22.406222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 693/1398] 10.222.0.112 () {58 vars in 1064 bytes} [Thu May 26 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:22.413945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290a0e6-99dc-46d3-b1a9-07c7180d0cf4 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.426685 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290a0e6-99dc-46d3-b1a9-07c7180d0cf4 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.430850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d83f0-d4c5-476c-9209-e28765ddda50 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf32c811ead4fd0b69c83890a56509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.431704 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d83f0-d4c5-476c-9209-e28765ddda50 service glance] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.432218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d83f0-d4c5-476c-9209-e28765ddda50 service glance] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.433044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d83f0-d4c5-476c-9209-e28765ddda50 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.442755 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d83f0-d4c5-476c-9209-e28765ddda50 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.444219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d83f0-d4c5-476c-9209-e28765ddda50 service glance] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.454591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 706/1399] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:23.342606 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7ee23-94d7-4760-9597-417666ccec27 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.343119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7ee23-94d7-4760-9597-417666ccec27 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.343233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7ee23-94d7-4760-9597-417666ccec27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.395066 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-1ec7ee23-94d7-4760-9597-417666ccec27 None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:23.396289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1ec7ee23-94d7-4760-9597-417666ccec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:23.467815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 694/1400] 10.222.0.112 () {58 vars in 1014 bytes} [Thu May 26 16:49:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:23.509650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181de77-1c8a-47cb-acc7-aa532745e9c5 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.510252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181de77-1c8a-47cb-acc7-aa532745e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.510252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181de77-1c8a-47cb-acc7-aa532745e9c5 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.511789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 707/1401] 10.222.0.112 () {54 vars in 947 bytes} [Thu May 26 16:49:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:23.518659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f77847-81cb-4812-a846-d46008d79bfb None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.518953 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f77847-81cb-4812-a846-d46008d79bfb None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.519233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f77847-81cb-4812-a846-d46008d79bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.567249 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:23.570573 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-e6f77847-81cb-4812-a846-d46008d79bfb None None] MFA Rules not processed for user `465b269fc6ee415b8f5715843468d089`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:23.571817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-e6f77847-81cb-4812-a846-d46008d79bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:23.646444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 695/1402] 10.222.0.112 () {58 vars in 1044 bytes} [Thu May 26 16:49:23 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:23.656686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181de77-1c8a-47cb-acc7-aa532745e9c5 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.675728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181de77-1c8a-47cb-acc7-aa532745e9c5 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.684068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb58391-65fb-44cc-92a4-4d31693526e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.685148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb58391-65fb-44cc-92a4-4d31693526e5 service swift] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.685671 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb58391-65fb-44cc-92a4-4d31693526e5 service swift] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.686115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb58391-65fb-44cc-92a4-4d31693526e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.694663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb58391-65fb-44cc-92a4-4d31693526e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.696452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb58391-65fb-44cc-92a4-4d31693526e5 service swift] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.706406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 708/1403] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 16:49:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:49:24.423197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adabc3-8cbd-410e-8d7f-302ad823e577 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.423788 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adabc3-8cbd-410e-8d7f-302ad823e577 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.423788 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adabc3-8cbd-410e-8d7f-302ad823e577 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.429298 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 696/1404] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:49:24 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:24.430967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ca3c-10e4-4bbd-bf23-3bec2561c05c None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.432101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ca3c-10e4-4bbd-bf23-3bec2561c05c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.432477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ca3c-10e4-4bbd-bf23-3bec2561c05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.452366 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-5040ca3c-10e4-4bbd-bf23-3bec2561c05c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:24.453896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5040ca3c-10e4-4bbd-bf23-3bec2561c05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:24.462308 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 709/1405] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:24.508988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adabc3-8cbd-410e-8d7f-302ad823e577 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.525115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adabc3-8cbd-410e-8d7f-302ad823e577 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:24.531836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f07ee-3627-4ba5-a492-2ff59c6c3e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:24.532732 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f07ee-3627-4ba5-a492-2ff59c6c3e09 service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.533236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f07ee-3627-4ba5-a492-2ff59c6c3e09 service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.533586 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f07ee-3627-4ba5-a492-2ff59c6c3e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.547538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f07ee-3627-4ba5-a492-2ff59c6c3e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:24.549638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f07ee-3627-4ba5-a492-2ff59c6c3e09 service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:24.561311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 697/1406] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:27.150852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c7b02-d819-479d-bca8-2b372afd9414 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:27.151407 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c7b02-d819-479d-bca8-2b372afd9414 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:27.151407 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c7b02-d819-479d-bca8-2b372afd9414 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:27.152930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 710/1407] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:49:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:27.158188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093fb00-7669-47bb-9ff2-f89d06871e19 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:27.158679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093fb00-7669-47bb-9ff2-f89d06871e19 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:27.160641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093fb00-7669-47bb-9ff2-f89d06871e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:27.180341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-2093fb00-7669-47bb-9ff2-f89d06871e19 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:27.181844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2093fb00-7669-47bb-9ff2-f89d06871e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:27.191326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 698/1408] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:27.236343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c7b02-d819-479d-bca8-2b372afd9414 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:27.252033 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c7b02-d819-479d-bca8-2b372afd9414 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:27.258721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584d6f2-aa08-4992-8b46-6c15ba416b5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:27.260129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584d6f2-aa08-4992-8b46-6c15ba416b5a service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:27.260418 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584d6f2-aa08-4992-8b46-6c15ba416b5a service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:27.260777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584d6f2-aa08-4992-8b46-6c15ba416b5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:27.270156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584d6f2-aa08-4992-8b46-6c15ba416b5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:27.271801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584d6f2-aa08-4992-8b46-6c15ba416b5a service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:27.286917 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 711/1409] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:37.175057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=39 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:37.278813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=68 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:49.655043 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e21830-dd68-4af9-8124-e50019017550 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:49.655582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e21830-dd68-4af9-8124-e50019017550 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:49.655582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e21830-dd68-4af9-8124-e50019017550 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:49.656979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 699/1410] 10.222.0.112 () {54 vars in 923 bytes} [Thu May 26 16:49:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:49.662154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56323b1-56a1-4464-8ffa-de353a80da0b None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:49.662623 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56323b1-56a1-4464-8ffa-de353a80da0b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:49.662756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56323b1-56a1-4464-8ffa-de353a80da0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:49.680927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-f56323b1-56a1-4464-8ffa-de353a80da0b None None] MFA Rules not processed for user `b415e7fca03e4602b3d711436d47f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:49.692340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-f56323b1-56a1-4464-8ffa-de353a80da0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:49.701449 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 712/1411] 10.222.0.112 () {58 vars in 1020 bytes} [Thu May 26 16:49:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:49.716580 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9efa-4619-460d-8f45-5408ac53fb51 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:49.716872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9efa-4619-460d-8f45-5408ac53fb51 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:49.717154 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9efa-4619-460d-8f45-5408ac53fb51 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:49.718871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 700/1412] 10.222.0.112 () {54 vars in 923 bytes} [Thu May 26 16:49:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:49.723600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc799f98-89d0-4397-b4fb-f7567ec64996 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:49.723894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc799f98-89d0-4397-b4fb-f7567ec64996 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:49.724176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc799f98-89d0-4397-b4fb-f7567ec64996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:49.742705 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-bc799f98-89d0-4397-b4fb-f7567ec64996 None None] MFA Rules not processed for user `5f2ec4c76f8f4d858bce53f30cc198fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:49.743906 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-bc799f98-89d0-4397-b4fb-f7567ec64996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:49.753048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 713/1413] 10.222.0.112 () {58 vars in 1020 bytes} [Thu May 26 16:49:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:52.518277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f243de4-1648-4f23-a5f9-afa176a1ca54 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:52.518867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f243de4-1648-4f23-a5f9-afa176a1ca54 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:52.518867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f243de4-1648-4f23-a5f9-afa176a1ca54 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:52.520267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:49:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:52.526035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc8da3-a57d-40b2-823a-735a8ffc505d None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:52.526537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc8da3-a57d-40b2-823a-735a8ffc505d None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:52.526642 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc8da3-a57d-40b2-823a-735a8ffc505d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:52.544731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-87cc8da3-a57d-40b2-823a-735a8ffc505d None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:52.545921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-87cc8da3-a57d-40b2-823a-735a8ffc505d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:52.554881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:52.596478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f243de4-1648-4f23-a5f9-afa176a1ca54 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:52.611915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f243de4-1648-4f23-a5f9-afa176a1ca54 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:52.618283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cf840-50f3-478b-b748-01d24f17e081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:52.618839 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cf840-50f3-478b-b748-01d24f17e081 service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:52.619073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cf840-50f3-478b-b748-01d24f17e081 service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:52.619502 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cf840-50f3-478b-b748-01d24f17e081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:52.637686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cf840-50f3-478b-b748-01d24f17e081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:52.639370 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cf840-50f3-478b-b748-01d24f17e081 service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:52.650563 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 702/1416] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:53.652572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2c65b-a4bc-48f7-b029-1be352d239ac None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:53.653120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2c65b-a4bc-48f7-b029-1be352d239ac None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:53.653120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2c65b-a4bc-48f7-b029-1be352d239ac None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:53.654581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:49:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:53.659623 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96812c50-e9d5-40c5-bd39-4b2fb5632e47 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:53.660064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96812c50-e9d5-40c5-bd39-4b2fb5632e47 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:53.660194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96812c50-e9d5-40c5-bd39-4b2fb5632e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:53.679286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-96812c50-e9d5-40c5-bd39-4b2fb5632e47 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:53.680711 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-96812c50-e9d5-40c5-bd39-4b2fb5632e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:53.688539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:53.845826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2c65b-a4bc-48f7-b029-1be352d239ac None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:53.861740 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2c65b-a4bc-48f7-b029-1be352d239ac None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:53.868255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae302207-f16f-4177-ab90-e8268ba1b628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:53.868897 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae302207-f16f-4177-ab90-e8268ba1b628 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:53.869201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae302207-f16f-4177-ab90-e8268ba1b628 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:53.869580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae302207-f16f-4177-ab90-e8268ba1b628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:53.878442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae302207-f16f-4177-ab90-e8268ba1b628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:53.880077 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae302207-f16f-4177-ab90-e8268ba1b628 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:53.890726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 716/1419] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:54.834024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4c583-04d2-457b-b08a-9d742c4447dc None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:54.834621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4c583-04d2-457b-b08a-9d742c4447dc None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:54.834621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4c583-04d2-457b-b08a-9d742c4447dc None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:54.836741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:49:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:54.841953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d169ac-4cc2-4a2d-a245-006615cf1d8e None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:54.842440 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d169ac-4cc2-4a2d-a245-006615cf1d8e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:54.842627 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d169ac-4cc2-4a2d-a245-006615cf1d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:54.861843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-31d169ac-4cc2-4a2d-a245-006615cf1d8e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:54.863071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-31d169ac-4cc2-4a2d-a245-006615cf1d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:54.871181 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:55.046392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4c583-04d2-457b-b08a-9d742c4447dc None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:55.062233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4c583-04d2-457b-b08a-9d742c4447dc None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:55.068212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd18122-9213-435b-95a8-0378f9e20395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:55.070243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd18122-9213-435b-95a8-0378f9e20395 service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:55.070243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd18122-9213-435b-95a8-0378f9e20395 service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:55.071019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd18122-9213-435b-95a8-0378f9e20395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:55.080155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd18122-9213-435b-95a8-0378f9e20395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:55.081759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd18122-9213-435b-95a8-0378f9e20395 service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:55.092259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 705/1422] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:56.017710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ea89-7926-4082-a1f4-56d7e3c2d9dd None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:56.018313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ea89-7926-4082-a1f4-56d7e3c2d9dd None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:56.018313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ea89-7926-4082-a1f4-56d7e3c2d9dd None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:56.019715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:49:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:56.025643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0e4e3-915e-44e3-b93f-661c1cfbc58d None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:56.026098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0e4e3-915e-44e3-b93f-661c1cfbc58d None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:56.026212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0e4e3-915e-44e3-b93f-661c1cfbc58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:56.044617 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-8be0e4e3-915e-44e3-b93f-661c1cfbc58d None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:56.045804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8be0e4e3-915e-44e3-b93f-661c1cfbc58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:56.053816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:56.208184 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30ea89-7926-4082-a1f4-56d7e3c2d9dd None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:56.225528 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30ea89-7926-4082-a1f4-56d7e3c2d9dd None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:56.230893 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44fb91-155d-4070-ab8c-7b267b24a52e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:56.231522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44fb91-155d-4070-ab8c-7b267b24a52e service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:56.231802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44fb91-155d-4070-ab8c-7b267b24a52e service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:56.232075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44fb91-155d-4070-ab8c-7b267b24a52e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:56.240646 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44fb91-155d-4070-ab8c-7b267b24a52e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:56.242317 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44fb91-155d-4070-ab8c-7b267b24a52e service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:56.252095 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 719/1425] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:57.195223 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bad299-70e8-40ca-853d-8cb7398f5b9a None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:57.195802 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bad299-70e8-40ca-853d-8cb7398f5b9a None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:57.195802 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bad299-70e8-40ca-853d-8cb7398f5b9a None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:57.197200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:49:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:57.202518 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d67a3b-0802-4ff5-b2be-a287176ee8ed None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:57.202973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d67a3b-0802-4ff5-b2be-a287176ee8ed None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:57.203081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d67a3b-0802-4ff5-b2be-a287176ee8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:57.221756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-77d67a3b-0802-4ff5-b2be-a287176ee8ed None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:57.223061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-77d67a3b-0802-4ff5-b2be-a287176ee8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:57.231606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:57.383761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bad299-70e8-40ca-853d-8cb7398f5b9a None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:57.399096 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bad299-70e8-40ca-853d-8cb7398f5b9a None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:57.404734 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec234383-e7af-4fa3-be1a-82593e50ae8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:57.405402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec234383-e7af-4fa3-be1a-82593e50ae8a service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:57.405692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec234383-e7af-4fa3-be1a-82593e50ae8a service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:57.405970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec234383-e7af-4fa3-be1a-82593e50ae8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:57.415038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec234383-e7af-4fa3-be1a-82593e50ae8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:57.417147 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec234383-e7af-4fa3-be1a-82593e50ae8a service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:57.427914 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 708/1428] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:58.383125 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9da96-fbaf-4d33-aef0-5c108e6c1044 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:58.383700 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9da96-fbaf-4d33-aef0-5c108e6c1044 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:58.383700 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9da96-fbaf-4d33-aef0-5c108e6c1044 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:58.385197 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:49:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:58.390182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0da21d-f883-438b-8af2-dc88a249e696 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:58.390661 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0da21d-f883-438b-8af2-dc88a249e696 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:58.390773 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0da21d-f883-438b-8af2-dc88a249e696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:58.409343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-1f0da21d-f883-438b-8af2-dc88a249e696 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:58.410586 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1f0da21d-f883-438b-8af2-dc88a249e696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:58.418671 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:58.574584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9da96-fbaf-4d33-aef0-5c108e6c1044 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:58.590404 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9da96-fbaf-4d33-aef0-5c108e6c1044 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:58.596260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c68009-ee59-4b10-9e28-fa0ea5e8a5e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:58.596941 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c68009-ee59-4b10-9e28-fa0ea5e8a5e2 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:58.597250 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c68009-ee59-4b10-9e28-fa0ea5e8a5e2 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:58.597527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c68009-ee59-4b10-9e28-fa0ea5e8a5e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:58.606413 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c68009-ee59-4b10-9e28-fa0ea5e8a5e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:58.607993 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c68009-ee59-4b10-9e28-fa0ea5e8a5e2 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:58.617411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 722/1431] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:59.565400 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fa648-6ff2-4efe-b30a-d325374c0554 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:59.565934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fa648-6ff2-4efe-b30a-d325374c0554 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:59.566027 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fa648-6ff2-4efe-b30a-d325374c0554 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:59.567427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:49:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:49:59.572435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa96fb-52f3-49b7-bf05-106bbad44501 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:59.572883 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa96fb-52f3-49b7-bf05-106bbad44501 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:59.572992 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa96fb-52f3-49b7-bf05-106bbad44501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:59.591378 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-d4aa96fb-52f3-49b7-bf05-106bbad44501 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:59.592582 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d4aa96fb-52f3-49b7-bf05-106bbad44501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:59.601015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:59.752390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fa648-6ff2-4efe-b30a-d325374c0554 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:59.772283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fa648-6ff2-4efe-b30a-d325374c0554 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:59.778401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56146c46-4357-4bda-8295-bc32f42ba0cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:59.779061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56146c46-4357-4bda-8295-bc32f42ba0cf service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:59.779352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56146c46-4357-4bda-8295-bc32f42ba0cf service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:59.779625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56146c46-4357-4bda-8295-bc32f42ba0cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:59.793698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56146c46-4357-4bda-8295-bc32f42ba0cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:59.795341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56146c46-4357-4bda-8295-bc32f42ba0cf service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:59.805718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 711/1434] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:00.745914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530be62-4f40-457a-8987-0c0020ec6478 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:00.746507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530be62-4f40-457a-8987-0c0020ec6478 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:00.746507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530be62-4f40-457a-8987-0c0020ec6478 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:00.747876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:50:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:50:00.752907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee9210-4ff8-4bdb-98e9-574cf5839f16 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:00.753447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee9210-4ff8-4bdb-98e9-574cf5839f16 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:00.753549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee9210-4ff8-4bdb-98e9-574cf5839f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:00.773161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-75ee9210-4ff8-4bdb-98e9-574cf5839f16 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:00.774421 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-75ee9210-4ff8-4bdb-98e9-574cf5839f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:00.782222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:00.948200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530be62-4f40-457a-8987-0c0020ec6478 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:00.963061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530be62-4f40-457a-8987-0c0020ec6478 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:00.968554 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e78b14-a9cb-4a2a-9d73-8c3014638416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:00.969193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e78b14-a9cb-4a2a-9d73-8c3014638416 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:00.969479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e78b14-a9cb-4a2a-9d73-8c3014638416 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:00.969757 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e78b14-a9cb-4a2a-9d73-8c3014638416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:00.978400 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e78b14-a9cb-4a2a-9d73-8c3014638416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:00.979979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e78b14-a9cb-4a2a-9d73-8c3014638416 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:00.989916 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 725/1437] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:01.935229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a490242-2798-4529-878b-1da2e7960c67 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:01.935773 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a490242-2798-4529-878b-1da2e7960c67 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:01.935773 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a490242-2798-4529-878b-1da2e7960c67 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:01.937181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:50:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:50:01.942214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc921e-d306-4d36-86bb-78c3b7e21dcd None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:01.942666 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc921e-d306-4d36-86bb-78c3b7e21dcd None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:01.942813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc921e-d306-4d36-86bb-78c3b7e21dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:01.963072 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-bfdc921e-d306-4d36-86bb-78c3b7e21dcd None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:01.964337 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-bfdc921e-d306-4d36-86bb-78c3b7e21dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:01.972067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:02.122619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a490242-2798-4529-878b-1da2e7960c67 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:02.138313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a490242-2798-4529-878b-1da2e7960c67 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:02.143619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec27e73-971b-45b6-b6db-a8c1434c1b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:02.144272 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec27e73-971b-45b6-b6db-a8c1434c1b18 service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:02.144559 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec27e73-971b-45b6-b6db-a8c1434c1b18 service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:02.144839 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec27e73-971b-45b6-b6db-a8c1434c1b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:02.154596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec27e73-971b-45b6-b6db-a8c1434c1b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:02.156188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec27e73-971b-45b6-b6db-a8c1434c1b18 service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:02.166647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 714/1440] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:04.241972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b68429-855b-44f6-8394-0c045142cae3 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:04.242545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b68429-855b-44f6-8394-0c045142cae3 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:04.242545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b68429-855b-44f6-8394-0c045142cae3 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:04.243909 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:50:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:50:04.249255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e50d85-ac51-4f98-8912-6769dbdb79e8 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:04.249675 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e50d85-ac51-4f98-8912-6769dbdb79e8 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:04.249848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e50d85-ac51-4f98-8912-6769dbdb79e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:04.268055 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-f7e50d85-ac51-4f98-8912-6769dbdb79e8 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:04.269266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f7e50d85-ac51-4f98-8912-6769dbdb79e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:04.278001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:04.316832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b68429-855b-44f6-8394-0c045142cae3 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:04.327928 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b68429-855b-44f6-8394-0c045142cae3 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:04.331424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d937fb-079d-454b-a271-5320981652f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:04.332052 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d937fb-079d-454b-a271-5320981652f0 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:04.332333 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d937fb-079d-454b-a271-5320981652f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:04.332616 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d937fb-079d-454b-a271-5320981652f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:04.342131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d937fb-079d-454b-a271-5320981652f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:04.343583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d937fb-079d-454b-a271-5320981652f0 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:04.353608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 728/1443] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:06.747669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833432a0-b9ab-4d96-b828-989e45a8d77f None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:06.748264 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833432a0-b9ab-4d96-b828-989e45a8d77f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:06.748264 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833432a0-b9ab-4d96-b828-989e45a8d77f None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:06.749624 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:50:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:50:06.755060 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fd73b-c417-4aec-8b88-e48326721bf0 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:06.755538 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fd73b-c417-4aec-8b88-e48326721bf0 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:06.755652 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fd73b-c417-4aec-8b88-e48326721bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:06.773641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-aa7fd73b-c417-4aec-8b88-e48326721bf0 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:06.774921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-aa7fd73b-c417-4aec-8b88-e48326721bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:06.782903 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:06.822954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833432a0-b9ab-4d96-b828-989e45a8d77f None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:06.833841 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833432a0-b9ab-4d96-b828-989e45a8d77f None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:06.837625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c51bab-a87d-42ab-bee5-2fb85cec047d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:06.838396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c51bab-a87d-42ab-bee5-2fb85cec047d service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:06.838693 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c51bab-a87d-42ab-bee5-2fb85cec047d service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:06.838979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c51bab-a87d-42ab-bee5-2fb85cec047d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:06.847930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c51bab-a87d-42ab-bee5-2fb85cec047d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:06.850156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c51bab-a87d-42ab-bee5-2fb85cec047d service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:06.860234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 717/1446] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:09.621827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce905bf9-0f93-4feb-8b82-80fd37a6fe2b None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:09.622450 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce905bf9-0f93-4feb-8b82-80fd37a6fe2b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:09.622628 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce905bf9-0f93-4feb-8b82-80fd37a6fe2b None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:09.624003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:50:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:50:09.629427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488f97d-c308-458c-a068-47e9c06b4b67 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:09.629894 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488f97d-c308-458c-a068-47e9c06b4b67 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:09.630004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488f97d-c308-458c-a068-47e9c06b4b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:09.649392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-3488f97d-c308-458c-a068-47e9c06b4b67 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:09.650630 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-3488f97d-c308-458c-a068-47e9c06b4b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:09.658339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:09.698241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce905bf9-0f93-4feb-8b82-80fd37a6fe2b None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:09.709480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce905bf9-0f93-4feb-8b82-80fd37a6fe2b None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:09.713185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c87241-9741-40d7-b812-1a93a3d1d728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:09.713856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c87241-9741-40d7-b812-1a93a3d1d728 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:09.714144 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c87241-9741-40d7-b812-1a93a3d1d728 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:09.714461 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c87241-9741-40d7-b812-1a93a3d1d728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:09.723614 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c87241-9741-40d7-b812-1a93a3d1d728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:09.725585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c87241-9741-40d7-b812-1a93a3d1d728 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:09.735294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 731/1449] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:12.103688 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6a566-1b41-4667-844f-8aa9cf1e66e1 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:12.104288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6a566-1b41-4667-844f-8aa9cf1e66e1 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:12.104288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6a566-1b41-4667-844f-8aa9cf1e66e1 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:12.105638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:50:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:50:12.111082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2cfac-110d-447d-976d-dfd62b7acd46 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:12.111488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2cfac-110d-447d-976d-dfd62b7acd46 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:12.111635 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2cfac-110d-447d-976d-dfd62b7acd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:12.130142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-ccf2cfac-110d-447d-976d-dfd62b7acd46 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:12.131828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ccf2cfac-110d-447d-976d-dfd62b7acd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:12.139562 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:12.179778 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6a566-1b41-4667-844f-8aa9cf1e66e1 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:12.190541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6a566-1b41-4667-844f-8aa9cf1e66e1 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:12.194239 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0c34c-4491-4c56-aa78-70683206c830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:12.194923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0c34c-4491-4c56-aa78-70683206c830 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:12.195216 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0c34c-4491-4c56-aa78-70683206c830 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:12.195500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0c34c-4491-4c56-aa78-70683206c830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:12.205183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0c34c-4491-4c56-aa78-70683206c830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:12.206665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0c34c-4491-4c56-aa78-70683206c830 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:12.217144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 720/1452] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:14.561481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ac4ec-2f12-4aef-909d-0ec6dcba5ec4 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:14.562023 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ac4ec-2f12-4aef-909d-0ec6dcba5ec4 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:14.562023 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ac4ec-2f12-4aef-909d-0ec6dcba5ec4 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:14.563349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:50:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:50:14.569567 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56046f-cfe6-4375-a2bd-ab480e8d3a54 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:14.570006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56046f-cfe6-4375-a2bd-ab480e8d3a54 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:14.570114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56046f-cfe6-4375-a2bd-ab480e8d3a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:14.588059 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-fe56046f-cfe6-4375-a2bd-ab480e8d3a54 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:14.589391 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-fe56046f-cfe6-4375-a2bd-ab480e8d3a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:14.597266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:14.636178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ac4ec-2f12-4aef-909d-0ec6dcba5ec4 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:14.647190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ac4ec-2f12-4aef-909d-0ec6dcba5ec4 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:14.650703 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcc95f-5c6e-42c0-a63d-2f2007d2cde9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:14.651335 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcc95f-5c6e-42c0-a63d-2f2007d2cde9 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:14.651624 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcc95f-5c6e-42c0-a63d-2f2007d2cde9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:14.651902 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcc95f-5c6e-42c0-a63d-2f2007d2cde9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:14.660731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcc95f-5c6e-42c0-a63d-2f2007d2cde9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:14.662453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcc95f-5c6e-42c0-a63d-2f2007d2cde9 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:14.672648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 734/1455] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:50:16.978513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2f73e-20db-4574-a051-bf1db30989ea None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:16.979057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2f73e-20db-4574-a051-bf1db30989ea None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:16.979182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2f73e-20db-4574-a051-bf1db30989ea None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:16.980536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:50:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:50:16.985969 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac429a-871c-4683-8d0e-0ff8a8ae1d74 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:16.986434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac429a-871c-4683-8d0e-0ff8a8ae1d74 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:16.986558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac429a-871c-4683-8d0e-0ff8a8ae1d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:17.005829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-c2ac429a-871c-4683-8d0e-0ff8a8ae1d74 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:17.008070 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c2ac429a-871c-4683-8d0e-0ff8a8ae1d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:17.014457 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:17.052664 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2f73e-20db-4574-a051-bf1db30989ea None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:17.063350 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2f73e-20db-4574-a051-bf1db30989ea None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:17.067066 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b04a1-2b4c-4c94-9aac-a37216e07c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:17.068844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b04a1-2b4c-4c94-9aac-a37216e07c62 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:17.069129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b04a1-2b4c-4c94-9aac-a37216e07c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:17.069406 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b04a1-2b4c-4c94-9aac-a37216e07c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:17.078462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b04a1-2b4c-4c94-9aac-a37216e07c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:17.079932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b04a1-2b4c-4c94-9aac-a37216e07c62 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:17.090532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 723/1458] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:19.435071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3c7d3-071e-4303-b3b1-ed3938f68e87 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:19.435605 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3c7d3-071e-4303-b3b1-ed3938f68e87 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:19.435761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3c7d3-071e-4303-b3b1-ed3938f68e87 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:19.437071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:50:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:50:19.442635 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f4a1c-0162-4477-94c8-48a7b271330d None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:19.443178 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f4a1c-0162-4477-94c8-48a7b271330d None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:19.443178 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f4a1c-0162-4477-94c8-48a7b271330d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:19.449374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=70 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:19.465619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-337f4a1c-0162-4477-94c8-48a7b271330d None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:19.465619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-337f4a1c-0162-4477-94c8-48a7b271330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:19.471013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:19.509608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3c7d3-071e-4303-b3b1-ed3938f68e87 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:19.515033 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=73 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:19.521730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3c7d3-071e-4303-b3b1-ed3938f68e87 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:19.525350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f1f61-133a-4556-8bec-77d0dc60d0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:19.528757 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f1f61-133a-4556-8bec-77d0dc60d0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:19.528757 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f1f61-133a-4556-8bec-77d0dc60d0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:19.528757 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f1f61-133a-4556-8bec-77d0dc60d0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:19.536629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f1f61-133a-4556-8bec-77d0dc60d0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:19.537995 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f1f61-133a-4556-8bec-77d0dc60d0f9 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:19.548560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 737/1461] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:21.835665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0764c-aa73-4eab-b078-018c16d0858e None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:21.836259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0764c-aa73-4eab-b078-018c16d0858e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:21.836259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0764c-aa73-4eab-b078-018c16d0858e None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:21.837681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:50:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:50:21.843214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ded066-3921-494f-b32c-848b3d8c5318 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:21.843626 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ded066-3921-494f-b32c-848b3d8c5318 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:21.843774 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ded066-3921-494f-b32c-848b3d8c5318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:21.861905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-25ded066-3921-494f-b32c-848b3d8c5318 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:21.863200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-25ded066-3921-494f-b32c-848b3d8c5318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:21.871397 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:21.908729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0764c-aa73-4eab-b078-018c16d0858e None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:21.920163 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0764c-aa73-4eab-b078-018c16d0858e None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:21.923670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab75b04-dae0-4313-a1bb-f25357eb5090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:21.924322 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab75b04-dae0-4313-a1bb-f25357eb5090 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:21.924610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab75b04-dae0-4313-a1bb-f25357eb5090 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:21.924889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab75b04-dae0-4313-a1bb-f25357eb5090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:21.934508 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab75b04-dae0-4313-a1bb-f25357eb5090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:21.935991 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab75b04-dae0-4313-a1bb-f25357eb5090 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:21.947065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 726/1464] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:24.224807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192b5a9-dc31-40cc-9323-38925a609ce0 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:24.225370 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192b5a9-dc31-40cc-9323-38925a609ce0 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:24.225370 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192b5a9-dc31-40cc-9323-38925a609ce0 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:24.226779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:50:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:50:24.232630 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1def87-6746-49e5-8271-29c9afb4d3c6 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:24.233107 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1def87-6746-49e5-8271-29c9afb4d3c6 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:24.233226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1def87-6746-49e5-8271-29c9afb4d3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:24.251665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-1e1def87-6746-49e5-8271-29c9afb4d3c6 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:24.252852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1e1def87-6746-49e5-8271-29c9afb4d3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:24.261222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:24.299501 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192b5a9-dc31-40cc-9323-38925a609ce0 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:24.310831 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192b5a9-dc31-40cc-9323-38925a609ce0 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:24.314463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529f6f8-b316-4cc9-a59b-654e5e71a9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:24.315102 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529f6f8-b316-4cc9-a59b-654e5e71a9cb service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:24.315499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529f6f8-b316-4cc9-a59b-654e5e71a9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:24.315781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529f6f8-b316-4cc9-a59b-654e5e71a9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:24.325802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529f6f8-b316-4cc9-a59b-654e5e71a9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:24.327548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529f6f8-b316-4cc9-a59b-654e5e71a9cb service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:24.338066 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 740/1467] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:26.785208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f16d4-477d-4a84-98cd-97382fe00020 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:26.785848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f16d4-477d-4a84-98cd-97382fe00020 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:26.785848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f16d4-477d-4a84-98cd-97382fe00020 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:26.787193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:50:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:50:26.792935 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d8dfa-f663-4fd1-b234-61cffff1a181 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:26.793522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d8dfa-f663-4fd1-b234-61cffff1a181 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:26.793884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d8dfa-f663-4fd1-b234-61cffff1a181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:26.812990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e55d8dfa-f663-4fd1-b234-61cffff1a181 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:26.814273 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e55d8dfa-f663-4fd1-b234-61cffff1a181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:26.823186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:26.861343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f16d4-477d-4a84-98cd-97382fe00020 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:26.873665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f16d4-477d-4a84-98cd-97382fe00020 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:26.889902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8425b8b-9c00-4e05-9b24-ed2714c76ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:26.889902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8425b8b-9c00-4e05-9b24-ed2714c76ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:26.889902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8425b8b-9c00-4e05-9b24-ed2714c76ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:26.889902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8425b8b-9c00-4e05-9b24-ed2714c76ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:26.890350 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8425b8b-9c00-4e05-9b24-ed2714c76ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:26.890350 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8425b8b-9c00-4e05-9b24-ed2714c76ed4 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:26.900187 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 729/1470] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:36.807600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=17 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:36.895546 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=17 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:01.125139 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e46a-4662-41ce-b71a-a236ce4909ff None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:01.125766 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e46a-4662-41ce-b71a-a236ce4909ff None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:01.125766 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e46a-4662-41ce-b71a-a236ce4909ff None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:01.127167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 742/1471] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:51:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:51:01.132564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b01be5-6b34-4717-ab64-8d603cb15331 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:01.132990 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b01be5-6b34-4717-ab64-8d603cb15331 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:01.133139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b01be5-6b34-4717-ab64-8d603cb15331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:01.151293 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-31b01be5-6b34-4717-ab64-8d603cb15331 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:01.152499 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-31b01be5-6b34-4717-ab64-8d603cb15331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:01.161054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 730/1472] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:51:01.208451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5b259-9f5a-4206-a869-cd4a07c20003 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:01.208743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5b259-9f5a-4206-a869-cd4a07c20003 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:01.209023 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5b259-9f5a-4206-a869-cd4a07c20003 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:01.210563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 743/1473] 10.222.0.112 () {54 vars in 967 bytes} [Thu May 26 16:51:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:51:01.215434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731455b-6a35-4215-ae6c-2f92be432cb3 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:01.215728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731455b-6a35-4215-ae6c-2f92be432cb3 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:01.216010 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731455b-6a35-4215-ae6c-2f92be432cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:01.235279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-0731455b-6a35-4215-ae6c-2f92be432cb3 None None] MFA Rules not processed for user `adf32c811ead4fd0b69c83890a56509d`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:01.236476 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0731455b-6a35-4215-ae6c-2f92be432cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:01.242988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 731/1474] 10.222.0.112 () {58 vars in 1064 bytes} [Thu May 26 16:51:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:01.250334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5b259-9f5a-4206-a869-cd4a07c20003 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:01.261220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5b259-9f5a-4206-a869-cd4a07c20003 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:01.264749 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f159a8-006a-44c1-bbdb-a4a4d813d2cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf32c811ead4fd0b69c83890a56509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:01.265384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f159a8-006a-44c1-bbdb-a4a4d813d2cb service glance] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:01.265669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f159a8-006a-44c1-bbdb-a4a4d813d2cb service glance] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:01.265963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f159a8-006a-44c1-bbdb-a4a4d813d2cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:01.275593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f159a8-006a-44c1-bbdb-a4a4d813d2cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:01.277008 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f159a8-006a-44c1-bbdb-a4a4d813d2cb service glance] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:01.287003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 744/1475] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:03.654177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928fc68-e30b-4e54-93fc-9f2074950346 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:03.654764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928fc68-e30b-4e54-93fc-9f2074950346 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:03.654764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928fc68-e30b-4e54-93fc-9f2074950346 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:03.656160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 732/1476] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:51:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:51:03.662432 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14a64b-4e7f-4e2d-8cc5-40b729c33daf None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:03.662846 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14a64b-4e7f-4e2d-8cc5-40b729c33daf None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:03.662998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14a64b-4e7f-4e2d-8cc5-40b729c33daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:03.681714 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-ef14a64b-4e7f-4e2d-8cc5-40b729c33daf None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:03.682944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ef14a64b-4e7f-4e2d-8cc5-40b729c33daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:03.691267 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 745/1477] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:03.715568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928fc68-e30b-4e54-93fc-9f2074950346 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:03.728641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928fc68-e30b-4e54-93fc-9f2074950346 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:03.733085 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df77b8-f0ef-4cd8-9a6b-e41e9c3a7b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:03.733735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df77b8-f0ef-4cd8-9a6b-e41e9c3a7b38 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:03.734025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df77b8-f0ef-4cd8-9a6b-e41e9c3a7b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:03.734307 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df77b8-f0ef-4cd8-9a6b-e41e9c3a7b38 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:03.735742 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df77b8-f0ef-4cd8-9a6b-e41e9c3a7b38 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:03.737826 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: WARNING py.warnings [None req-a8df77b8-f0ef-4cd8-9a6b-e41e9c3a7b38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:51:03.737826 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: warnings.warn(msg) May 26 16:51:03.737826 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: May 26 16:51:03.739101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df77b8-f0ef-4cd8-9a6b-e41e9c3a7b38 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:03.758087 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 733/1478] 10.222.0.112 () {56 vars in 1113 bytes} [Thu May 26 16:51:03 2022] GET /identity/v3/projects => generated 2562 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:51:06.073340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44b109-8c00-4660-9aff-aeea719a9da5 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:06.073907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44b109-8c00-4660-9aff-aeea719a9da5 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:06.073907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44b109-8c00-4660-9aff-aeea719a9da5 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:06.075369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 746/1479] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:51:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:51:06.081447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2749f-0955-4705-a494-02fea022d813 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:06.081886 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2749f-0955-4705-a494-02fea022d813 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:06.082058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2749f-0955-4705-a494-02fea022d813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:06.100400 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-35e2749f-0955-4705-a494-02fea022d813 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:06.101613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-35e2749f-0955-4705-a494-02fea022d813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:06.109436 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 734/1480] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:06.153075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44b109-8c00-4660-9aff-aeea719a9da5 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:06.167173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44b109-8c00-4660-9aff-aeea719a9da5 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:06.172401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6877f59-19ee-4923-9b31-98c4c66dd7a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:06.173382 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6877f59-19ee-4923-9b31-98c4c66dd7a0 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:06.173661 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6877f59-19ee-4923-9b31-98c4c66dd7a0 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:06.173936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6877f59-19ee-4923-9b31-98c4c66dd7a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:06.182065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6877f59-19ee-4923-9b31-98c4c66dd7a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:06.183688 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6877f59-19ee-4923-9b31-98c4c66dd7a0 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:06.194076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 747/1481] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:08.592694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f232-9261-4670-85a4-48694fc4bc7f None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:08.593220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f232-9261-4670-85a4-48694fc4bc7f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:08.593220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f232-9261-4670-85a4-48694fc4bc7f None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:08.594984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 735/1482] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:51:08 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:51:08.600252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13b7f9-1497-4b8c-a736-6fc811721602 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:08.600655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13b7f9-1497-4b8c-a736-6fc811721602 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:08.600810 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13b7f9-1497-4b8c-a736-6fc811721602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:08.619317 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-cf13b7f9-1497-4b8c-a736-6fc811721602 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:08.620502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-cf13b7f9-1497-4b8c-a736-6fc811721602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:08.629621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 748/1483] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:08.665032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49f232-9261-4670-85a4-48694fc4bc7f None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:08.677073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49f232-9261-4670-85a4-48694fc4bc7f None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:08.680555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e1194-f793-4d0b-b7f5-36b6acb021cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:08.681191 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e1194-f793-4d0b-b7f5-36b6acb021cf service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:08.681481 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e1194-f793-4d0b-b7f5-36b6acb021cf service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:08.681760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e1194-f793-4d0b-b7f5-36b6acb021cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:08.691790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e1194-f793-4d0b-b7f5-36b6acb021cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:08.693231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e1194-f793-4d0b-b7f5-36b6acb021cf service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:08.702938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 736/1484] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:11.039955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f13d9b-9a61-4a8d-9cec-b2817278d7ef None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:11.040579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f13d9b-9a61-4a8d-9cec-b2817278d7ef None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:11.040579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f13d9b-9a61-4a8d-9cec-b2817278d7ef None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:11.041908 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 749/1485] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:51:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:51:11.047272 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca9397-984d-4cf0-84e9-466232700e07 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:11.047969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca9397-984d-4cf0-84e9-466232700e07 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:11.048082 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca9397-984d-4cf0-84e9-466232700e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:11.068028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-eeca9397-984d-4cf0-84e9-466232700e07 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:11.069214 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-eeca9397-984d-4cf0-84e9-466232700e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:11.077304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 737/1486] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:11.115847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f13d9b-9a61-4a8d-9cec-b2817278d7ef None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:11.127050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f13d9b-9a61-4a8d-9cec-b2817278d7ef None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:11.130617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5031c-fae4-4625-9fe6-9b54cfbc056b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:11.131251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5031c-fae4-4625-9fe6-9b54cfbc056b service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:11.131545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5031c-fae4-4625-9fe6-9b54cfbc056b service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:11.131819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5031c-fae4-4625-9fe6-9b54cfbc056b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:11.141540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5031c-fae4-4625-9fe6-9b54cfbc056b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:11.143007 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5031c-fae4-4625-9fe6-9b54cfbc056b service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:11.152863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 750/1487] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:51:13.542966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3494e-e90d-41e3-a359-3c17d7138d7c None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:13.543557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3494e-e90d-41e3-a359-3c17d7138d7c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:13.543557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3494e-e90d-41e3-a359-3c17d7138d7c None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:13.544810 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 738/1488] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:51:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:51:13.550472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dff00-8abb-4bb9-af04-30240db1af06 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:13.550911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dff00-8abb-4bb9-af04-30240db1af06 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:13.551015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dff00-8abb-4bb9-af04-30240db1af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:13.569935 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-498dff00-8abb-4bb9-af04-30240db1af06 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:13.571174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-498dff00-8abb-4bb9-af04-30240db1af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:13.579957 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 751/1489] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:13.619371 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3494e-e90d-41e3-a359-3c17d7138d7c None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:13.630781 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3494e-e90d-41e3-a359-3c17d7138d7c None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:13.634288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87a5bb-91e8-4e64-90cc-c88441fd6392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:13.634957 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87a5bb-91e8-4e64-90cc-c88441fd6392 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:13.635252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87a5bb-91e8-4e64-90cc-c88441fd6392 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:13.635530 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87a5bb-91e8-4e64-90cc-c88441fd6392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:13.645295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87a5bb-91e8-4e64-90cc-c88441fd6392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:13.646799 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87a5bb-91e8-4e64-90cc-c88441fd6392 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:13.656202 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 739/1490] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:16.388691 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5500ee-3e55-4a3f-969d-2c3091ede2e0 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:16.389246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5500ee-3e55-4a3f-969d-2c3091ede2e0 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:16.389246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5500ee-3e55-4a3f-969d-2c3091ede2e0 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:16.390792 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 752/1491] 10.222.0.112 () {54 vars in 931 bytes} [Thu May 26 16:51:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:51:16.396461 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc51e6d-1e11-4175-9925-581106996e0c None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:16.396976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc51e6d-1e11-4175-9925-581106996e0c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:16.397099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc51e6d-1e11-4175-9925-581106996e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:16.415560 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-3fc51e6d-1e11-4175-9925-581106996e0c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:16.416769 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-3fc51e6d-1e11-4175-9925-581106996e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:16.425657 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 740/1492] 10.222.0.112 () {58 vars in 1028 bytes} [Thu May 26 16:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:16.463839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5500ee-3e55-4a3f-969d-2c3091ede2e0 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:16.475500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5500ee-3e55-4a3f-969d-2c3091ede2e0 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:16.479096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59882bee-9ddf-4e7a-aec3-758d146cba7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:16.479738 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59882bee-9ddf-4e7a-aec3-758d146cba7f service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:16.480026 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59882bee-9ddf-4e7a-aec3-758d146cba7f service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:16.480307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59882bee-9ddf-4e7a-aec3-758d146cba7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:16.490460 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59882bee-9ddf-4e7a-aec3-758d146cba7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:16.491888 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59882bee-9ddf-4e7a-aec3-758d146cba7f service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:16.501258 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 753/1493] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:51:26.410277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=33 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:26.497144 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=33 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:28.348359 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759c127-fff4-4754-b0a6-88715fb5d50b None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.349599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759c127-fff4-4754-b0a6-88715fb5d50b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.349599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759c127-fff4-4754-b0a6-88715fb5d50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.367811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-a759c127-fff4-4754-b0a6-88715fb5d50b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:28.368993 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a759c127-fff4-4754-b0a6-88715fb5d50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:28.376628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 741/1494] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:28.386369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f7b0f-914a-4725-8c85-cd5b27699287 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.386907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f7b0f-914a-4725-8c85-cd5b27699287 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.387016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f7b0f-914a-4725-8c85-cd5b27699287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.405359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-a89f7b0f-914a-4725-8c85-cd5b27699287 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:28.412980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a89f7b0f-914a-4725-8c85-cd5b27699287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:28.416433 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 754/1495] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:28.421185 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759c127-fff4-4754-b0a6-88715fb5d50b None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:28.431978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759c127-fff4-4754-b0a6-88715fb5d50b None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:28.436707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee9d1c-b5a3-4df9-94b2-2d1d2b21a34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:28.437359 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee9d1c-b5a3-4df9-94b2-2d1d2b21a34d admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.437645 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee9d1c-b5a3-4df9-94b2-2d1d2b21a34d admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.437924 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee9d1c-b5a3-4df9-94b2-2d1d2b21a34d admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.438682 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee9d1c-b5a3-4df9-94b2-2d1d2b21a34d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:28.438993 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee9d1c-b5a3-4df9-94b2-2d1d2b21a34d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:28.440013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: WARNING py.warnings [None req-21ee9d1c-b5a3-4df9-94b2-2d1d2b21a34d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:53:28.440013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: warnings.warn(msg) May 26 16:53:28.440013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: May 26 16:53:28.441015 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee9d1c-b5a3-4df9-94b2-2d1d2b21a34d admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:28.452877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 742/1496] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:53:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:28.461310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f7b0f-914a-4725-8c85-cd5b27699287 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:28.470521 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f7b0f-914a-4725-8c85-cd5b27699287 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:28.475709 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536683a0-b777-4b10-80a8-2b4a3fb1be5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:28.476362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536683a0-b777-4b10-80a8-2b4a3fb1be5c admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.476651 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536683a0-b777-4b10-80a8-2b4a3fb1be5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.476932 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536683a0-b777-4b10-80a8-2b4a3fb1be5c admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.477632 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536683a0-b777-4b10-80a8-2b4a3fb1be5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:28.479464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: WARNING py.warnings [None req-536683a0-b777-4b10-80a8-2b4a3fb1be5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:53:28.479464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: warnings.warn(msg) May 26 16:53:28.479464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: May 26 16:53:28.480673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536683a0-b777-4b10-80a8-2b4a3fb1be5c admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:28.603658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 755/1497] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:53:28 2022] POST /identity/v3/projects => generated 380 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:53:28.607937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee9d1c-b5a3-4df9-94b2-2d1d2b21a34d admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:28.623540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee9d1c-b5a3-4df9-94b2-2d1d2b21a34d admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:28.679911 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6fbf6-7067-4893-840d-11640e39e022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:28.680589 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6fbf6-7067-4893-840d-11640e39e022 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.680872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6fbf6-7067-4893-840d-11640e39e022 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.681144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6fbf6-7067-4893-840d-11640e39e022 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.681834 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6fbf6-7067-4893-840d-11640e39e022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:28.682892 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: WARNING py.warnings [None req-2da6fbf6-7067-4893-840d-11640e39e022 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:53:28.682892 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: warnings.warn(msg) May 26 16:53:28.682892 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: May 26 16:53:28.684346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6fbf6-7067-4893-840d-11640e39e022 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:28.773999 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 743/1498] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:53:28 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:53:28.778108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536683a0-b777-4b10-80a8-2b4a3fb1be5c admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:28.789307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536683a0-b777-4b10-80a8-2b4a3fb1be5c admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:28.794105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cbfe1-abf5-4774-8531-08f500115be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:28.794867 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cbfe1-abf5-4774-8531-08f500115be0 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.795160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cbfe1-abf5-4774-8531-08f500115be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.795436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cbfe1-abf5-4774-8531-08f500115be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.796158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cbfe1-abf5-4774-8531-08f500115be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:28.797200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: WARNING py.warnings [None req-933cbfe1-abf5-4774-8531-08f500115be0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:53:28.797200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: warnings.warn(msg) May 26 16:53:28.797200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: May 26 16:53:28.798099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cbfe1-abf5-4774-8531-08f500115be0 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:28.811614 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 756/1499] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:53:28 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:28.815838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6fbf6-7067-4893-840d-11640e39e022 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:28.826232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6fbf6-7067-4893-840d-11640e39e022 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:28.830855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcad89-cf1d-4671-a45e-892afb7e2d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:28.831505 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcad89-cf1d-4671-a45e-892afb7e2d90 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.831794 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcad89-cf1d-4671-a45e-892afb7e2d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.832082 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcad89-cf1d-4671-a45e-892afb7e2d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.832796 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcad89-cf1d-4671-a45e-892afb7e2d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:28.834568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: WARNING py.warnings [None req-8dbcad89-cf1d-4671-a45e-892afb7e2d90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:53:28.834568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: warnings.warn(msg) May 26 16:53:28.834568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: May 26 16:53:28.835478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcad89-cf1d-4671-a45e-892afb7e2d90 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:28.848734 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 744/1500] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:53:28 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:53:28.853608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cbfe1-abf5-4774-8531-08f500115be0 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:28.863600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cbfe1-abf5-4774-8531-08f500115be0 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:28.868760 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3579ea-e2d8-4173-8078-470f30e5b5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:28.869641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3579ea-e2d8-4173-8078-470f30e5b5fd admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.869927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3579ea-e2d8-4173-8078-470f30e5b5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.870207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3579ea-e2d8-4173-8078-470f30e5b5fd admin admin] PATH_INFO: `/v3/projects/3265ab470a334830874e351e18a84bda/users/a466805277b642f5a649aaff85cf5093/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.885522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3579ea-e2d8-4173-8078-470f30e5b5fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3265ab470a334830874e351e18a84bda, user_id=a466805277b642f5a649aaff85cf5093, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:28.886575 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: WARNING py.warnings [None req-cd3579ea-e2d8-4173-8078-470f30e5b5fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:53:28.886575 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: warnings.warn(msg) May 26 16:53:28.886575 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: May 26 16:53:28.888670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3579ea-e2d8-4173-8078-470f30e5b5fd admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:28.984353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 757/1501] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:53:28 2022] PUT /identity/v3/projects/3265ab470a334830874e351e18a84bda/users/a466805277b642f5a649aaff85cf5093/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:28.996084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638b42a-e475-42b8-a507-db2d43806d65 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:29.000481 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638b42a-e475-42b8-a507-db2d43806d65 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:29.000481 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638b42a-e475-42b8-a507-db2d43806d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:29.022941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-d638b42a-e475-42b8-a507-db2d43806d65 None None] MFA Rules not processed for user `a466805277b642f5a649aaff85cf5093`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:29.024270 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d638b42a-e475-42b8-a507-db2d43806d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:29.088167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 745/1502] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:29.101854 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6cf1d-8d50-4679-8306-59e4ebd451bf None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:29.102149 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6cf1d-8d50-4679-8306-59e4ebd451bf None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:29.102480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6cf1d-8d50-4679-8306-59e4ebd451bf None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:29.103903 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 758/1503] 10.222.0.112 () {54 vars in 968 bytes} [Thu May 26 16:53:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:53:29.108644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6f141-10f6-42a9-87d2-d418a2fb7ff6 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:29.108935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6f141-10f6-42a9-87d2-d418a2fb7ff6 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:29.109213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6f141-10f6-42a9-87d2-d418a2fb7ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:29.127633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-e1c6f141-10f6-42a9-87d2-d418a2fb7ff6 None None] MFA Rules not processed for user `53822ebd38c94a729591cb270e0459ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:29.128851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-e1c6f141-10f6-42a9-87d2-d418a2fb7ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:29.171269 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:29.179031 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 746/1504] 10.222.0.112 () {58 vars in 1065 bytes} [Thu May 26 16:53:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:29.187203 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6cf1d-8d50-4679-8306-59e4ebd451bf None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:29.198653 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6cf1d-8d50-4679-8306-59e4ebd451bf None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:29.202166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af630631-77da-4258-89ab-e83f5442b480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:29.202870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630631-77da-4258-89ab-e83f5442b480 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:29.203155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630631-77da-4258-89ab-e83f5442b480 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:29.203432 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630631-77da-4258-89ab-e83f5442b480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:29.212834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af630631-77da-4258-89ab-e83f5442b480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:29.214266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af630631-77da-4258-89ab-e83f5442b480 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:29.223888 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 759/1505] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:53:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:29.268868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea3153-8d89-4af8-bab2-668b748b67a3 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:29.269167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea3153-8d89-4af8-bab2-668b748b67a3 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:29.269456 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea3153-8d89-4af8-bab2-668b748b67a3 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:29.271639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 747/1506] 10.222.0.112 () {52 vars in 834 bytes} [Thu May 26 16:53:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:53:29.274689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af630631-77da-4258-89ab-e83f5442b480 service cinder] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:29.338573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af630631-77da-4258-89ab-e83f5442b480 service cinder] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:29.343063 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835e9d7-2f5e-4d68-941f-b0bfc678116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:29.343932 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835e9d7-2f5e-4d68-941f-b0bfc678116a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:29.344220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835e9d7-2f5e-4d68-941f-b0bfc678116a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:29.344497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835e9d7-2f5e-4d68-941f-b0bfc678116a admin admin] PATH_INFO: `/v3/users/a466805277b642f5a649aaff85cf5093` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:29.345675 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835e9d7-2f5e-4d68-941f-b0bfc678116a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a466805277b642f5a649aaff85cf5093)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:29.346713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: WARNING py.warnings [None req-0835e9d7-2f5e-4d68-941f-b0bfc678116a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:53:29.346713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: warnings.warn(msg) May 26 16:53:29.346713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: May 26 16:53:29.347938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835e9d7-2f5e-4d68-941f-b0bfc678116a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:29.632693 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0835e9d7-2f5e-4d68-941f-b0bfc678116a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a466805277b642f5a649aaff85cf5093'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:29.633351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0835e9d7-2f5e-4d68-941f-b0bfc678116a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a466805277b642f5a649aaff85cf5093'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:29.652655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0835e9d7-2f5e-4d68-941f-b0bfc678116a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a466805277b642f5a649aaff85cf5093'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:29.774263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0835e9d7-2f5e-4d68-941f-b0bfc678116a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a466805277b642f5a649aaff85cf5093'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:29.783973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:29.789501 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0835e9d7-2f5e-4d68-941f-b0bfc678116a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a466805277b642f5a649aaff85cf5093'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:29.795922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 760/1507] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:53:29 2022] DELETE /identity/v3/users/a466805277b642f5a649aaff85cf5093 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:29.800356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76217-a179-47de-a14d-b64c1126e8f1 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:29.800828 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76217-a179-47de-a14d-b64c1126e8f1 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:29.800942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76217-a179-47de-a14d-b64c1126e8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:29.820165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-78a76217-a179-47de-a14d-b64c1126e8f1 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:29.821306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-78a76217-a179-47de-a14d-b64c1126e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:29.880180 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 748/1508] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:29.890452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835e9d7-2f5e-4d68-941f-b0bfc678116a admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:29.891919 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0835e9d7-2f5e-4d68-941f-b0bfc678116a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:29.952611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835e9d7-2f5e-4d68-941f-b0bfc678116a admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:29.956204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2d467-c346-4bdb-ac6a-2be2c01cb96d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:29.956853 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2d467-c346-4bdb-ac6a-2be2c01cb96d service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:29.957139 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2d467-c346-4bdb-ac6a-2be2c01cb96d service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:29.957417 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2d467-c346-4bdb-ac6a-2be2c01cb96d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:29.967265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2d467-c346-4bdb-ac6a-2be2c01cb96d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:29.968694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2d467-c346-4bdb-ac6a-2be2c01cb96d service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:29.978522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 761/1509] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:30.514038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76217-a179-47de-a14d-b64c1126e8f1 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:30.515615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-78a76217-a179-47de-a14d-b64c1126e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:30.529193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76217-a179-47de-a14d-b64c1126e8f1 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:30.535281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:30.536159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:30.536443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:30.536723 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56 admin admin] PATH_INFO: `/v3/projects/3265ab470a334830874e351e18a84bda` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:30.537916 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3265ab470a334830874e351e18a84bda)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:30.539010 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: WARNING py.warnings [None req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:53:30.539010 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: warnings.warn(msg) May 26 16:53:30.539010 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: May 26 16:53:30.540224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:30.676114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3265ab470a334830874e351e18a84bda', 'request_id': 'req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:30.774019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3265ab470a334830874e351e18a84bda', 'request_id': 'req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:30.788852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3265ab470a334830874e351e18a84bda', 'request_id': 'req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:30.799864 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56 admin admin] The token cache is being invalidate because project 3265ab470a334830874e351e18a84bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:30.800156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:30.800814 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e1119669-4dd9-4b80-bdb5-586c9b4cbe56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:30.803123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 749/1510] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:53:30 2022] DELETE /identity/v3/projects/3265ab470a334830874e351e18a84bda => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:39.973880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=29 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:40.796898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:22.142591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa8346-c7b0-4391-9aeb-2b45536d410b None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:22.143209 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa8346-c7b0-4391-9aeb-2b45536d410b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:22.143209 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa8346-c7b0-4391-9aeb-2b45536d410b None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:22.144570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:55:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:55:22.149507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe817d0-49d7-476e-8929-2f975c82f4f7 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:22.149941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe817d0-49d7-476e-8929-2f975c82f4f7 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:22.150048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe817d0-49d7-476e-8929-2f975c82f4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:22.168376 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-efe817d0-49d7-476e-8929-2f975c82f4f7 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:22.169590 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-efe817d0-49d7-476e-8929-2f975c82f4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:22.229866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:22.405583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa8346-c7b0-4391-9aeb-2b45536d410b None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:22.407421 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-51fa8346-c7b0-4391-9aeb-2b45536d410b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:22.483606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa8346-c7b0-4391-9aeb-2b45536d410b None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:22.489226 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0366e-33ee-4b70-9723-56278bada925 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:22.489876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0366e-33ee-4b70-9723-56278bada925 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:22.490162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0366e-33ee-4b70-9723-56278bada925 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:22.490471 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0366e-33ee-4b70-9723-56278bada925 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:22.499002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0366e-33ee-4b70-9723-56278bada925 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:22.500584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0366e-33ee-4b70-9723-56278bada925 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:22.510043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 763/1513] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:55:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:23.392259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957d73d-56ce-4bdb-b6f5-f05951006dd0 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:23.392818 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957d73d-56ce-4bdb-b6f5-f05951006dd0 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:23.392818 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957d73d-56ce-4bdb-b6f5-f05951006dd0 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:23.394188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:55:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:55:23.399133 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b965b4c-74b7-4b32-bc5c-9c62b55e2d74 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:23.399534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b965b4c-74b7-4b32-bc5c-9c62b55e2d74 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:23.399732 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b965b4c-74b7-4b32-bc5c-9c62b55e2d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:23.418303 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-0b965b4c-74b7-4b32-bc5c-9c62b55e2d74 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:23.419514 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0b965b4c-74b7-4b32-bc5c-9c62b55e2d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:23.427357 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:23.579932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957d73d-56ce-4bdb-b6f5-f05951006dd0 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:23.594125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957d73d-56ce-4bdb-b6f5-f05951006dd0 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:23.599488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12709179-9be3-4dac-834f-07d49879b2a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:23.600124 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12709179-9be3-4dac-834f-07d49879b2a3 service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:23.600410 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12709179-9be3-4dac-834f-07d49879b2a3 service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:23.600692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12709179-9be3-4dac-834f-07d49879b2a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:23.608946 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12709179-9be3-4dac-834f-07d49879b2a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:23.610588 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12709179-9be3-4dac-834f-07d49879b2a3 service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:23.619994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 752/1516] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:26.870843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454686e9-3a6b-4c16-8116-817a595d4f21 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:26.871428 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454686e9-3a6b-4c16-8116-817a595d4f21 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:26.871623 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454686e9-3a6b-4c16-8116-817a595d4f21 None None] PATH_INFO: `/v3` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:26.873196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 765/1517] 10.222.0.45 () {54 vars in 929 bytes} [Thu May 26 16:55:26 2022] GET /identity/v3 => generated 256 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:55:26.882173 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50dde0-c1a6-4214-9d42-a7cee7bce34a None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:26.882702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50dde0-c1a6-4214-9d42-a7cee7bce34a None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:26.882818 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50dde0-c1a6-4214-9d42-a7cee7bce34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:26.901418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-fe50dde0-c1a6-4214-9d42-a7cee7bce34a None None] MFA Rules not processed for user `b415e7fca03e4602b3d711436d47f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:26.902661 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-fe50dde0-c1a6-4214-9d42-a7cee7bce34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:26.965955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 753/1518] 10.222.0.45 () {58 vars in 1019 bytes} [Thu May 26 16:55:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:33.413041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=37 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:34.905878 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32564e-ad55-4bcb-a49a-2b6348a358f3 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:34.906560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32564e-ad55-4bcb-a49a-2b6348a358f3 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:34.906560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32564e-ad55-4bcb-a49a-2b6348a358f3 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:34.907818 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 766/1519] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:55:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:55:34.912729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed59fa-95b4-4bc0-b65b-53b2a121756b None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:34.913179 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed59fa-95b4-4bc0-b65b-53b2a121756b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:34.913286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed59fa-95b4-4bc0-b65b-53b2a121756b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:34.931646 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-86ed59fa-95b4-4bc0-b65b-53b2a121756b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:34.932839 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-86ed59fa-95b4-4bc0-b65b-53b2a121756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:34.940806 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 754/1520] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:35.101805 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32564e-ad55-4bcb-a49a-2b6348a358f3 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:35.116347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32564e-ad55-4bcb-a49a-2b6348a358f3 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:35.121683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0b65a-d2ea-4446-b175-751c3799dbbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:35.122306 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0b65a-d2ea-4446-b175-751c3799dbbe service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:35.122616 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0b65a-d2ea-4446-b175-751c3799dbbe service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:35.122891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0b65a-d2ea-4446-b175-751c3799dbbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:35.130941 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0b65a-d2ea-4446-b175-751c3799dbbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:35.132528 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0b65a-d2ea-4446-b175-751c3799dbbe service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:35.142297 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 767/1521] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:36.020634 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a603ef-aa28-46db-a979-02ddb0e87405 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:36.021205 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a603ef-aa28-46db-a979-02ddb0e87405 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:36.021205 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a603ef-aa28-46db-a979-02ddb0e87405 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:36.022799 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:55:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:55:36.027335 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a37199-a8db-4211-86a5-35d876062bf0 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:36.027736 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a37199-a8db-4211-86a5-35d876062bf0 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:36.027887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a37199-a8db-4211-86a5-35d876062bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:36.046560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-94a37199-a8db-4211-86a5-35d876062bf0 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:36.047737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-94a37199-a8db-4211-86a5-35d876062bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:36.055467 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:36.205975 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a603ef-aa28-46db-a979-02ddb0e87405 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:36.220852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a603ef-aa28-46db-a979-02ddb0e87405 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:36.226202 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44a9c4-2ba0-4575-b0c1-962cbd6902ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:36.226871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44a9c4-2ba0-4575-b0c1-962cbd6902ce service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:36.227161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44a9c4-2ba0-4575-b0c1-962cbd6902ce service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:36.227445 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44a9c4-2ba0-4575-b0c1-962cbd6902ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:36.235614 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44a9c4-2ba0-4575-b0c1-962cbd6902ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:36.237221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44a9c4-2ba0-4575-b0c1-962cbd6902ce service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:36.246651 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 756/1524] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:55:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:39.553831 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307b9ac-0288-4037-885f-7198a2320afd None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:39.554379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307b9ac-0288-4037-885f-7198a2320afd None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:39.554379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307b9ac-0288-4037-885f-7198a2320afd None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:39.555724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 769/1525] 10.222.0.112 () {54 vars in 965 bytes} [Thu May 26 16:55:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:55:39.560649 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8844a03-ba06-4321-8def-3e510b14f268 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:39.561103 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8844a03-ba06-4321-8def-3e510b14f268 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:39.561352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8844a03-ba06-4321-8def-3e510b14f268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:39.579324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-b8844a03-ba06-4321-8def-3e510b14f268 None None] MFA Rules not processed for user `b415e7fca03e4602b3d711436d47f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:39.580495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b8844a03-ba06-4321-8def-3e510b14f268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:39.588825 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 757/1526] 10.222.0.112 () {58 vars in 1062 bytes} [Thu May 26 16:55:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:39.596995 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307b9ac-0288-4037-885f-7198a2320afd None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:39.611369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307b9ac-0288-4037-885f-7198a2320afd None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:39.616295 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cfd79-5cd8-4f97-b27d-a3c0d3b4dfee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:39.616920 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cfd79-5cd8-4f97-b27d-a3c0d3b4dfee service placement] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:39.617206 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cfd79-5cd8-4f97-b27d-a3c0d3b4dfee service placement] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:39.617488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cfd79-5cd8-4f97-b27d-a3c0d3b4dfee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:39.625923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cfd79-5cd8-4f97-b27d-a3c0d3b4dfee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:39.627555 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cfd79-5cd8-4f97-b27d-a3c0d3b4dfee service placement] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:39.637060 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 770/1527] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:55:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:47.563965 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af2024-90fc-4c2c-aab6-1f52c07236ae None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:47.564480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af2024-90fc-4c2c-aab6-1f52c07236ae None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:47.564480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af2024-90fc-4c2c-aab6-1f52c07236ae None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:47.565814 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:55:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:55:47.570597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a33c97-f99b-447d-ba15-de761c700a23 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:47.571066 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a33c97-f99b-447d-ba15-de761c700a23 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:47.571189 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a33c97-f99b-447d-ba15-de761c700a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:47.589914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-d4a33c97-f99b-447d-ba15-de761c700a23 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:47.591175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d4a33c97-f99b-447d-ba15-de761c700a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:47.599134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:55:47.753142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af2024-90fc-4c2c-aab6-1f52c07236ae None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:47.768492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af2024-90fc-4c2c-aab6-1f52c07236ae None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:47.773943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c5106-30df-4443-aa1d-528cd6a142bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:47.774619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c5106-30df-4443-aa1d-528cd6a142bb service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:47.774907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c5106-30df-4443-aa1d-528cd6a142bb service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:47.775191 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c5106-30df-4443-aa1d-528cd6a142bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:47.784247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c5106-30df-4443-aa1d-528cd6a142bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:47.785855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c5106-30df-4443-aa1d-528cd6a142bb service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:47.795467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 759/1530] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:48.662412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18dcf0-8114-4a62-b326-018a3ed58dac None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:48.662948 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18dcf0-8114-4a62-b326-018a3ed58dac None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:48.663062 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18dcf0-8114-4a62-b326-018a3ed58dac None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:48.664364 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:55:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:55:48.669378 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1bae4-ae59-42f8-a0ce-5d48f52df673 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:48.669849 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1bae4-ae59-42f8-a0ce-5d48f52df673 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:48.669992 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1bae4-ae59-42f8-a0ce-5d48f52df673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:48.688990 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-65e1bae4-ae59-42f8-a0ce-5d48f52df673 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:48.690202 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-65e1bae4-ae59-42f8-a0ce-5d48f52df673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:48.698435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:48.855794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18dcf0-8114-4a62-b326-018a3ed58dac None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:48.870632 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18dcf0-8114-4a62-b326-018a3ed58dac None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:48.876901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588d917-5477-4104-be19-a78669b90b3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:48.877563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588d917-5477-4104-be19-a78669b90b3e service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:48.877848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588d917-5477-4104-be19-a78669b90b3e service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:48.878128 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588d917-5477-4104-be19-a78669b90b3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:48.886304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588d917-5477-4104-be19-a78669b90b3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:48.887919 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588d917-5477-4104-be19-a78669b90b3e service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:48.897483 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 773/1533] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:53.329653 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf3588-d28d-4ad3-aa25-586dadf91fcc None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:53.330274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf3588-d28d-4ad3-aa25-586dadf91fcc None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:53.330274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf3588-d28d-4ad3-aa25-586dadf91fcc None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:53.331597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:55:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:55:53.336684 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd36c2a-8253-4723-b0f0-f4aac36c646f None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:53.337142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd36c2a-8253-4723-b0f0-f4aac36c646f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:53.337252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd36c2a-8253-4723-b0f0-f4aac36c646f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:53.355641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-7dd36c2a-8253-4723-b0f0-f4aac36c646f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:53.356835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7dd36c2a-8253-4723-b0f0-f4aac36c646f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:53.364860 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:53.400768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf3588-d28d-4ad3-aa25-586dadf91fcc None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:53.402499 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-fcdf3588-d28d-4ad3-aa25-586dadf91fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:53.409279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=84 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:53.462166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf3588-d28d-4ad3-aa25-586dadf91fcc None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:53.465614 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16391caa-d1ca-42df-9cab-e49e6f2bca8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:53.466256 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16391caa-d1ca-42df-9cab-e49e6f2bca8d service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:53.466570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16391caa-d1ca-42df-9cab-e49e6f2bca8d service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:53.466847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16391caa-d1ca-42df-9cab-e49e6f2bca8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:53.475607 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16391caa-d1ca-42df-9cab-e49e6f2bca8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:53.477079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16391caa-d1ca-42df-9cab-e49e6f2bca8d service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:53.486965 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 762/1536] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:55.691697 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd0251-dd7d-4b46-915b-c8cc42df0a29 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:55.692263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd0251-dd7d-4b46-915b-c8cc42df0a29 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:55.692263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd0251-dd7d-4b46-915b-c8cc42df0a29 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:55.693637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:55:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:55:55.699099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdd6ff-5cdd-4cf4-901d-543688d7fed3 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:55.699526 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdd6ff-5cdd-4cf4-901d-543688d7fed3 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:55.699674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdd6ff-5cdd-4cf4-901d-543688d7fed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:55.717753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-7ecdd6ff-5cdd-4cf4-901d-543688d7fed3 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:55.719586 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7ecdd6ff-5cdd-4cf4-901d-543688d7fed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:55.727360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:55.762719 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd0251-dd7d-4b46-915b-c8cc42df0a29 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:55.774176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd0251-dd7d-4b46-915b-c8cc42df0a29 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:55.777670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e8cbe-cc77-400d-832f-c6e476ded71b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:55.778305 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e8cbe-cc77-400d-832f-c6e476ded71b service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:55.778621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e8cbe-cc77-400d-832f-c6e476ded71b service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:55.778900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e8cbe-cc77-400d-832f-c6e476ded71b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:55.789153 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e8cbe-cc77-400d-832f-c6e476ded71b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:55.790634 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e8cbe-cc77-400d-832f-c6e476ded71b service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:55.800546 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 776/1539] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:59.429183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669456eb-d61a-4b6c-8ba0-0f798416d2af None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:59.429716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669456eb-d61a-4b6c-8ba0-0f798416d2af None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:59.429716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669456eb-d61a-4b6c-8ba0-0f798416d2af None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:59.431193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 764/1540] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:55:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:55:59.436666 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91ccff-7716-4468-b327-0c1e7cdbc988 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:59.437613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91ccff-7716-4468-b327-0c1e7cdbc988 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:59.437912 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91ccff-7716-4468-b327-0c1e7cdbc988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:59.458446 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-ec91ccff-7716-4468-b327-0c1e7cdbc988 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:59.459601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ec91ccff-7716-4468-b327-0c1e7cdbc988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:59.467506 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 777/1541] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:59.740848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669456eb-d61a-4b6c-8ba0-0f798416d2af None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:59.742609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-669456eb-d61a-4b6c-8ba0-0f798416d2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:59.799370 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669456eb-d61a-4b6c-8ba0-0f798416d2af None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:59.803004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7af6c-be85-41be-b574-fc23249f775b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:59.803653 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7af6c-be85-41be-b574-fc23249f775b service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:59.803941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7af6c-be85-41be-b574-fc23249f775b service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:59.804224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7af6c-be85-41be-b574-fc23249f775b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:59.813626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7af6c-be85-41be-b574-fc23249f775b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:59.815092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7af6c-be85-41be-b574-fc23249f775b service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:59.824644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 765/1542] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:02.094886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174d7d4-f509-40e1-99a7-24efc48b71a0 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:02.095497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174d7d4-f509-40e1-99a7-24efc48b71a0 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:02.095497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174d7d4-f509-40e1-99a7-24efc48b71a0 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:02.096819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 778/1543] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:56:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:56:02.101998 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bf376-ab98-4e8b-bb78-e8d91236e8d7 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:02.102479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bf376-ab98-4e8b-bb78-e8d91236e8d7 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:02.102587 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bf376-ab98-4e8b-bb78-e8d91236e8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:02.121003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-0a3bf376-ab98-4e8b-bb78-e8d91236e8d7 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:02.122179 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0a3bf376-ab98-4e8b-bb78-e8d91236e8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:02.131164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 766/1544] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:02.402482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174d7d4-f509-40e1-99a7-24efc48b71a0 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:02.404172 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6174d7d4-f509-40e1-99a7-24efc48b71a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:02.417331 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174d7d4-f509-40e1-99a7-24efc48b71a0 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:02.420813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df03f7d-5aba-40fe-88d2-04508d35d938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:02.421962 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03f7d-5aba-40fe-88d2-04508d35d938 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:02.422234 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03f7d-5aba-40fe-88d2-04508d35d938 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:02.422742 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03f7d-5aba-40fe-88d2-04508d35d938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:02.431558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df03f7d-5aba-40fe-88d2-04508d35d938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:02.432960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df03f7d-5aba-40fe-88d2-04508d35d938 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:02.442769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 779/1545] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:12.116281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=57 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:12.438689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=42 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:43.592163 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dc997-2a50-4801-8998-fe1b0d21e9d2 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:43.593261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dc997-2a50-4801-8998-fe1b0d21e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:43.593788 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dc997-2a50-4801-8998-fe1b0d21e9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:43.623889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-d21dc997-2a50-4801-8998-fe1b0d21e9d2 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:43.625496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d21dc997-2a50-4801-8998-fe1b0d21e9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:43.637097 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 767/1546] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:43.649351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e70f8-5290-4817-8ebe-de40a4187c22 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:43.650363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e70f8-5290-4817-8ebe-de40a4187c22 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:43.650873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e70f8-5290-4817-8ebe-de40a4187c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:43.675389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-8d0e70f8-5290-4817-8ebe-de40a4187c22 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:43.677028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8d0e70f8-5290-4817-8ebe-de40a4187c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:43.689088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 780/1547] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:43.695829 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dc997-2a50-4801-8998-fe1b0d21e9d2 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:43.712159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dc997-2a50-4801-8998-fe1b0d21e9d2 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:43.721598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298b3f6-de98-4f06-b8f5-fa9e535e1e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:43.722286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298b3f6-de98-4f06-b8f5-fa9e535e1e45 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:43.722600 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298b3f6-de98-4f06-b8f5-fa9e535e1e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:43.722873 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298b3f6-de98-4f06-b8f5-fa9e535e1e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:43.723607 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298b3f6-de98-4f06-b8f5-fa9e535e1e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:57:43.723916 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298b3f6-de98-4f06-b8f5-fa9e535e1e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:43.725538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298b3f6-de98-4f06-b8f5-fa9e535e1e45 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:43.746584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 768/1548] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:57:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:57:43.756702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e70f8-5290-4817-8ebe-de40a4187c22 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:43.772789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e70f8-5290-4817-8ebe-de40a4187c22 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:43.778404 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a265c22-a445-4eac-b1d0-8ed3582387dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:43.779473 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a265c22-a445-4eac-b1d0-8ed3582387dc admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:43.779991 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a265c22-a445-4eac-b1d0-8ed3582387dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:43.780495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a265c22-a445-4eac-b1d0-8ed3582387dc admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:43.781440 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a265c22-a445-4eac-b1d0-8ed3582387dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:43.784671 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a265c22-a445-4eac-b1d0-8ed3582387dc admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:43.878564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 781/1549] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:57:43 2022] POST /identity/v3/projects => generated 384 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:43.882459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298b3f6-de98-4f06-b8f5-fa9e535e1e45 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:43.898134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298b3f6-de98-4f06-b8f5-fa9e535e1e45 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:43.903115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074a63-648c-4f5d-aab4-4a8c9900b360 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:43.903115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074a63-648c-4f5d-aab4-4a8c9900b360 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:43.903115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074a63-648c-4f5d-aab4-4a8c9900b360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:43.942354 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-f9074a63-648c-4f5d-aab4-4a8c9900b360 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:43.942354 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-f9074a63-648c-4f5d-aab4-4a8c9900b360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:43.999734 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbd1d5-ac28-490f-9cd1-86751fd79da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:44.001163 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbd1d5-ac28-490f-9cd1-86751fd79da3 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.001678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbd1d5-ac28-490f-9cd1-86751fd79da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.002151 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbd1d5-ac28-490f-9cd1-86751fd79da3 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.003084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbd1d5-ac28-490f-9cd1-86751fd79da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:44.005254 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbd1d5-ac28-490f-9cd1-86751fd79da3 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:44.048605 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 782/1550] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 26 16:57:44.059634 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2a145-092e-4d83-8288-5e0d3b6bf0a4 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.060140 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2a145-092e-4d83-8288-5e0d3b6bf0a4 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.060435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2a145-092e-4d83-8288-5e0d3b6bf0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.089342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e5a2a145-092e-4d83-8288-5e0d3b6bf0a4 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:44.092707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e5a2a145-092e-4d83-8288-5e0d3b6bf0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:44.096551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 769/1551] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:57:43 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:44.098521 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302268f-b231-4ea6-b50b-6f9d80bafbe2 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.099079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302268f-b231-4ea6-b50b-6f9d80bafbe2 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.099590 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302268f-b231-4ea6-b50b-6f9d80bafbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.108300 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 783/1552] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:57:44.109315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2a145-092e-4d83-8288-5e0d3b6bf0a4 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:44.130440 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2a145-092e-4d83-8288-5e0d3b6bf0a4 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:44.135535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-1302268f-b231-4ea6-b50b-6f9d80bafbe2 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:44.137024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1302268f-b231-4ea6-b50b-6f9d80bafbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:44.139767 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3698072-a2d0-4361-906e-ec7bc14c47b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:44.140709 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3698072-a2d0-4361-906e-ec7bc14c47b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.143046 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3698072-a2d0-4361-906e-ec7bc14c47b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.144081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3698072-a2d0-4361-906e-ec7bc14c47b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.145561 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3698072-a2d0-4361-906e-ec7bc14c47b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:44.148013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3698072-a2d0-4361-906e-ec7bc14c47b7 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:44.167996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 770/1553] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:44.169256 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302268f-b231-4ea6-b50b-6f9d80bafbe2 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:44.186405 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302268f-b231-4ea6-b50b-6f9d80bafbe2 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:44.195340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 784/1554] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:44 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:44.197264 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01a74-79dc-4ffc-bd8f-6c4c973a6d98 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.197791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01a74-79dc-4ffc-bd8f-6c4c973a6d98 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.198312 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01a74-79dc-4ffc-bd8f-6c4c973a6d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.210212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17aa06-9171-4d6f-87b5-522e29196b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:44.210212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17aa06-9171-4d6f-87b5-522e29196b84 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.210212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17aa06-9171-4d6f-87b5-522e29196b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.210212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17aa06-9171-4d6f-87b5-522e29196b84 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.210670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17aa06-9171-4d6f-87b5-522e29196b84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:57:44.210670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17aa06-9171-4d6f-87b5-522e29196b84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:44.211064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17aa06-9171-4d6f-87b5-522e29196b84 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:44.233145 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 771/1555] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:57:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:57:44.234375 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b4651-9eea-4b4f-b057-2e483b1b6d50 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.234668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b4651-9eea-4b4f-b057-2e483b1b6d50 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.234946 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b4651-9eea-4b4f-b057-2e483b1b6d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.240946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-5fb01a74-79dc-4ffc-bd8f-6c4c973a6d98 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:44.242789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5fb01a74-79dc-4ffc-bd8f-6c4c973a6d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:44.264201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 785/1556] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:44.264866 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb01a74-79dc-4ffc-bd8f-6c4c973a6d98 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:44.275008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-0c1b4651-9eea-4b4f-b057-2e483b1b6d50 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:44.276235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0c1b4651-9eea-4b4f-b057-2e483b1b6d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:44.280053 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb01a74-79dc-4ffc-bd8f-6c4c973a6d98 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:44.285309 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 772/1557] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:44.289330 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b4651-9eea-4b4f-b057-2e483b1b6d50 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:44.290955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3a017-642c-475d-9931-bf3b654185e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:44.291950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3a017-642c-475d-9931-bf3b654185e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.292672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3a017-642c-475d-9931-bf3b654185e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.293422 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3a017-642c-475d-9931-bf3b654185e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.294828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3a017-642c-475d-9931-bf3b654185e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:44.296582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b4651-9eea-4b4f-b057-2e483b1b6d50 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:44.297030 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3a017-642c-475d-9931-bf3b654185e5 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:44.301966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3c209-9eaa-49d5-844c-edf3716f9f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:44.302668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3c209-9eaa-49d5-844c-edf3716f9f64 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.303099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3c209-9eaa-49d5-844c-edf3716f9f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.303389 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3c209-9eaa-49d5-844c-edf3716f9f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.304090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3c209-9eaa-49d5-844c-edf3716f9f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:44.305123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: WARNING py.warnings [None req-29f3c209-9eaa-49d5-844c-edf3716f9f64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:57:44.305123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: warnings.warn(msg) May 26 16:57:44.305123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: May 26 16:57:44.306305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3c209-9eaa-49d5-844c-edf3716f9f64 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:44.312366 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 786/1558] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:44 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:44.315464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311795b3-2a4f-48b4-b719-5daf03e381e0 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.316013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311795b3-2a4f-48b4-b719-5daf03e381e0 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.316524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311795b3-2a4f-48b4-b719-5daf03e381e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.337354 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-311795b3-2a4f-48b4-b719-5daf03e381e0 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:44.338601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-311795b3-2a4f-48b4-b719-5daf03e381e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:44.346934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 787/1559] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:44.348254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b17a4-e087-47f6-b0a6-bf1db31d8ce4 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.348544 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b17a4-e087-47f6-b0a6-bf1db31d8ce4 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.348825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b17a4-e087-47f6-b0a6-bf1db31d8ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.367965 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e50b17a4-e087-47f6-b0a6-bf1db31d8ce4 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:44.369143 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e50b17a4-e087-47f6-b0a6-bf1db31d8ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:44.377778 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 788/1560] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:44.379135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa56558-e485-4cb5-8795-5ffe74e6acb9 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.379479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa56558-e485-4cb5-8795-5ffe74e6acb9 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.379612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa56558-e485-4cb5-8795-5ffe74e6acb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.398543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-7fa56558-e485-4cb5-8795-5ffe74e6acb9 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:44.399849 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7fa56558-e485-4cb5-8795-5ffe74e6acb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:44.408936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 789/1561] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:44.412779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa56558-e485-4cb5-8795-5ffe74e6acb9 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:44.412920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 773/1562] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/projects => generated 376 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:44.412920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3c209-9eaa-49d5-844c-edf3716f9f64 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:44.422003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa56558-e485-4cb5-8795-5ffe74e6acb9 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:44.477872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3c209-9eaa-49d5-844c-edf3716f9f64 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:44.480423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47e959-991b-45c3-b009-bb1d84ad72c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:44.481089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47e959-991b-45c3-b009-bb1d84ad72c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.481376 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47e959-991b-45c3-b009-bb1d84ad72c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.481656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47e959-991b-45c3-b009-bb1d84ad72c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.482399 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47e959-991b-45c3-b009-bb1d84ad72c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:57:44.482501 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4131e64-abb9-4b14-8ef6-b1ca0104f294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:44.482712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47e959-991b-45c3-b009-bb1d84ad72c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:44.483314 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4131e64-abb9-4b14-8ef6-b1ca0104f294 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.483599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4131e64-abb9-4b14-8ef6-b1ca0104f294 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.483711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: WARNING py.warnings [None req-ef47e959-991b-45c3-b009-bb1d84ad72c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:57:44.483711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: warnings.warn(msg) May 26 16:57:44.483711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: May 26 16:57:44.483926 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4131e64-abb9-4b14-8ef6-b1ca0104f294 admin admin] PATH_INFO: `/v3/projects/e6412eea680c4b2bbcac2efb59aabe52/users/289cb250e20344d28bd5fd17255d5896/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.484643 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47e959-991b-45c3-b009-bb1d84ad72c8 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:44.506230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 790/1563] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:57:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:57:44.506230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388d9ba-7e0d-4aa9-85d7-613a3913eba8 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.506230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388d9ba-7e0d-4aa9-85d7-613a3913eba8 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.506230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388d9ba-7e0d-4aa9-85d7-613a3913eba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.507739 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4131e64-abb9-4b14-8ef6-b1ca0104f294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6412eea680c4b2bbcac2efb59aabe52, user_id=289cb250e20344d28bd5fd17255d5896, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:44.508942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: WARNING py.warnings [None req-c4131e64-abb9-4b14-8ef6-b1ca0104f294 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:57:44.508942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: warnings.warn(msg) May 26 16:57:44.508942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: May 26 16:57:44.510979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4131e64-abb9-4b14-8ef6-b1ca0104f294 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:44.520143 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-8388d9ba-7e0d-4aa9-85d7-613a3913eba8 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:44.521360 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8388d9ba-7e0d-4aa9-85d7-613a3913eba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:44.529287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 791/1564] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:44.530527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57910001-e6cd-4a88-9bb0-bacc1d094879 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.530824 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57910001-e6cd-4a88-9bb0-bacc1d094879 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.531088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57910001-e6cd-4a88-9bb0-bacc1d094879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.538260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:44.549963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-57910001-e6cd-4a88-9bb0-bacc1d094879 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:44.551224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-57910001-e6cd-4a88-9bb0-bacc1d094879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:44.559222 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 792/1565] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:44.561203 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff07188-f25e-4cb5-938c-e8302351d3b9 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.562117 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff07188-f25e-4cb5-938c-e8302351d3b9 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.562434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff07188-f25e-4cb5-938c-e8302351d3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.581929 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-fff07188-f25e-4cb5-938c-e8302351d3b9 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:44.583109 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-fff07188-f25e-4cb5-938c-e8302351d3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:44.591257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 793/1566] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:44.592753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239485b-d71f-46de-958e-5650013edd88 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.593036 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239485b-d71f-46de-958e-5650013edd88 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.593307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239485b-d71f-46de-958e-5650013edd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.611588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-3239485b-d71f-46de-958e-5650013edd88 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:44.612750 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-3239485b-d71f-46de-958e-5650013edd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:44.620855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 794/1567] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:44.621685 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239485b-d71f-46de-958e-5650013edd88 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:44.624797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 774/1568] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:44 2022] PUT /identity/v3/projects/e6412eea680c4b2bbcac2efb59aabe52/users/289cb250e20344d28bd5fd17255d5896/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:44.627071 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4131e64-abb9-4b14-8ef6-b1ca0104f294 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:44.634690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:44.639088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239485b-d71f-46de-958e-5650013edd88 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:44.695886 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4131e64-abb9-4b14-8ef6-b1ca0104f294 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:44.697848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9975381-a954-46aa-bc84-b0022a533e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:44.698543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9975381-a954-46aa-bc84-b0022a533e86 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.698831 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9975381-a954-46aa-bc84-b0022a533e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.699111 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9975381-a954-46aa-bc84-b0022a533e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.699832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9975381-a954-46aa-bc84-b0022a533e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:57:44.700138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9975381-a954-46aa-bc84-b0022a533e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:44.700655 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa94f16-e93a-4d56-9cdd-b878446a4590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:44.701329 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa94f16-e93a-4d56-9cdd-b878446a4590 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.701616 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa94f16-e93a-4d56-9cdd-b878446a4590 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.701741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9975381-a954-46aa-bc84-b0022a533e86 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:44.701900 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa94f16-e93a-4d56-9cdd-b878446a4590 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.702632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa94f16-e93a-4d56-9cdd-b878446a4590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:44.705709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa94f16-e93a-4d56-9cdd-b878446a4590 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:44.722060 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 795/1569] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:57:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:57:44.722060 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9975381-a954-46aa-bc84-b0022a533e86 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:44.731387 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9975381-a954-46aa-bc84-b0022a533e86 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:44.736114 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9a9ac-1f44-48ca-9a47-6ba53258379f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:44.736797 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9a9ac-1f44-48ca-9a47-6ba53258379f admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.737087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9a9ac-1f44-48ca-9a47-6ba53258379f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.737366 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9a9ac-1f44-48ca-9a47-6ba53258379f admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.738045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9a9ac-1f44-48ca-9a47-6ba53258379f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:44.739964 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9a9ac-1f44-48ca-9a47-6ba53258379f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:44.852154 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 775/1570] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:44.853439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbb634-9e76-4d2d-853d-a50c4a0acb85 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.853730 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbb634-9e76-4d2d-853d-a50c4a0acb85 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.854008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbb634-9e76-4d2d-853d-a50c4a0acb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.872967 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-7dfbb634-9e76-4d2d-853d-a50c4a0acb85 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:44.874162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7dfbb634-9e76-4d2d-853d-a50c4a0acb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:44.884177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 776/1571] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:44.885042 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbb634-9e76-4d2d-853d-a50c4a0acb85 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:44.896251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbb634-9e76-4d2d-853d-a50c4a0acb85 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:44.901836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3455f-fe2c-4526-91e8-be9ee42a0bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:44.910003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3455f-fe2c-4526-91e8-be9ee42a0bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.910003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3455f-fe2c-4526-91e8-be9ee42a0bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.910003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3455f-fe2c-4526-91e8-be9ee42a0bb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.910003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3455f-fe2c-4526-91e8-be9ee42a0bb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:57:44.910003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3455f-fe2c-4526-91e8-be9ee42a0bb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:44.910452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 796/1572] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/projects => generated 400 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:44.910547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3455f-fe2c-4526-91e8-be9ee42a0bb8 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:44.910623 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9a9ac-1f44-48ca-9a47-6ba53258379f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:44.918237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 777/1573] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:57:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:57:44.919512 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a77a7-d013-4fb2-8188-c1ca049d574d None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.919803 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a77a7-d013-4fb2-8188-c1ca049d574d None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.920080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a77a7-d013-4fb2-8188-c1ca049d574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.937742 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-0d3a77a7-d013-4fb2-8188-c1ca049d574d None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:44.939609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0d3a77a7-d013-4fb2-8188-c1ca049d574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:44.974406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9a9ac-1f44-48ca-9a47-6ba53258379f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:44.979320 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af68b4-1eee-4d46-8434-d12c8f1dc092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:44.980345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af68b4-1eee-4d46-8434-d12c8f1dc092 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.980637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af68b4-1eee-4d46-8434-d12c8f1dc092 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.980924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af68b4-1eee-4d46-8434-d12c8f1dc092 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:44.981644 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af68b4-1eee-4d46-8434-d12c8f1dc092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:57:44.981958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af68b4-1eee-4d46-8434-d12c8f1dc092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:44.983592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af68b4-1eee-4d46-8434-d12c8f1dc092 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:44.996027 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 797/1574] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:57:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:57:44.997596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39263bae-0698-469b-8f39-4ad9759fc150 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:44.997890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39263bae-0698-469b-8f39-4ad9759fc150 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:44.998280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39263bae-0698-469b-8f39-4ad9759fc150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.000881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 778/1575] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:45.002198 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a77a7-d013-4fb2-8188-c1ca049d574d None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.011972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a77a7-d013-4fb2-8188-c1ca049d574d None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.016561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc19f8-530e-4372-aa42-611234cf6120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.017261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc19f8-530e-4372-aa42-611234cf6120 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.017498 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc19f8-530e-4372-aa42-611234cf6120 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.017778 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc19f8-530e-4372-aa42-611234cf6120 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.018526 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc19f8-530e-4372-aa42-611234cf6120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:45.020442 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc19f8-530e-4372-aa42-611234cf6120 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:45.021631 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-39263bae-0698-469b-8f39-4ad9759fc150 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:45.022846 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-39263bae-0698-469b-8f39-4ad9759fc150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:45.030902 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 798/1576] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:45.031339 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39263bae-0698-469b-8f39-4ad9759fc150 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.040596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39263bae-0698-469b-8f39-4ad9759fc150 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.045104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c38e75-7274-4b8b-bd41-d6e7ee85c633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.045745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c38e75-7274-4b8b-bd41-d6e7ee85c633 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.046031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c38e75-7274-4b8b-bd41-d6e7ee85c633 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.046304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c38e75-7274-4b8b-bd41-d6e7ee85c633 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.047050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c38e75-7274-4b8b-bd41-d6e7ee85c633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:45.049306 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c38e75-7274-4b8b-bd41-d6e7ee85c633 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:45.059670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 799/1577] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:45 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:45.060457 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c38e75-7274-4b8b-bd41-d6e7ee85c633 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.070968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c38e75-7274-4b8b-bd41-d6e7ee85c633 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.075498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba852691-e96d-45bc-b83e-80ebbfcad6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.076113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba852691-e96d-45bc-b83e-80ebbfcad6af admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.076393 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba852691-e96d-45bc-b83e-80ebbfcad6af admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.076667 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba852691-e96d-45bc-b83e-80ebbfcad6af admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.077364 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba852691-e96d-45bc-b83e-80ebbfcad6af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:57:45.077668 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba852691-e96d-45bc-b83e-80ebbfcad6af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:45.079639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba852691-e96d-45bc-b83e-80ebbfcad6af admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:45.091459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 800/1578] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:57:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:57:45.092057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba852691-e96d-45bc-b83e-80ebbfcad6af admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.102789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 779/1579] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:57:45 2022] POST /identity/v3/projects => generated 388 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:45.102789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc19f8-530e-4372-aa42-611234cf6120 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.107863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba852691-e96d-45bc-b83e-80ebbfcad6af admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.124499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:45.158062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:45.164214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2626d7-1c8b-4a6d-a3da-9371345bcc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.164887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2626d7-1c8b-4a6d-a3da-9371345bcc96 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.165169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2626d7-1c8b-4a6d-a3da-9371345bcc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.165444 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2626d7-1c8b-4a6d-a3da-9371345bcc96 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.166119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2626d7-1c8b-4a6d-a3da-9371345bcc96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:45.167158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: WARNING py.warnings [None req-3b2626d7-1c8b-4a6d-a3da-9371345bcc96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:57:45.167158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: warnings.warn(msg) May 26 16:57:45.167158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: May 26 16:57:45.168365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2626d7-1c8b-4a6d-a3da-9371345bcc96 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:45.171012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc19f8-530e-4372-aa42-611234cf6120 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.176814 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61193f7e-c25e-4e7e-b87d-e4e7a2b9be96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.177488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61193f7e-c25e-4e7e-b87d-e4e7a2b9be96 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.177774 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61193f7e-c25e-4e7e-b87d-e4e7a2b9be96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.178058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61193f7e-c25e-4e7e-b87d-e4e7a2b9be96 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.178812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61193f7e-c25e-4e7e-b87d-e4e7a2b9be96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:45.180868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61193f7e-c25e-4e7e-b87d-e4e7a2b9be96 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:45.263770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 801/1580] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:57:45 2022] POST /identity/v3/users => generated 301 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:45.264523 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2626d7-1c8b-4a6d-a3da-9371345bcc96 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.273900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2626d7-1c8b-4a6d-a3da-9371345bcc96 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.279564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25002566-d37d-43df-a900-acc9064ce0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.282852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25002566-d37d-43df-a900-acc9064ce0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.282852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25002566-d37d-43df-a900-acc9064ce0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.282852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25002566-d37d-43df-a900-acc9064ce0f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.282852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25002566-d37d-43df-a900-acc9064ce0f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:45.283176 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 780/1581] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:57:45 2022] POST /identity/v3/projects => generated 366 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:45.283862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61193f7e-c25e-4e7e-b87d-e4e7a2b9be96 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.284413 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25002566-d37d-43df-a900-acc9064ce0f5 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:45.337147 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61193f7e-c25e-4e7e-b87d-e4e7a2b9be96 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.340737 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0916a7f-bed8-4969-935b-15510b4a6e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.341448 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0916a7f-bed8-4969-935b-15510b4a6e37 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.341738 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0916a7f-bed8-4969-935b-15510b4a6e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.342026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0916a7f-bed8-4969-935b-15510b4a6e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.399686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0916a7f-bed8-4969-935b-15510b4a6e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:45.401133 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0916a7f-bed8-4969-935b-15510b4a6e37 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:45.411453 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 781/1582] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:45.412243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0916a7f-bed8-4969-935b-15510b4a6e37 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.421844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0916a7f-bed8-4969-935b-15510b4a6e37 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.427468 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d197ad-5e88-4998-82da-ef0abdfd796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.428171 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d197ad-5e88-4998-82da-ef0abdfd796e admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.428459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d197ad-5e88-4998-82da-ef0abdfd796e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.428741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d197ad-5e88-4998-82da-ef0abdfd796e admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.429469 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d197ad-5e88-4998-82da-ef0abdfd796e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:57:45.429778 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d197ad-5e88-4998-82da-ef0abdfd796e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:45.431413 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d197ad-5e88-4998-82da-ef0abdfd796e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:45.443977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 782/1583] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:57:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:57:45.444947 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d197ad-5e88-4998-82da-ef0abdfd796e admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.455324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d197ad-5e88-4998-82da-ef0abdfd796e admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.460004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30ad35-8863-46ac-9c2b-3d72a1e31834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.460302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 802/1584] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:57:45 2022] POST /identity/v3/projects => generated 406 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:45.461252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25002566-d37d-43df-a900-acc9064ce0f5 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.463784 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30ad35-8863-46ac-9c2b-3d72a1e31834 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.464085 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30ad35-8863-46ac-9c2b-3d72a1e31834 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.464376 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30ad35-8863-46ac-9c2b-3d72a1e31834 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.465111 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30ad35-8863-46ac-9c2b-3d72a1e31834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:45.466771 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30ad35-8863-46ac-9c2b-3d72a1e31834 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:45.480513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 783/1585] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:45 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:45.480513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30ad35-8863-46ac-9c2b-3d72a1e31834 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.488999 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30ad35-8863-46ac-9c2b-3d72a1e31834 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.526361 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25002566-d37d-43df-a900-acc9064ce0f5 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.534679 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb0e61-afd1-4b54-b524-5620bd162601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.536462 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb0e61-afd1-4b54-b524-5620bd162601 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.536759 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb0e61-afd1-4b54-b524-5620bd162601 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.537044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb0e61-afd1-4b54-b524-5620bd162601 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.537922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb0e61-afd1-4b54-b524-5620bd162601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:45.539938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb0e61-afd1-4b54-b524-5620bd162601 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:45.552069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca055c7a-673b-4b4f-a6cd-ad06daeabb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.552752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca055c7a-673b-4b4f-a6cd-ad06daeabb45 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.553530 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca055c7a-673b-4b4f-a6cd-ad06daeabb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.553530 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca055c7a-673b-4b4f-a6cd-ad06daeabb45 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.554176 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca055c7a-673b-4b4f-a6cd-ad06daeabb45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:45.556078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca055c7a-673b-4b4f-a6cd-ad06daeabb45 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:45.565139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:45.652535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 803/1586] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:57:45 2022] POST /identity/v3/projects => generated 378 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:45.652535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb0e61-afd1-4b54-b524-5620bd162601 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.681739 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 784/1587] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:57:45 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:45.682609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca055c7a-673b-4b4f-a6cd-ad06daeabb45 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.693324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca055c7a-673b-4b4f-a6cd-ad06daeabb45 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.713437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb0e61-afd1-4b54-b524-5620bd162601 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.718225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af1a80-3d51-4e3f-be43-125c295fa842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.718925 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af1a80-3d51-4e3f-be43-125c295fa842 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.719214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af1a80-3d51-4e3f-be43-125c295fa842 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.719512 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af1a80-3d51-4e3f-be43-125c295fa842 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.721154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af1a80-3d51-4e3f-be43-125c295fa842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:45.722848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af1a80-3d51-4e3f-be43-125c295fa842 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:45.732885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 804/1588] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:45 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:45.733662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af1a80-3d51-4e3f-be43-125c295fa842 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.744917 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af1a80-3d51-4e3f-be43-125c295fa842 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.749629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4ce9f-4e47-4495-8f62-4c6955a01382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.750265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4ce9f-4e47-4495-8f62-4c6955a01382 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.750582 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4ce9f-4e47-4495-8f62-4c6955a01382 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.750868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4ce9f-4e47-4495-8f62-4c6955a01382 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.751548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4ce9f-4e47-4495-8f62-4c6955a01382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:45.753482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4ce9f-4e47-4495-8f62-4c6955a01382 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:45.753623 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b512f7-102b-46e8-bb3d-b189a804d8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.754309 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b512f7-102b-46e8-bb3d-b189a804d8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.754689 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b512f7-102b-46e8-bb3d-b189a804d8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.754909 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b512f7-102b-46e8-bb3d-b189a804d8f2 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.755602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b512f7-102b-46e8-bb3d-b189a804d8f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:45.757881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b512f7-102b-46e8-bb3d-b189a804d8f2 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:45.757995 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:45.910025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 785/1589] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:57:45 2022] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:45.911064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b512f7-102b-46e8-bb3d-b189a804d8f2 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.915434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 805/1590] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:57:45 2022] POST /identity/v3/projects => generated 382 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:45.915434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4ce9f-4e47-4495-8f62-4c6955a01382 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:45.921001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b512f7-102b-46e8-bb3d-b189a804d8f2 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.978977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc91c0c-f526-4253-89cd-eb545dfa84bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.979658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc91c0c-f526-4253-89cd-eb545dfa84bf admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.979942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc91c0c-f526-4253-89cd-eb545dfa84bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.980219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc91c0c-f526-4253-89cd-eb545dfa84bf admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:45.980360 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4ce9f-4e47-4495-8f62-4c6955a01382 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:45.980936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc91c0c-f526-4253-89cd-eb545dfa84bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:45.982898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc91c0c-f526-4253-89cd-eb545dfa84bf admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:45.985754 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8648c-afcb-42e8-a28c-3e39fae39bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:45.986777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8648c-afcb-42e8-a28c-3e39fae39bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:45.987065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8648c-afcb-42e8-a28c-3e39fae39bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:45.987371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8648c-afcb-42e8-a28c-3e39fae39bbe admin admin] PATH_INFO: `/v3/projects/6f18b754d17d4ded958a80cf2781c72b/users/8207acca876a4af5ac75dd4283916763/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.003103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8648c-afcb-42e8-a28c-3e39fae39bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f18b754d17d4ded958a80cf2781c72b, user_id=8207acca876a4af5ac75dd4283916763, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.005846 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8648c-afcb-42e8-a28c-3e39fae39bbe admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.093095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 786/1591] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:57:45 2022] POST /identity/v3/users => generated 304 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:46.093996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc91c0c-f526-4253-89cd-eb545dfa84bf admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.104591 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc91c0c-f526-4253-89cd-eb545dfa84bf admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.109160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f4c0d-cdf9-44ec-a59d-ce7fa4634496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.109817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f4c0d-cdf9-44ec-a59d-ce7fa4634496 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.110144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f4c0d-cdf9-44ec-a59d-ce7fa4634496 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.111146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f4c0d-cdf9-44ec-a59d-ce7fa4634496 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.112008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f4c0d-cdf9-44ec-a59d-ce7fa4634496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.118686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f4c0d-cdf9-44ec-a59d-ce7fa4634496 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.124863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 806/1592] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:45 2022] PUT /identity/v3/projects/6f18b754d17d4ded958a80cf2781c72b/users/8207acca876a4af5ac75dd4283916763/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:46.124863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8648c-afcb-42e8-a28c-3e39fae39bbe admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.193943 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8648c-afcb-42e8-a28c-3e39fae39bbe admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.199713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142790-1461-4712-b5dc-ff93fa513b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.200541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142790-1461-4712-b5dc-ff93fa513b04 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.200870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142790-1461-4712-b5dc-ff93fa513b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.201177 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142790-1461-4712-b5dc-ff93fa513b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.202098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0142790-1461-4712-b5dc-ff93fa513b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.203866 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0142790-1461-4712-b5dc-ff93fa513b04 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.217472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 807/1593] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:46 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:46.218532 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142790-1461-4712-b5dc-ff93fa513b04 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.229013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142790-1461-4712-b5dc-ff93fa513b04 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.233582 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0239-78e0-4720-a3da-9095a02b8a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.234213 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0239-78e0-4720-a3da-9095a02b8a59 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.234534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0239-78e0-4720-a3da-9095a02b8a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.234813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0239-78e0-4720-a3da-9095a02b8a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.236133 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db0239-78e0-4720-a3da-9095a02b8a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.237703 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db0239-78e0-4720-a3da-9095a02b8a59 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.247372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 808/1594] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:46 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:46.248232 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0239-78e0-4720-a3da-9095a02b8a59 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.253736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 787/1595] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:57:46 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:46.254949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f4c0d-cdf9-44ec-a59d-ce7fa4634496 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.259194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0239-78e0-4720-a3da-9095a02b8a59 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.263874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e90b8-fe51-43ef-bb71-e6c7ab85d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.264529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e90b8-fe51-43ef-bb71-e6c7ab85d348 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.264814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e90b8-fe51-43ef-bb71-e6c7ab85d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.265093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e90b8-fe51-43ef-bb71-e6c7ab85d348 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.265807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e90b8-fe51-43ef-bb71-e6c7ab85d348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.268572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e90b8-fe51-43ef-bb71-e6c7ab85d348 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.268863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f4c0d-cdf9-44ec-a59d-ce7fa4634496 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.273506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63076911-8ba1-4298-8e19-8dde18396fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.274238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63076911-8ba1-4298-8e19-8dde18396fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.274563 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63076911-8ba1-4298-8e19-8dde18396fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.274902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63076911-8ba1-4298-8e19-8dde18396fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.275598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63076911-8ba1-4298-8e19-8dde18396fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.277560 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63076911-8ba1-4298-8e19-8dde18396fa4 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.283971 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 809/1596] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:46 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:46.285040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e90b8-fe51-43ef-bb71-e6c7ab85d348 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.296333 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e90b8-fe51-43ef-bb71-e6c7ab85d348 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.301370 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b7515-1241-4c09-aef3-58699a6d8d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.302034 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b7515-1241-4c09-aef3-58699a6d8d0e admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.302313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b7515-1241-4c09-aef3-58699a6d8d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.302621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b7515-1241-4c09-aef3-58699a6d8d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.303485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b7515-1241-4c09-aef3-58699a6d8d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.305071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b7515-1241-4c09-aef3-58699a6d8d0e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.315671 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 810/1597] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:46 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:46.316938 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c430146-4e44-4daa-a4c7-2d9aa1c0079d None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.317224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c430146-4e44-4daa-a4c7-2d9aa1c0079d None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.317504 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c430146-4e44-4daa-a4c7-2d9aa1c0079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.337153 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-1c430146-4e44-4daa-a4c7-2d9aa1c0079d None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:46.338527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1c430146-4e44-4daa-a4c7-2d9aa1c0079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:46.346350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 811/1598] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:46.350498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c430146-4e44-4daa-a4c7-2d9aa1c0079d None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.359040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c430146-4e44-4daa-a4c7-2d9aa1c0079d None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.364431 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb23cd0-8bd2-411d-8d3c-7d54d5581674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.365106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb23cd0-8bd2-411d-8d3c-7d54d5581674 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.365426 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb23cd0-8bd2-411d-8d3c-7d54d5581674 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.365708 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb23cd0-8bd2-411d-8d3c-7d54d5581674 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.366479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb23cd0-8bd2-411d-8d3c-7d54d5581674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.368173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb23cd0-8bd2-411d-8d3c-7d54d5581674 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.383465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 812/1599] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:46 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:46.384297 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb23cd0-8bd2-411d-8d3c-7d54d5581674 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.385283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 788/1600] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:57:46 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:46.386232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63076911-8ba1-4298-8e19-8dde18396fa4 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.397341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb23cd0-8bd2-411d-8d3c-7d54d5581674 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.398360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63076911-8ba1-4298-8e19-8dde18396fa4 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.402596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4668a-abe4-431a-8339-26b484c88f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.403493 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4668a-abe4-431a-8339-26b484c88f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.403786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4668a-abe4-431a-8339-26b484c88f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.404049 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4668a-abe4-431a-8339-26b484c88f69 admin admin] PATH_INFO: `/v3/projects/b56aa3839b5046809cea98a15da74f70/users/211d5744e75b488090c87b065a2a34ef/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.404721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bfe7b-b93e-46ea-be22-f1ff0f3ae3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.405223 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bfe7b-b93e-46ea-be22-f1ff0f3ae3af admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.405512 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bfe7b-b93e-46ea-be22-f1ff0f3ae3af admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.405792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bfe7b-b93e-46ea-be22-f1ff0f3ae3af admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.406650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bfe7b-b93e-46ea-be22-f1ff0f3ae3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.409104 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bfe7b-b93e-46ea-be22-f1ff0f3ae3af admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.419798 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 789/1601] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:46 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:46.420848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bfe7b-b93e-46ea-be22-f1ff0f3ae3af admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.424428 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:46.427822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4668a-abe4-431a-8339-26b484c88f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56aa3839b5046809cea98a15da74f70, user_id=211d5744e75b488090c87b065a2a34ef, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.430655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4668a-abe4-431a-8339-26b484c88f69 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.432708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bfe7b-b93e-46ea-be22-f1ff0f3ae3af admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.437636 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190105a-7bcf-4436-982a-0899c2376e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.439019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190105a-7bcf-4436-982a-0899c2376e73 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.448231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190105a-7bcf-4436-982a-0899c2376e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.448231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190105a-7bcf-4436-982a-0899c2376e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.448231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190105a-7bcf-4436-982a-0899c2376e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.448231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190105a-7bcf-4436-982a-0899c2376e73 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.452292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 790/1602] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:46 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:46.453392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190105a-7bcf-4436-982a-0899c2376e73 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.464889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190105a-7bcf-4436-982a-0899c2376e73 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.469369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54042de5-fdfe-4c03-99d1-17548f3ca578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.470170 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54042de5-fdfe-4c03-99d1-17548f3ca578 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.470491 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54042de5-fdfe-4c03-99d1-17548f3ca578 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.470770 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54042de5-fdfe-4c03-99d1-17548f3ca578 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.471485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54042de5-fdfe-4c03-99d1-17548f3ca578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.473054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54042de5-fdfe-4c03-99d1-17548f3ca578 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.483169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 791/1603] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:46 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:46.483935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54042de5-fdfe-4c03-99d1-17548f3ca578 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.486026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-54042de5-fdfe-4c03-99d1-17548f3ca578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:46.491988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:INSERT=13,keystone:SELECT=87 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:46.539875 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 813/1604] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:46 2022] PUT /identity/v3/projects/b56aa3839b5046809cea98a15da74f70/users/211d5744e75b488090c87b065a2a34ef/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:46.541085 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4668a-abe4-431a-8339-26b484c88f69 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.552153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54042de5-fdfe-4c03-99d1-17548f3ca578 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.611318 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8bf3a-6c04-4050-ba08-3356dd595bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.611989 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8bf3a-6c04-4050-ba08-3356dd595bef service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.612276 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8bf3a-6c04-4050-ba08-3356dd595bef service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.612554 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8bf3a-6c04-4050-ba08-3356dd595bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.616637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4668a-abe4-431a-8339-26b484c88f69 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.622015 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8bf3a-6c04-4050-ba08-3356dd595bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.622831 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef58db-b241-4d93-950d-9333ab1fa9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.623503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8bf3a-6c04-4050-ba08-3356dd595bef service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.623754 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef58db-b241-4d93-950d-9333ab1fa9ee admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.624071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef58db-b241-4d93-950d-9333ab1fa9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.624351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef58db-b241-4d93-950d-9333ab1fa9ee admin admin] PATH_INFO: `/v3/projects/0c9ae847a0d449ab9c875f8a4f936d6a/users/9e09f6a92f064ec78231fa06782bafda/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.633994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 792/1605] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:46.634783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8bf3a-6c04-4050-ba08-3356dd595bef service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.640135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef58db-b241-4d93-950d-9333ab1fa9ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9ae847a0d449ab9c875f8a4f936d6a, user_id=9e09f6a92f064ec78231fa06782bafda, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.644057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8bf3a-6c04-4050-ba08-3356dd595bef service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.644336 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef58db-b241-4d93-950d-9333ab1fa9ee admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.648692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbe186-943c-4a18-8d34-ddfe9227725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.649357 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbe186-943c-4a18-8d34-ddfe9227725a admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.649652 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbe186-943c-4a18-8d34-ddfe9227725a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.649941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbe186-943c-4a18-8d34-ddfe9227725a admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.650668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbe186-943c-4a18-8d34-ddfe9227725a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.652320 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbe186-943c-4a18-8d34-ddfe9227725a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.663064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 793/1606] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:46 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:46.664045 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbe186-943c-4a18-8d34-ddfe9227725a admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.674798 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbe186-943c-4a18-8d34-ddfe9227725a admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.679965 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c371c-aa05-42ad-8276-3d1ee2cfad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.680654 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c371c-aa05-42ad-8276-3d1ee2cfad7d admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.680975 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c371c-aa05-42ad-8276-3d1ee2cfad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.682315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c371c-aa05-42ad-8276-3d1ee2cfad7d admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.682315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c371c-aa05-42ad-8276-3d1ee2cfad7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.684017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c371c-aa05-42ad-8276-3d1ee2cfad7d admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.695086 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 794/1607] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:46 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:46.695841 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c371c-aa05-42ad-8276-3d1ee2cfad7d admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.705775 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c371c-aa05-42ad-8276-3d1ee2cfad7d admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.710595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3558dd-4e3f-476b-9016-2e48f611547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.711466 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3558dd-4e3f-476b-9016-2e48f611547a admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.711744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3558dd-4e3f-476b-9016-2e48f611547a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.712017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3558dd-4e3f-476b-9016-2e48f611547a admin admin] PATH_INFO: `/v3/projects/ecabe67e9f0046908d4f3d8f2f519607/users/e2dcf37c096241edbf3f784ccedb97ad/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.730976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3558dd-4e3f-476b-9016-2e48f611547a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecabe67e9f0046908d4f3d8f2f519607, user_id=e2dcf37c096241edbf3f784ccedb97ad, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.731472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 814/1608] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:46 2022] PUT /identity/v3/projects/0c9ae847a0d449ab9c875f8a4f936d6a/users/9e09f6a92f064ec78231fa06782bafda/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:46.732869 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef58db-b241-4d93-950d-9333ab1fa9ee admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.734640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3558dd-4e3f-476b-9016-2e48f611547a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.810187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef58db-b241-4d93-950d-9333ab1fa9ee admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:46.815243 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284b275-ba3e-4306-86d0-59e7b3405934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:46.816086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284b275-ba3e-4306-86d0-59e7b3405934 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.816383 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284b275-ba3e-4306-86d0-59e7b3405934 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.818482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284b275-ba3e-4306-86d0-59e7b3405934 admin admin] PATH_INFO: `/v3/projects/2bbfa92caa7648eeb84e45be2340fe4e/users/580ab3a0455440389c31d17060f23f97/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.824415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 795/1609] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:46 2022] PUT /identity/v3/projects/ecabe67e9f0046908d4f3d8f2f519607/users/e2dcf37c096241edbf3f784ccedb97ad/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:46.825492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee85db1-4be6-48c3-903e-6bc0297e1b1c None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:46.825859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee85db1-4be6-48c3-903e-6bc0297e1b1c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:46.826061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee85db1-4be6-48c3-903e-6bc0297e1b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:46.838813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284b275-ba3e-4306-86d0-59e7b3405934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbfa92caa7648eeb84e45be2340fe4e, user_id=580ab3a0455440389c31d17060f23f97, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:46.841548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284b275-ba3e-4306-86d0-59e7b3405934 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:46.861428 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-7ee85db1-4be6-48c3-903e-6bc0297e1b1c None None] MFA Rules not processed for user `211d5744e75b488090c87b065a2a34ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:46.861428 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7ee85db1-4be6-48c3-903e-6bc0297e1b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:46.924613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 815/1610] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:46 2022] PUT /identity/v3/projects/2bbfa92caa7648eeb84e45be2340fe4e/users/580ab3a0455440389c31d17060f23f97/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:46.930558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284b275-ba3e-4306-86d0-59e7b3405934 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.948883 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 796/1611] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:46.952305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee85db1-4be6-48c3-903e-6bc0297e1b1c None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:46.968171 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:47.001456 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:47.005964 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284b275-ba3e-4306-86d0-59e7b3405934 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:47.011345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67c151-86b3-4329-ac6f-3034cec00054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:47.012260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67c151-86b3-4329-ac6f-3034cec00054 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:47.012616 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67c151-86b3-4329-ac6f-3034cec00054 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:47.013091 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67c151-86b3-4329-ac6f-3034cec00054 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:47.014430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67c151-86b3-4329-ac6f-3034cec00054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:47.015865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67c151-86b3-4329-ac6f-3034cec00054 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:47.031635 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 816/1612] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:46 2022] GET /identity/v3/roles => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:47.037980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee561fd3-075e-48ed-978f-7373ded2d362 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:47.037980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee561fd3-075e-48ed-978f-7373ded2d362 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:47.037980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee561fd3-075e-48ed-978f-7373ded2d362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:47.046306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee85db1-4be6-48c3-903e-6bc0297e1b1c None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:47.056487 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acfb4b-f11e-45c3-acea-708be8ea4acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:47.057376 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acfb4b-f11e-45c3-acea-708be8ea4acb admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:47.057660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acfb4b-f11e-45c3-acea-708be8ea4acb admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:47.057935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acfb4b-f11e-45c3-acea-708be8ea4acb admin admin] PATH_INFO: `/v3/projects/642e24c7c239432b93d0e03f7022cc0e/users/5bdb3e36e5934d1fbf2204cac57be139/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:47.059112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-ee561fd3-075e-48ed-978f-7373ded2d362 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:47.060339 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ee561fd3-075e-48ed-978f-7373ded2d362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:47.075336 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acfb4b-f11e-45c3-acea-708be8ea4acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=642e24c7c239432b93d0e03f7022cc0e, user_id=5bdb3e36e5934d1fbf2204cac57be139, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:47.078648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acfb4b-f11e-45c3-acea-708be8ea4acb admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:47.081994 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 817/1613] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:47.084380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dc8f1-fea2-4e60-8c5e-53e1d91fc885 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:47.085870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dc8f1-fea2-4e60-8c5e-53e1d91fc885 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:47.086337 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dc8f1-fea2-4e60-8c5e-53e1d91fc885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:47.124198 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-6c5dc8f1-fea2-4e60-8c5e-53e1d91fc885 None None] MFA Rules not processed for user `e2dcf37c096241edbf3f784ccedb97ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:47.124198 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6c5dc8f1-fea2-4e60-8c5e-53e1d91fc885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:47.180430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 797/1614] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:46 2022] PUT /identity/v3/projects/642e24c7c239432b93d0e03f7022cc0e/users/5bdb3e36e5934d1fbf2204cac57be139/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:47.180430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c01c20-6923-4930-8f4b-bb248d2a4523 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:47.180430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c01c20-6923-4930-8f4b-bb248d2a4523 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:47.180430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c01c20-6923-4930-8f4b-bb248d2a4523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:47.205702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 818/1615] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:47.206809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dc8f1-fea2-4e60-8c5e-53e1d91fc885 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:47.220896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dc8f1-fea2-4e60-8c5e-53e1d91fc885 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:47.226305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-a0c01c20-6923-4930-8f4b-bb248d2a4523 None None] MFA Rules not processed for user `580ab3a0455440389c31d17060f23f97`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:47.228495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a0c01c20-6923-4930-8f4b-bb248d2a4523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:47.303287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505df460-12d9-4ba4-a13a-258b3ff546f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:47.304186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505df460-12d9-4ba4-a13a-258b3ff546f0 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:47.304479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505df460-12d9-4ba4-a13a-258b3ff546f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:47.304763 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505df460-12d9-4ba4-a13a-258b3ff546f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:47.305523 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505df460-12d9-4ba4-a13a-258b3ff546f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:47.307944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505df460-12d9-4ba4-a13a-258b3ff546f0 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:47.310369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 798/1616] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:47 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:47.311378 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c01c20-6923-4930-8f4b-bb248d2a4523 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:47.328741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c01c20-6923-4930-8f4b-bb248d2a4523 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:47.334969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c3108-9029-44a2-b8a0-3aa98795c1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:47.335933 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c3108-9029-44a2-b8a0-3aa98795c1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:47.336218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c3108-9029-44a2-b8a0-3aa98795c1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:47.336501 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c3108-9029-44a2-b8a0-3aa98795c1d5 admin admin] PATH_INFO: `/v3/projects/59358446c4044832a7794ce504dfc92a/users/c4c90777ae734707a4f7245ea8035851/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:47.353410 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c3108-9029-44a2-b8a0-3aa98795c1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59358446c4044832a7794ce504dfc92a, user_id=c4c90777ae734707a4f7245ea8035851, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:47.356126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c3108-9029-44a2-b8a0-3aa98795c1d5 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:47.420820 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 819/1618] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:57:47 2022] POST /identity/v3/projects => generated 400 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:47.422069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505df460-12d9-4ba4-a13a-258b3ff546f0 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:47.429169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 799/1618] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:47 2022] PUT /identity/v3/projects/59358446c4044832a7794ce504dfc92a/users/c4c90777ae734707a4f7245ea8035851/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:47.430942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd365f2a-5303-4ab6-ade6-03d31de43cc3 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:47.431332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd365f2a-5303-4ab6-ade6-03d31de43cc3 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:47.435507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd365f2a-5303-4ab6-ade6-03d31de43cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:47.451836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-cd365f2a-5303-4ab6-ade6-03d31de43cc3 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:47.453297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-cd365f2a-5303-4ab6-ade6-03d31de43cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:47.528170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505df460-12d9-4ba4-a13a-258b3ff546f0 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:47.536044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512e4cf-ca03-449d-8e87-5dc345fc1409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:47.536734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e4cf-ca03-449d-8e87-5dc345fc1409 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:47.537026 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e4cf-ca03-449d-8e87-5dc345fc1409 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:47.538048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e4cf-ca03-449d-8e87-5dc345fc1409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:47.539315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:47.553357 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 800/1619] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:47.554299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd365f2a-5303-4ab6-ade6-03d31de43cc3 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:47.563214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:47.565988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd365f2a-5303-4ab6-ade6-03d31de43cc3 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:47.571917 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a595a9b-315d-4dac-ada1-7d5fac349523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:47.572565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a595a9b-315d-4dac-ada1-7d5fac349523 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:47.572952 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a595a9b-315d-4dac-ada1-7d5fac349523 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:47.573326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a595a9b-315d-4dac-ada1-7d5fac349523 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:47.574124 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a595a9b-315d-4dac-ada1-7d5fac349523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:47.576161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a595a9b-315d-4dac-ada1-7d5fac349523 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:47.625474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512e4cf-ca03-449d-8e87-5dc345fc1409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:47.628565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512e4cf-ca03-449d-8e87-5dc345fc1409 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:47.639604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 820/1620] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:47.640315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512e4cf-ca03-449d-8e87-5dc345fc1409 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:47.651476 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512e4cf-ca03-449d-8e87-5dc345fc1409 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:47.656362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77210a77-1b88-436e-8def-b25c6451dc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:47.657047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77210a77-1b88-436e-8def-b25c6451dc99 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:47.657907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77210a77-1b88-436e-8def-b25c6451dc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:47.658203 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77210a77-1b88-436e-8def-b25c6451dc99 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:47.659834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77210a77-1b88-436e-8def-b25c6451dc99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:47.661017 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77210a77-1b88-436e-8def-b25c6451dc99 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:47.731240 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 801/1621] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:57:47 2022] POST /identity/v3/projects => generated 366 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:47.732295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a595a9b-315d-4dac-ada1-7d5fac349523 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:47.787188 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 821/1622] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:57:47 2022] POST /identity/v3/projects => generated 402 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:47.788587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8869f5-5a03-4022-bd0d-03b30a6538c0 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:47.788871 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8869f5-5a03-4022-bd0d-03b30a6538c0 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:47.789146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8869f5-5a03-4022-bd0d-03b30a6538c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:47.837206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a595a9b-315d-4dac-ada1-7d5fac349523 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:47.847049 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-5d8869f5-5a03-4022-bd0d-03b30a6538c0 None None] MFA Rules not processed for user `c4c90777ae734707a4f7245ea8035851`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:47.848833 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5d8869f5-5a03-4022-bd0d-03b30a6538c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:47.939189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a3fe7-04d7-46b3-8bd7-a4df6d0851ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:47.940090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a3fe7-04d7-46b3-8bd7-a4df6d0851ff admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:47.942089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a3fe7-04d7-46b3-8bd7-a4df6d0851ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:47.942089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a3fe7-04d7-46b3-8bd7-a4df6d0851ff admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:47.942266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a3fe7-04d7-46b3-8bd7-a4df6d0851ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:47.944323 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a3fe7-04d7-46b3-8bd7-a4df6d0851ff admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:48.210924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 822/1623] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:48.210924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8869f5-5a03-4022-bd0d-03b30a6538c0 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:48.210924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8869f5-5a03-4022-bd0d-03b30a6538c0 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:48.210924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a508ba8-a525-463d-b63e-4e19ab6760ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:48.214047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a508ba8-a525-463d-b63e-4e19ab6760ec service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:48.214047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a508ba8-a525-463d-b63e-4e19ab6760ec service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:48.214047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a508ba8-a525-463d-b63e-4e19ab6760ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:48.214047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a508ba8-a525-463d-b63e-4e19ab6760ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:48.214047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a508ba8-a525-463d-b63e-4e19ab6760ec service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:48.214047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 823/1624] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:48.215315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a508ba8-a525-463d-b63e-4e19ab6760ec service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:48.215550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 802/1625] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:57:47 2022] POST /identity/v3/users => generated 307 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:48.215550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a3fe7-04d7-46b3-8bd7-a4df6d0851ff admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:48.215857 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a508ba8-a525-463d-b63e-4e19ab6760ec service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:48.215960 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a3fe7-04d7-46b3-8bd7-a4df6d0851ff admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:48.216037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece91da8-2afb-4863-b75d-e8043b1e2d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:48.216037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece91da8-2afb-4863-b75d-e8043b1e2d4e admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:48.216037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece91da8-2afb-4863-b75d-e8043b1e2d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:48.216037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece91da8-2afb-4863-b75d-e8043b1e2d4e admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:48.216320 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece91da8-2afb-4863-b75d-e8043b1e2d4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:48.216320 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece91da8-2afb-4863-b75d-e8043b1e2d4e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:48.216489 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599ac65-8dd7-4241-8176-4fa5a082a351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:48.216489 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599ac65-8dd7-4241-8176-4fa5a082a351 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:48.216489 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599ac65-8dd7-4241-8176-4fa5a082a351 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:48.216489 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599ac65-8dd7-4241-8176-4fa5a082a351 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:48.216826 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599ac65-8dd7-4241-8176-4fa5a082a351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:48.216826 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599ac65-8dd7-4241-8176-4fa5a082a351 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:48.452051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 824/1626] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:57:48 2022] POST /identity/v3/users => generated 290 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:48.452889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece91da8-2afb-4863-b75d-e8043b1e2d4e admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:48.463343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:48.468601 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 803/1627] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:57:48 2022] POST /identity/v3/users => generated 308 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:48.468601 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599ac65-8dd7-4241-8176-4fa5a082a351 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:48.469687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece91da8-2afb-4863-b75d-e8043b1e2d4e admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:48.476585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e308bb-a164-4c12-a08f-b759f1f47491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:48.477433 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e308bb-a164-4c12-a08f-b759f1f47491 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:48.477717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e308bb-a164-4c12-a08f-b759f1f47491 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:48.477997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e308bb-a164-4c12-a08f-b759f1f47491 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:48.478739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e308bb-a164-4c12-a08f-b759f1f47491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:48.480771 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e308bb-a164-4c12-a08f-b759f1f47491 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:48.484723 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599ac65-8dd7-4241-8176-4fa5a082a351 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:48.488959 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39439f-c643-4a61-8528-01331d5db952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:48.490632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39439f-c643-4a61-8528-01331d5db952 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:48.490923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39439f-c643-4a61-8528-01331d5db952 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:48.491206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39439f-c643-4a61-8528-01331d5db952 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:48.491992 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39439f-c643-4a61-8528-01331d5db952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:48.493674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39439f-c643-4a61-8528-01331d5db952 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:48.515445 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 804/1628] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:48 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:48.515445 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39439f-c643-4a61-8528-01331d5db952 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:48.527169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39439f-c643-4a61-8528-01331d5db952 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:48.617224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8f15f-d108-4421-9280-028c356eafcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:48.617224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8f15f-d108-4421-9280-028c356eafcd admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:48.617224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8f15f-d108-4421-9280-028c356eafcd admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:48.617224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8f15f-d108-4421-9280-028c356eafcd admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:48.618024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8f15f-d108-4421-9280-028c356eafcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:48.618024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8f15f-d108-4421-9280-028c356eafcd admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:48.618024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 805/1629] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:48 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:48.618024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8f15f-d108-4421-9280-028c356eafcd admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:48.625106 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8f15f-d108-4421-9280-028c356eafcd admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:48.638685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1e919-e790-496e-ba5b-5704cd156c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:48.639385 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1e919-e790-496e-ba5b-5704cd156c8c admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:48.639788 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1e919-e790-496e-ba5b-5704cd156c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:48.640121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1e919-e790-496e-ba5b-5704cd156c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:48.641115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1e919-e790-496e-ba5b-5704cd156c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:48.645945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1e919-e790-496e-ba5b-5704cd156c8c admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:48.673650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 806/1630] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:48 2022] GET /identity/v3/roles => generated 1427 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:48.673650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1e919-e790-496e-ba5b-5704cd156c8c admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:48.673891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 825/1631] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:57:48 2022] POST /identity/v3/projects => generated 380 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:48.675088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e308bb-a164-4c12-a08f-b759f1f47491 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:48.704327 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1e919-e790-496e-ba5b-5704cd156c8c admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:48.768027 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:48.828779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e308bb-a164-4c12-a08f-b759f1f47491 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:48.834819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437b860-afad-4648-a430-182ff3f78c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:48.836867 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437b860-afad-4648-a430-182ff3f78c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:48.837396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437b860-afad-4648-a430-182ff3f78c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:48.837880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437b860-afad-4648-a430-182ff3f78c2a admin admin] PATH_INFO: `/v3/projects/9e02a1df275d412f932f9fa537e4b6e2/users/4b1c82df5d104c8fa44a39b5ac5eb775/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:48.864218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437b860-afad-4648-a430-182ff3f78c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e02a1df275d412f932f9fa537e4b6e2, user_id=4b1c82df5d104c8fa44a39b5ac5eb775, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:48.871739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437b860-afad-4648-a430-182ff3f78c2a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:48.889441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559e16b-8a41-4e0c-bf00-780ff9efe8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:48.890437 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559e16b-8a41-4e0c-bf00-780ff9efe8f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:48.890690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559e16b-8a41-4e0c-bf00-780ff9efe8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:48.890970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559e16b-8a41-4e0c-bf00-780ff9efe8f3 admin admin] PATH_INFO: `/v3/projects/a6a4d83b2cef47a38a23aab7fc470d51/users/f4f54542ccc34107a9da6660b8622651/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:48.924470 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559e16b-8a41-4e0c-bf00-780ff9efe8f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a4d83b2cef47a38a23aab7fc470d51, user_id=f4f54542ccc34107a9da6660b8622651, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:48.927996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559e16b-8a41-4e0c-bf00-780ff9efe8f3 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:48.968423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 826/1632] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:48 2022] PUT /identity/v3/projects/9e02a1df275d412f932f9fa537e4b6e2/users/4b1c82df5d104c8fa44a39b5ac5eb775/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:48.969505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437b860-afad-4648-a430-182ff3f78c2a admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:49.040524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 807/1633] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:48 2022] PUT /identity/v3/projects/a6a4d83b2cef47a38a23aab7fc470d51/users/f4f54542ccc34107a9da6660b8622651/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:49.042374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559e16b-8a41-4e0c-bf00-780ff9efe8f3 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:49.080817 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437b860-afad-4648-a430-182ff3f78c2a admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:49.181440 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559e16b-8a41-4e0c-bf00-780ff9efe8f3 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:49.199646 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719af53-aa20-4995-bcca-31cd500ccf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:49.202549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719af53-aa20-4995-bcca-31cd500ccf4a admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:49.208875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719af53-aa20-4995-bcca-31cd500ccf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:49.208875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719af53-aa20-4995-bcca-31cd500ccf4a admin admin] PATH_INFO: `/v3/projects/2649760dfcb44b2ab6959d359907751c/users/e615116367284fc9acdbf89d282ec1a0/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:49.230491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18805e2-f59f-453f-b14b-de5c675022c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:49.231119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18805e2-f59f-453f-b14b-de5c675022c2 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:49.231404 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18805e2-f59f-453f-b14b-de5c675022c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:49.231683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18805e2-f59f-453f-b14b-de5c675022c2 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:49.232463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18805e2-f59f-453f-b14b-de5c675022c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:49.234490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18805e2-f59f-453f-b14b-de5c675022c2 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:49.244851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719af53-aa20-4995-bcca-31cd500ccf4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2649760dfcb44b2ab6959d359907751c, user_id=e615116367284fc9acdbf89d282ec1a0, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:49.247704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719af53-aa20-4995-bcca-31cd500ccf4a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:49.374227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 808/1634] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:49 2022] PUT /identity/v3/projects/2649760dfcb44b2ab6959d359907751c/users/e615116367284fc9acdbf89d282ec1a0/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:49.375498 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719af53-aa20-4995-bcca-31cd500ccf4a admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:49.383574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 827/1635] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:57:48 2022] POST /identity/v3/users => generated 297 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:49.384954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18805e2-f59f-453f-b14b-de5c675022c2 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:49.402215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18805e2-f59f-453f-b14b-de5c675022c2 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:49.506299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd3ab0-026e-40dd-8943-bbb905a6eae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:49.508254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd3ab0-026e-40dd-8943-bbb905a6eae8 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:49.510243 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd3ab0-026e-40dd-8943-bbb905a6eae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:49.510721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd3ab0-026e-40dd-8943-bbb905a6eae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:49.511686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd3ab0-026e-40dd-8943-bbb905a6eae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:49.514167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd3ab0-026e-40dd-8943-bbb905a6eae8 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:49.515778 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719af53-aa20-4995-bcca-31cd500ccf4a admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:49.533812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fdfe6-613d-4e4d-9a37-444151304c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:49.534610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fdfe6-613d-4e4d-9a37-444151304c08 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:49.537840 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fdfe6-613d-4e4d-9a37-444151304c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:49.537840 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fdfe6-613d-4e4d-9a37-444151304c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:49.537840 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fdfe6-613d-4e4d-9a37-444151304c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:49.537840 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fdfe6-613d-4e4d-9a37-444151304c08 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:49.538789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 828/1636] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:49 2022] GET /identity/v3/roles => generated 1427 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:49.539676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd3ab0-026e-40dd-8943-bbb905a6eae8 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:49.566076 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 809/1637] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:49 2022] GET /identity/v3/roles => generated 1427 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:49.571871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fdfe6-613d-4e4d-9a37-444151304c08 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:49.572002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd3ab0-026e-40dd-8943-bbb905a6eae8 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:49.578008 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3c168-f078-4784-97ad-028d8abf58f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:49.578738 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3c168-f078-4784-97ad-028d8abf58f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:49.580865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3c168-f078-4784-97ad-028d8abf58f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:49.581205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3c168-f078-4784-97ad-028d8abf58f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:49.583249 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fdfe6-613d-4e4d-9a37-444151304c08 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:49.583435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3c168-f078-4784-97ad-028d8abf58f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:49.585513 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3c168-f078-4784-97ad-028d8abf58f6 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:49.602179 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de02217-cd04-4dde-88d0-3c7dff767919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:49.603102 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de02217-cd04-4dde-88d0-3c7dff767919 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:49.603448 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de02217-cd04-4dde-88d0-3c7dff767919 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:49.612559 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de02217-cd04-4dde-88d0-3c7dff767919 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:49.612559 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de02217-cd04-4dde-88d0-3c7dff767919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:49.612559 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de02217-cd04-4dde-88d0-3c7dff767919 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:49.619010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 829/1638] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:49 2022] GET /identity/v3/roles => generated 1427 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:49.619010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3c168-f078-4784-97ad-028d8abf58f6 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:49.637004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 810/1639] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:49 2022] GET /identity/v3/roles => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:49.637004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de02217-cd04-4dde-88d0-3c7dff767919 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:49.647980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3c168-f078-4784-97ad-028d8abf58f6 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:49.661294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32270aac-7bc2-4fae-aa48-29d31299c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:49.662438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de02217-cd04-4dde-88d0-3c7dff767919 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:49.662578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32270aac-7bc2-4fae-aa48-29d31299c820 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:49.662578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32270aac-7bc2-4fae-aa48-29d31299c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:49.662805 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32270aac-7bc2-4fae-aa48-29d31299c820 admin admin] PATH_INFO: `/v3/projects/a6a4d83b2cef47a38a23aab7fc470d51/users/f4f54542ccc34107a9da6660b8622651/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:49.665192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32270aac-7bc2-4fae-aa48-29d31299c820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a4d83b2cef47a38a23aab7fc470d51, user_id=f4f54542ccc34107a9da6660b8622651, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:49.668641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32270aac-7bc2-4fae-aa48-29d31299c820 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:49.675882 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543af54-34ba-4f74-a809-7cc2e280c106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:49.677148 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543af54-34ba-4f74-a809-7cc2e280c106 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:49.677823 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543af54-34ba-4f74-a809-7cc2e280c106 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:49.677823 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543af54-34ba-4f74-a809-7cc2e280c106 admin admin] PATH_INFO: `/v3/projects/9e02a1df275d412f932f9fa537e4b6e2/users/4b1c82df5d104c8fa44a39b5ac5eb775/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:49.681571 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543af54-34ba-4f74-a809-7cc2e280c106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e02a1df275d412f932f9fa537e4b6e2, user_id=4b1c82df5d104c8fa44a39b5ac5eb775, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:49.682347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 830/1640] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:49 2022] PUT /identity/v3/projects/a6a4d83b2cef47a38a23aab7fc470d51/users/f4f54542ccc34107a9da6660b8622651/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:49.683275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32270aac-7bc2-4fae-aa48-29d31299c820 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:49.689168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543af54-34ba-4f74-a809-7cc2e280c106 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:49.725972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 811/1641] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:49 2022] PUT /identity/v3/projects/9e02a1df275d412f932f9fa537e4b6e2/users/4b1c82df5d104c8fa44a39b5ac5eb775/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:49.725972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543af54-34ba-4f74-a809-7cc2e280c106 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:49.809339 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32270aac-7bc2-4fae-aa48-29d31299c820 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:49.812469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:49.846482 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543af54-34ba-4f74-a809-7cc2e280c106 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:49.853553 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8df70-a900-4acb-9afd-8876d1322c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:49.855143 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8df70-a900-4acb-9afd-8876d1322c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:49.855452 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8df70-a900-4acb-9afd-8876d1322c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:49.855734 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8df70-a900-4acb-9afd-8876d1322c65 admin admin] PATH_INFO: `/v3/projects/991c85a25e7040bc9c3feee4d8c39f56/users/a6b139d00f544c44a08c4752b6ee2f97/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:49.905115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8df70-a900-4acb-9afd-8876d1322c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991c85a25e7040bc9c3feee4d8c39f56, user_id=a6b139d00f544c44a08c4752b6ee2f97, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:49.912074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8df70-a900-4acb-9afd-8876d1322c65 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:49.954438 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d8fc2-f5f2-4f05-b15a-b7f392a9f954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:49.956128 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d8fc2-f5f2-4f05-b15a-b7f392a9f954 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:49.956632 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d8fc2-f5f2-4f05-b15a-b7f392a9f954 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:49.957158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d8fc2-f5f2-4f05-b15a-b7f392a9f954 admin admin] PATH_INFO: `/v3/projects/2649760dfcb44b2ab6959d359907751c/users/e615116367284fc9acdbf89d282ec1a0/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:49.959988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d8fc2-f5f2-4f05-b15a-b7f392a9f954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2649760dfcb44b2ab6959d359907751c, user_id=e615116367284fc9acdbf89d282ec1a0, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:49.963481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d8fc2-f5f2-4f05-b15a-b7f392a9f954 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:49.987474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 831/1642] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:49 2022] PUT /identity/v3/projects/2649760dfcb44b2ab6959d359907751c/users/e615116367284fc9acdbf89d282ec1a0/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:49.989408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acc572-ea6a-491b-929a-e99804bdb52f None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:49.991380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acc572-ea6a-491b-929a-e99804bdb52f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:49.991926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acc572-ea6a-491b-929a-e99804bdb52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:50.009221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 812/1643] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:49 2022] PUT /identity/v3/projects/991c85a25e7040bc9c3feee4d8c39f56/users/a6b139d00f544c44a08c4752b6ee2f97/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:50.010553 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfab70-4350-40ab-ae8f-9f50723d07f0 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:50.010924 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfab70-4350-40ab-ae8f-9f50723d07f0 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:50.011294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfab70-4350-40ab-ae8f-9f50723d07f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:50.049652 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-07dfab70-4350-40ab-ae8f-9f50723d07f0 None None] MFA Rules not processed for user `4b1c82df5d104c8fa44a39b5ac5eb775`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:50.050918 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-07dfab70-4350-40ab-ae8f-9f50723d07f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:50.053935 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-03acc572-ea6a-491b-929a-e99804bdb52f None None] MFA Rules not processed for user `f4f54542ccc34107a9da6660b8622651`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:50.056134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-03acc572-ea6a-491b-929a-e99804bdb52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:50.161544 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 813/1644] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:50.163098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f4134-9201-4575-97e3-2da451aebc4a None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:50.163403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f4134-9201-4575-97e3-2da451aebc4a None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:50.163900 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f4134-9201-4575-97e3-2da451aebc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:50.210875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-a55f4134-9201-4575-97e3-2da451aebc4a None None] MFA Rules not processed for user `e615116367284fc9acdbf89d282ec1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:50.213116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a55f4134-9201-4575-97e3-2da451aebc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:50.219615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:50.244308 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 832/1645] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:49 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:50.245213 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acc572-ea6a-491b-929a-e99804bdb52f None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:50.368065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acc572-ea6a-491b-929a-e99804bdb52f None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:50.369332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 814/1646] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:50 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:50.371349 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f4134-9201-4575-97e3-2da451aebc4a None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:50.373858 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099633b-2777-4e0f-bd1b-8dfcfe669e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:50.375281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099633b-2777-4e0f-bd1b-8dfcfe669e4b admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:50.375570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099633b-2777-4e0f-bd1b-8dfcfe669e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:50.376229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099633b-2777-4e0f-bd1b-8dfcfe669e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:50.377125 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099633b-2777-4e0f-bd1b-8dfcfe669e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:50.379021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099633b-2777-4e0f-bd1b-8dfcfe669e4b admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:50.390372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 833/1647] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:57:50 2022] GET /identity/v3/roles => generated 1427 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:50.391885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099633b-2777-4e0f-bd1b-8dfcfe669e4b admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:50.459511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f4134-9201-4575-97e3-2da451aebc4a None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:50.464437 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe3777-2427-4d0b-b365-f614465ef180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:50.465102 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe3777-2427-4d0b-b365-f614465ef180 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:50.465397 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe3777-2427-4d0b-b365-f614465ef180 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:50.465675 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe3777-2427-4d0b-b365-f614465ef180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:50.470370 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099633b-2777-4e0f-bd1b-8dfcfe669e4b admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:50.474442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5ce0f-2bc5-46af-bccb-738346b06aef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:50.475126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5ce0f-2bc5-46af-bccb-738346b06aef service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:50.475396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5ce0f-2bc5-46af-bccb-738346b06aef service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:50.475694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5ce0f-2bc5-46af-bccb-738346b06aef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:50.479266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe3777-2427-4d0b-b365-f614465ef180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:50.480779 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe3777-2427-4d0b-b365-f614465ef180 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:50.485806 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5ce0f-2bc5-46af-bccb-738346b06aef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:50.487462 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5ce0f-2bc5-46af-bccb-738346b06aef service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:50.498463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 834/1648] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:50 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:50.498908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 815/1649] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:50.499896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe3777-2427-4d0b-b365-f614465ef180 service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:50.509580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afcaca-be05-4d7f-8654-f5b26b1da49f None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:50.509942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afcaca-be05-4d7f-8654-f5b26b1da49f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:50.510161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afcaca-be05-4d7f-8654-f5b26b1da49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:50.512018 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe3777-2427-4d0b-b365-f614465ef180 service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:50.517532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a40985-0171-4563-b8b4-831b314860b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:50.518459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a40985-0171-4563-b8b4-831b314860b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:50.518744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a40985-0171-4563-b8b4-831b314860b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:50.519021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a40985-0171-4563-b8b4-831b314860b1 admin admin] PATH_INFO: `/v3/projects/991c85a25e7040bc9c3feee4d8c39f56/users/a6b139d00f544c44a08c4752b6ee2f97/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:50.521152 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a40985-0171-4563-b8b4-831b314860b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991c85a25e7040bc9c3feee4d8c39f56, user_id=a6b139d00f544c44a08c4752b6ee2f97, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:50.524333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a40985-0171-4563-b8b4-831b314860b1 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:50.542413 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 816/1650] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:57:50 2022] PUT /identity/v3/projects/991c85a25e7040bc9c3feee4d8c39f56/users/a6b139d00f544c44a08c4752b6ee2f97/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:50.552945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b6cae-beac-4cba-a573-3c2d9cfd50dc None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:50.553234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b6cae-beac-4cba-a573-3c2d9cfd50dc None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:50.554106 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b6cae-beac-4cba-a573-3c2d9cfd50dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:50.589118 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e1afcaca-be05-4d7f-8654-f5b26b1da49f None None] MFA Rules not processed for user `5bdb3e36e5934d1fbf2204cac57be139`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:50.600756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e1afcaca-be05-4d7f-8654-f5b26b1da49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:50.601295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-756b6cae-beac-4cba-a573-3c2d9cfd50dc None None] MFA Rules not processed for user `a6b139d00f544c44a08c4752b6ee2f97`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:50.601295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-756b6cae-beac-4cba-a573-3c2d9cfd50dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:50.701050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 835/1651] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:50.702124 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afcaca-be05-4d7f-8654-f5b26b1da49f None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:50.774719 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 817/1652] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:50.776536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb07f56-3c9c-4ba2-bb65-4c89affa0bab None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:50.776536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb07f56-3c9c-4ba2-bb65-4c89affa0bab None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:50.776783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb07f56-3c9c-4ba2-bb65-4c89affa0bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:50.801531 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afcaca-be05-4d7f-8654-f5b26b1da49f None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:50.806113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbb1ca-9641-4f31-a4f4-46967ba29da0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:50.806845 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbb1ca-9641-4f31-a4f4-46967ba29da0 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:50.807134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbb1ca-9641-4f31-a4f4-46967ba29da0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:50.807466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbb1ca-9641-4f31-a4f4-46967ba29da0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:50.816228 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-1eb07f56-3c9c-4ba2-bb65-4c89affa0bab None None] MFA Rules not processed for user `5bdb3e36e5934d1fbf2204cac57be139`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:50.819336 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1eb07f56-3c9c-4ba2-bb65-4c89affa0bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:50.857077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 818/1653] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:50.863618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:50.929133 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb07f56-3c9c-4ba2-bb65-4c89affa0bab None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:50.945720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb07f56-3c9c-4ba2-bb65-4c89affa0bab None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:50.953010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbb1ca-9641-4f31-a4f4-46967ba29da0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:50.953784 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158e0cb-432f-4c83-ae2c-7e7bba17d1e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:50.955614 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158e0cb-432f-4c83-ae2c-7e7bba17d1e3 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:50.955835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbb1ca-9641-4f31-a4f4-46967ba29da0 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:50.956525 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158e0cb-432f-4c83-ae2c-7e7bba17d1e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:50.957012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158e0cb-432f-4c83-ae2c-7e7bba17d1e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:50.969925 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 836/1654] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:50 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:50.971947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6041cc1-0619-4a67-8b72-708a8e48902f None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:50.972445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6041cc1-0619-4a67-8b72-708a8e48902f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:50.972968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6041cc1-0619-4a67-8b72-708a8e48902f None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:50.974918 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 837/1655] 10.222.0.112 () {54 vars in 966 bytes} [Thu May 26 16:57:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:57:50.980810 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348a907-a091-4ef2-ada0-21d1992b5284 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:50.982408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348a907-a091-4ef2-ada0-21d1992b5284 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:50.983233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348a907-a091-4ef2-ada0-21d1992b5284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:50.984621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158e0cb-432f-4c83-ae2c-7e7bba17d1e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:50.992950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158e0cb-432f-4c83-ae2c-7e7bba17d1e3 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:51.034532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 819/1656] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:57:51.071655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-6348a907-a091-4ef2-ada0-21d1992b5284 None None] MFA Rules not processed for user `5f2ec4c76f8f4d858bce53f30cc198fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:51.077016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6348a907-a091-4ef2-ada0-21d1992b5284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:51.129634 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158e0cb-432f-4c83-ae2c-7e7bba17d1e3 service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:51.144443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158e0cb-432f-4c83-ae2c-7e7bba17d1e3 service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:51.154452 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9e0de-b26e-4b5d-9f2a-342031af63c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:51.154944 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9e0de-b26e-4b5d-9f2a-342031af63c7 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:51.155237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9e0de-b26e-4b5d-9f2a-342031af63c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:51.155521 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9e0de-b26e-4b5d-9f2a-342031af63c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:51.281537 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:51.335147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 838/1657] 10.222.0.112 () {58 vars in 1063 bytes} [Thu May 26 16:57:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:57:51.336577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348a907-a091-4ef2-ada0-21d1992b5284 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:51.378644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9e0de-b26e-4b5d-9f2a-342031af63c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:51.382526 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9e0de-b26e-4b5d-9f2a-342031af63c7 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:51.386615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348a907-a091-4ef2-ada0-21d1992b5284 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:51.403076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27700b-d78f-49dc-882a-4009923cbf3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:51.403812 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27700b-d78f-49dc-882a-4009923cbf3f service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:51.404149 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27700b-d78f-49dc-882a-4009923cbf3f service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:51.404434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27700b-d78f-49dc-882a-4009923cbf3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:51.418375 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 820/1658] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:51 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:57:51.421418 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27700b-d78f-49dc-882a-4009923cbf3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:51.424104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27700b-d78f-49dc-882a-4009923cbf3f service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:51.447276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 839/1659] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:51.870154 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9e0de-b26e-4b5d-9f2a-342031af63c7 service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:51.891253 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9e0de-b26e-4b5d-9f2a-342031af63c7 service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:51.909974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:51.910246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2281f62-686c-49a6-af25-8e4efccb0f47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:51.913918 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2281f62-686c-49a6-af25-8e4efccb0f47 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:51.914212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2281f62-686c-49a6-af25-8e4efccb0f47 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:51.914522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2281f62-686c-49a6-af25-8e4efccb0f47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:51.957398 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901fa9a-40d2-4dde-9bcd-918428717cc1 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:51.959707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901fa9a-40d2-4dde-9bcd-918428717cc1 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:51.959707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901fa9a-40d2-4dde-9bcd-918428717cc1 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:51.960312 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 840/1660] 10.222.0.112 () {54 vars in 917 bytes} [Thu May 26 16:57:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:57:51.972390 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a176bd-1471-47b4-a59f-32bc51936304 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:51.972684 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a176bd-1471-47b4-a59f-32bc51936304 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:51.972973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a176bd-1471-47b4-a59f-32bc51936304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:52.012724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e5a176bd-1471-47b4-a59f-32bc51936304 None None] MFA Rules not processed for user `5f2ec4c76f8f4d858bce53f30cc198fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:52.013983 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e5a176bd-1471-47b4-a59f-32bc51936304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:52.036742 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 841/1661] 10.222.0.112 () {58 vars in 1014 bytes} [Thu May 26 16:57:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:52.044528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2281f62-686c-49a6-af25-8e4efccb0f47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:52.056112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a176bd-1471-47b4-a59f-32bc51936304 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:52.057282 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e5a176bd-1471-47b4-a59f-32bc51936304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:52.059497 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2281f62-686c-49a6-af25-8e4efccb0f47 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:52.082429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 821/1662] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:52.207667 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a176bd-1471-47b4-a59f-32bc51936304 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:52.218913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fabbd-535e-4bf2-b53f-128ea3b0d8c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf32c811ead4fd0b69c83890a56509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:52.220203 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fabbd-535e-4bf2-b53f-128ea3b0d8c9 service glance] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:52.220894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fabbd-535e-4bf2-b53f-128ea3b0d8c9 service glance] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:52.221313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fabbd-535e-4bf2-b53f-128ea3b0d8c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:52.256394 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fabbd-535e-4bf2-b53f-128ea3b0d8c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:52.259695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fabbd-535e-4bf2-b53f-128ea3b0d8c9 service glance] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:52.284153 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 842/1663] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:52.487323 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:52.727083 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:53.126625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2281f62-686c-49a6-af25-8e4efccb0f47 service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:53.334069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2281f62-686c-49a6-af25-8e4efccb0f47 service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:53.350642 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84442ed1-f5c2-4192-98f6-f0599e58437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:53.355035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84442ed1-f5c2-4192-98f6-f0599e58437d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:53.355035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84442ed1-f5c2-4192-98f6-f0599e58437d admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:53.355035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84442ed1-f5c2-4192-98f6-f0599e58437d admin admin] PATH_INFO: `/v3/users/580ab3a0455440389c31d17060f23f97` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:53.355035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84442ed1-f5c2-4192-98f6-f0599e58437d admin admin] RBAC: Authorizing `identity:delete_user(user_id=580ab3a0455440389c31d17060f23f97)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:53.355035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: WARNING py.warnings [None req-84442ed1-f5c2-4192-98f6-f0599e58437d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:57:53.355035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: warnings.warn(msg) May 26 16:57:53.355035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: May 26 16:57:53.355896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84442ed1-f5c2-4192-98f6-f0599e58437d admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:53.497542 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649d4f9-2729-4ee3-92eb-7b14e6c02508 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:53.498026 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649d4f9-2729-4ee3-92eb-7b14e6c02508 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:53.498112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649d4f9-2729-4ee3-92eb-7b14e6c02508 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:53.499565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 843/1664] 10.222.0.112 () {54 vars in 917 bytes} [Thu May 26 16:57:53 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:57:53.517180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756b4f5-4f37-43a2-9bf0-2511b1e29495 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:53.517180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756b4f5-4f37-43a2-9bf0-2511b1e29495 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:53.517180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756b4f5-4f37-43a2-9bf0-2511b1e29495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:53.616299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-b756b4f5-4f37-43a2-9bf0-2511b1e29495 None None] MFA Rules not processed for user `0288901db0244eab9a737af460ce1bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:53.617865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b756b4f5-4f37-43a2-9bf0-2511b1e29495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:53.645967 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-84442ed1-f5c2-4192-98f6-f0599e58437d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580ab3a0455440389c31d17060f23f97'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:53.646769 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-84442ed1-f5c2-4192-98f6-f0599e58437d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580ab3a0455440389c31d17060f23f97'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:53.647986 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-84442ed1-f5c2-4192-98f6-f0599e58437d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580ab3a0455440389c31d17060f23f97'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:53.721315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-84442ed1-f5c2-4192-98f6-f0599e58437d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580ab3a0455440389c31d17060f23f97'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:53.753962 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 844/1665] 10.222.0.112 () {58 vars in 1014 bytes} [Thu May 26 16:57:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:53.757115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-84442ed1-f5c2-4192-98f6-f0599e58437d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580ab3a0455440389c31d17060f23f97'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:53.767034 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756b4f5-4f37-43a2-9bf0-2511b1e29495 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:53.774523 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b756b4f5-4f37-43a2-9bf0-2511b1e29495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:53.788084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756b4f5-4f37-43a2-9bf0-2511b1e29495 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:53.793742 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d3674-7840-4308-a559-290e32cfafc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:53.795170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d3674-7840-4308-a559-290e32cfafc8 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:53.795622 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d3674-7840-4308-a559-290e32cfafc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:53.796284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d3674-7840-4308-a559-290e32cfafc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:53.809616 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 822/1666] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:57:53 2022] DELETE /identity/v3/users/580ab3a0455440389c31d17060f23f97 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:53.814504 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d3674-7840-4308-a559-290e32cfafc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:53.815439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046852f-854b-43e3-88be-b05e7b2196ee None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:53.815915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046852f-854b-43e3-88be-b05e7b2196ee None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:53.816296 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d3674-7840-4308-a559-290e32cfafc8 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:53.816649 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046852f-854b-43e3-88be-b05e7b2196ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:53.846112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 845/1667] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:57:53.847566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-f046852f-854b-43e3-88be-b05e7b2196ee None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:53.849061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f046852f-854b-43e3-88be-b05e7b2196ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:54.050312 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:54.133095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 823/1668] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:54.179555 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d3674-7840-4308-a559-290e32cfafc8 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:54.193864 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d3674-7840-4308-a559-290e32cfafc8 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:54.333284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad0b49-b973-4aea-b0ea-cc90d7958463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:54.333491 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046852f-854b-43e3-88be-b05e7b2196ee None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:54.334117 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad0b49-b973-4aea-b0ea-cc90d7958463 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:54.334447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad0b49-b973-4aea-b0ea-cc90d7958463 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:54.334791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad0b49-b973-4aea-b0ea-cc90d7958463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:54.336048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f046852f-854b-43e3-88be-b05e7b2196ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:54.353447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad0b49-b973-4aea-b0ea-cc90d7958463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:54.355099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad0b49-b973-4aea-b0ea-cc90d7958463 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:54.356304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046852f-854b-43e3-88be-b05e7b2196ee None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:54.377073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26330c-9061-4d2f-88ae-3c7eb275a94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:54.377985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26330c-9061-4d2f-88ae-3c7eb275a94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:54.378488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26330c-9061-4d2f-88ae-3c7eb275a94c admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:54.381327 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26330c-9061-4d2f-88ae-3c7eb275a94c admin admin] PATH_INFO: `/v3/users/e2dcf37c096241edbf3f784ccedb97ad` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:54.382754 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26330c-9061-4d2f-88ae-3c7eb275a94c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2dcf37c096241edbf3f784ccedb97ad)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:54.385762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26330c-9061-4d2f-88ae-3c7eb275a94c admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:54.389475 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 846/1669] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:54.710776 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-cc26330c-9061-4d2f-88ae-3c7eb275a94c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2dcf37c096241edbf3f784ccedb97ad'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:54.713550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-cc26330c-9061-4d2f-88ae-3c7eb275a94c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2dcf37c096241edbf3f784ccedb97ad'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:54.715625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-cc26330c-9061-4d2f-88ae-3c7eb275a94c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2dcf37c096241edbf3f784ccedb97ad'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:54.893651 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-cc26330c-9061-4d2f-88ae-3c7eb275a94c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2dcf37c096241edbf3f784ccedb97ad'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:54.928596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-cc26330c-9061-4d2f-88ae-3c7eb275a94c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2dcf37c096241edbf3f784ccedb97ad'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:54.998251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 824/1670] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:57:54 2022] DELETE /identity/v3/users/e2dcf37c096241edbf3f784ccedb97ad => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:55.002397 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac45c68-4511-4b9f-8177-70abc3bc90c3 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:55.004087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac45c68-4511-4b9f-8177-70abc3bc90c3 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:55.004568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac45c68-4511-4b9f-8177-70abc3bc90c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:55.035838 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-eac45c68-4511-4b9f-8177-70abc3bc90c3 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:55.038024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-eac45c68-4511-4b9f-8177-70abc3bc90c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:55.057923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:55.142841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 847/1671] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:55.246388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26330c-9061-4d2f-88ae-3c7eb275a94c admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:55.247850 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-cc26330c-9061-4d2f-88ae-3c7eb275a94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:55.357469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d6f8c-f628-424e-8a86-8b65d3e01ace None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:55.357759 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d6f8c-f628-424e-8a86-8b65d3e01ace None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:55.358047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d6f8c-f628-424e-8a86-8b65d3e01ace None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:55.362940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 848/1672] 10.222.0.112 () {54 vars in 965 bytes} [Thu May 26 16:57:55 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:57:55.371876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee7453-00ce-45fc-9eda-c063ad4c9a33 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:55.372100 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee7453-00ce-45fc-9eda-c063ad4c9a33 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:55.372896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee7453-00ce-45fc-9eda-c063ad4c9a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:55.428375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-a4ee7453-00ce-45fc-9eda-c063ad4c9a33 None None] MFA Rules not processed for user `b415e7fca03e4602b3d711436d47f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:55.428707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26330c-9061-4d2f-88ae-3c7eb275a94c admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:55.431014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a4ee7453-00ce-45fc-9eda-c063ad4c9a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:55.442363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b3459-9806-42b7-bc2b-db87f634cea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:55.442998 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b3459-9806-42b7-bc2b-db87f634cea2 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:55.443289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b3459-9806-42b7-bc2b-db87f634cea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:55.443577 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b3459-9806-42b7-bc2b-db87f634cea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:55.479523 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b3459-9806-42b7-bc2b-db87f634cea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:55.480691 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b3459-9806-42b7-bc2b-db87f634cea2 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:55.523259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 825/1673] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:55.556542 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 849/1674] 10.222.0.112 () {58 vars in 1062 bytes} [Thu May 26 16:57:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:55.566236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b3459-9806-42b7-bc2b-db87f634cea2 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:55.583622 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b3459-9806-42b7-bc2b-db87f634cea2 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:55.594555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9a6d3-08cf-40d5-bdf7-6bd2fc381f00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:55.596837 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9a6d3-08cf-40d5-bdf7-6bd2fc381f00 service placement] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:55.597422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9a6d3-08cf-40d5-bdf7-6bd2fc381f00 service placement] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:55.597856 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9a6d3-08cf-40d5-bdf7-6bd2fc381f00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:55.600414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0da9a6d3-08cf-40d5-bdf7-6bd2fc381f00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:55.628094 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9a6d3-08cf-40d5-bdf7-6bd2fc381f00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:55.630189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9a6d3-08cf-40d5-bdf7-6bd2fc381f00 service placement] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:55.659004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 826/1675] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:55.777603 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552f77b-db1c-412a-9e9a-37c71e9623f1 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:55.777946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552f77b-db1c-412a-9e9a-37c71e9623f1 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:55.778234 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552f77b-db1c-412a-9e9a-37c71e9623f1 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:55.780298 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 850/1676] 10.222.0.112 () {54 vars in 966 bytes} [Thu May 26 16:57:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:57:55.811514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174936e2-6604-4ab1-8087-e74e5ad9c616 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:55.812122 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174936e2-6604-4ab1-8087-e74e5ad9c616 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:55.812578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174936e2-6604-4ab1-8087-e74e5ad9c616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:55.858385 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-174936e2-6604-4ab1-8087-e74e5ad9c616 None None] MFA Rules not processed for user `5f2ec4c76f8f4d858bce53f30cc198fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:55.859808 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-174936e2-6604-4ab1-8087-e74e5ad9c616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:56.117946 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 827/1677] 10.222.0.112 () {58 vars in 1063 bytes} [Thu May 26 16:57:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:56.123835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959b7c5-4aef-48a2-953a-808b94f8b386 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:56.124355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959b7c5-4aef-48a2-953a-808b94f8b386 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:56.124435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959b7c5-4aef-48a2-953a-808b94f8b386 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:56.126865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 851/1678] 10.222.0.112 () {54 vars in 917 bytes} [Thu May 26 16:57:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:57:56.133170 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eee57-eff7-40eb-a1ab-c390454fb8d9 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:56.133511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eee57-eff7-40eb-a1ab-c390454fb8d9 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:56.133804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eee57-eff7-40eb-a1ab-c390454fb8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:56.174308 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-da9eee57-eff7-40eb-a1ab-c390454fb8d9 None None] MFA Rules not processed for user `5f2ec4c76f8f4d858bce53f30cc198fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:56.176910 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-da9eee57-eff7-40eb-a1ab-c390454fb8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:56.208584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 828/1679] 10.222.0.112 () {58 vars in 1014 bytes} [Thu May 26 16:57:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:56.231728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959b7c5-4aef-48a2-953a-808b94f8b386 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:56.233453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e959b7c5-4aef-48a2-953a-808b94f8b386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:56.241002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:56.262534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959b7c5-4aef-48a2-953a-808b94f8b386 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:56.274581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d5460-417d-43f1-8d21-beec22d3aa22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:56.275660 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d5460-417d-43f1-8d21-beec22d3aa22 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:56.276092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d5460-417d-43f1-8d21-beec22d3aa22 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:56.276541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d5460-417d-43f1-8d21-beec22d3aa22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:56.291315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d5460-417d-43f1-8d21-beec22d3aa22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:56.293173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d5460-417d-43f1-8d21-beec22d3aa22 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:56.307537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 852/1680] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:56.669734 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692a94d-bfa7-484f-9240-78ba18059b07 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:56.670542 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692a94d-bfa7-484f-9240-78ba18059b07 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:56.670974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692a94d-bfa7-484f-9240-78ba18059b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:56.718421 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-c692a94d-bfa7-484f-9240-78ba18059b07 None None] MFA Rules not processed for user `289cb250e20344d28bd5fd17255d5896`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:56.719131 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-c692a94d-bfa7-484f-9240-78ba18059b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:56.871664 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 829/1681] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:57:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:56.890032 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d5460-417d-43f1-8d21-beec22d3aa22 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:56.892134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-f46d5460-417d-43f1-8d21-beec22d3aa22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:56.917634 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d5460-417d-43f1-8d21-beec22d3aa22 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:56.924794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8ecba-d6fb-45c3-9a5b-8e77c0152b9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:56.925458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8ecba-d6fb-45c3-9a5b-8e77c0152b9b service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:56.925742 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8ecba-d6fb-45c3-9a5b-8e77c0152b9b service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:56.926018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8ecba-d6fb-45c3-9a5b-8e77c0152b9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:56.936999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8ecba-d6fb-45c3-9a5b-8e77c0152b9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:56.938987 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8ecba-d6fb-45c3-9a5b-8e77c0152b9b service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:56.949416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692a94d-bfa7-484f-9240-78ba18059b07 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:56.951482 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-c692a94d-bfa7-484f-9240-78ba18059b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:56.956466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 853/1682] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:57:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:56.979275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692a94d-bfa7-484f-9240-78ba18059b07 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:56.996412 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5df04-a05e-4770-bc13-31d34777548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:56.998196 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5df04-a05e-4770-bc13-31d34777548a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:56.998976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5df04-a05e-4770-bc13-31d34777548a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:56.999455 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5df04-a05e-4770-bc13-31d34777548a admin admin] PATH_INFO: `/v3/projects/2bbfa92caa7648eeb84e45be2340fe4e` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:57.003751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5df04-a05e-4770-bc13-31d34777548a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bbfa92caa7648eeb84e45be2340fe4e)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:57.011283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5df04-a05e-4770-bc13-31d34777548a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:57.220486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-95e5df04-a05e-4770-bc13-31d34777548a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bbfa92caa7648eeb84e45be2340fe4e', 'request_id': 'req-95e5df04-a05e-4770-bc13-31d34777548a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:57.336826 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-95e5df04-a05e-4770-bc13-31d34777548a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bbfa92caa7648eeb84e45be2340fe4e', 'request_id': 'req-95e5df04-a05e-4770-bc13-31d34777548a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:57.347280 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-95e5df04-a05e-4770-bc13-31d34777548a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bbfa92caa7648eeb84e45be2340fe4e', 'request_id': 'req-95e5df04-a05e-4770-bc13-31d34777548a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:57.363032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-95e5df04-a05e-4770-bc13-31d34777548a admin admin] The token cache is being invalidate because project 2bbfa92caa7648eeb84e45be2340fe4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:57:57.363649 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-95e5df04-a05e-4770-bc13-31d34777548a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:57.365199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-95e5df04-a05e-4770-bc13-31d34777548a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:57.367432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 830/1683] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:57:56 2022] DELETE /identity/v3/projects/2bbfa92caa7648eeb84e45be2340fe4e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:57:57.371257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8ecba-d6fb-45c3-9a5b-8e77c0152b9b service nova] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:57.384674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5df04-a05e-4770-bc13-31d34777548a admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:57.386275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-95e5df04-a05e-4770-bc13-31d34777548a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:57.389175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8ecba-d6fb-45c3-9a5b-8e77c0152b9b service nova] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:57.494943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5df04-a05e-4770-bc13-31d34777548a admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:57.502889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97195729-126a-4454-8797-3f6dd7624e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:57.504319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97195729-126a-4454-8797-3f6dd7624e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:57.504622 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97195729-126a-4454-8797-3f6dd7624e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:57.504909 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97195729-126a-4454-8797-3f6dd7624e62 admin admin] PATH_INFO: `/v3/projects/ecabe67e9f0046908d4f3d8f2f519607` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:57.506191 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97195729-126a-4454-8797-3f6dd7624e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecabe67e9f0046908d4f3d8f2f519607)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:57.508173 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97195729-126a-4454-8797-3f6dd7624e62 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:57.553879 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66364ae4-ca5f-48d0-98df-f236af46c6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:57.554828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66364ae4-ca5f-48d0-98df-f236af46c6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:57.555108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66364ae4-ca5f-48d0-98df-f236af46c6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:57.555389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66364ae4-ca5f-48d0-98df-f236af46c6ea admin admin] PATH_INFO: `/v3/users/e615116367284fc9acdbf89d282ec1a0` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:57.556617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66364ae4-ca5f-48d0-98df-f236af46c6ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e615116367284fc9acdbf89d282ec1a0)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:57.558807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66364ae4-ca5f-48d0-98df-f236af46c6ea admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:57.717600 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97195729-126a-4454-8797-3f6dd7624e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecabe67e9f0046908d4f3d8f2f519607', 'request_id': 'req-97195729-126a-4454-8797-3f6dd7624e62'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:57.881374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97195729-126a-4454-8797-3f6dd7624e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecabe67e9f0046908d4f3d8f2f519607', 'request_id': 'req-97195729-126a-4454-8797-3f6dd7624e62'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:57.889909 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97195729-126a-4454-8797-3f6dd7624e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecabe67e9f0046908d4f3d8f2f519607', 'request_id': 'req-97195729-126a-4454-8797-3f6dd7624e62'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:57.910848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97195729-126a-4454-8797-3f6dd7624e62 admin admin] The token cache is being invalidate because project ecabe67e9f0046908d4f3d8f2f519607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:57:57.911141 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97195729-126a-4454-8797-3f6dd7624e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:57.911846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97195729-126a-4454-8797-3f6dd7624e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:57.913768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 831/1684] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:57:57 2022] DELETE /identity/v3/projects/ecabe67e9f0046908d4f3d8f2f519607 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:57.917683 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97195729-126a-4454-8797-3f6dd7624e62 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:57.920863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-97195729-126a-4454-8797-3f6dd7624e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:57.959064 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:57.991736 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-66364ae4-ca5f-48d0-98df-f236af46c6ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e615116367284fc9acdbf89d282ec1a0'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:57.993187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-66364ae4-ca5f-48d0-98df-f236af46c6ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e615116367284fc9acdbf89d282ec1a0'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:58.032885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-66364ae4-ca5f-48d0-98df-f236af46c6ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e615116367284fc9acdbf89d282ec1a0'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:58.128207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-66364ae4-ca5f-48d0-98df-f236af46c6ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e615116367284fc9acdbf89d282ec1a0'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:58.137072 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-66364ae4-ca5f-48d0-98df-f236af46c6ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e615116367284fc9acdbf89d282ec1a0'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:58.154791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 854/1685] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:57:57 2022] DELETE /identity/v3/users/e615116367284fc9acdbf89d282ec1a0 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:58.180123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97195729-126a-4454-8797-3f6dd7624e62 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:58.390034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e7b38-9d5a-47c8-baef-4520caf6f452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:58.391216 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e7b38-9d5a-47c8-baef-4520caf6f452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:58.392182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e7b38-9d5a-47c8-baef-4520caf6f452 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:58.394243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e7b38-9d5a-47c8-baef-4520caf6f452 admin admin] PATH_INFO: `/v3/users/4b1c82df5d104c8fa44a39b5ac5eb775` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:58.397661 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e7b38-9d5a-47c8-baef-4520caf6f452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1c82df5d104c8fa44a39b5ac5eb775)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:58.400891 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e7b38-9d5a-47c8-baef-4520caf6f452 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:58.616441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-7d1e7b38-9d5a-47c8-baef-4520caf6f452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1c82df5d104c8fa44a39b5ac5eb775'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:58.617306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-7d1e7b38-9d5a-47c8-baef-4520caf6f452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1c82df5d104c8fa44a39b5ac5eb775'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:58.617992 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-7d1e7b38-9d5a-47c8-baef-4520caf6f452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1c82df5d104c8fa44a39b5ac5eb775'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:58.721479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-7d1e7b38-9d5a-47c8-baef-4520caf6f452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1c82df5d104c8fa44a39b5ac5eb775'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:58.740016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-7d1e7b38-9d5a-47c8-baef-4520caf6f452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1c82df5d104c8fa44a39b5ac5eb775'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:58.790368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 832/1686] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:57:57 2022] DELETE /identity/v3/users/4b1c82df5d104c8fa44a39b5ac5eb775 => generated 0 bytes in 873 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:59.904809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:00.255257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66364ae4-ca5f-48d0-98df-f236af46c6ea admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:00.257244 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-66364ae4-ca5f-48d0-98df-f236af46c6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:00.303556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66364ae4-ca5f-48d0-98df-f236af46c6ea admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:00.346145 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e7b38-9d5a-47c8-baef-4520caf6f452 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:00.347685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7d1e7b38-9d5a-47c8-baef-4520caf6f452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:00.480764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:00.483144 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:00.489213 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:00.489603 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] PATH_INFO: `/v3/projects/2649760dfcb44b2ab6959d359907751c` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:00.493271 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2649760dfcb44b2ab6959d359907751c)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:00.494350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: WARNING py.warnings [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:58:00.494350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: warnings.warn(msg) May 26 16:58:00.494350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: May 26 16:58:00.495615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:00.576319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e7b38-9d5a-47c8-baef-4520caf6f452 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:00.590250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8bac4-245e-4c20-b1cb-910e05b6b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:00.591219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8bac4-245e-4c20-b1cb-910e05b6b577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:00.591501 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8bac4-245e-4c20-b1cb-910e05b6b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:00.591834 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8bac4-245e-4c20-b1cb-910e05b6b577 admin admin] PATH_INFO: `/v3/projects/9e02a1df275d412f932f9fa537e4b6e2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:00.594657 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8bac4-245e-4c20-b1cb-910e05b6b577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e02a1df275d412f932f9fa537e4b6e2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:00.609128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8bac4-245e-4c20-b1cb-910e05b6b577 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:00.689521 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2649760dfcb44b2ab6959d359907751c', 'request_id': 'req-394c53dc-5f72-4197-9200-c9aad35e1987'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:00.757702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2649760dfcb44b2ab6959d359907751c', 'request_id': 'req-394c53dc-5f72-4197-9200-c9aad35e1987'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:00.791724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2649760dfcb44b2ab6959d359907751c', 'request_id': 'req-394c53dc-5f72-4197-9200-c9aad35e1987'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:00.807547 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] The token cache is being invalidate because project 2649760dfcb44b2ab6959d359907751c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:00.807884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:00.808794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:00.810792 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 855/1687] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:00 2022] DELETE /identity/v3/projects/2649760dfcb44b2ab6959d359907751c => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:00.811822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:00.816197 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:00.832024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-17c8bac4-245e-4c20-b1cb-910e05b6b577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e02a1df275d412f932f9fa537e4b6e2', 'request_id': 'req-17c8bac4-245e-4c20-b1cb-910e05b6b577'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:00.932891 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-17c8bac4-245e-4c20-b1cb-910e05b6b577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e02a1df275d412f932f9fa537e4b6e2', 'request_id': 'req-17c8bac4-245e-4c20-b1cb-910e05b6b577'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:00.950839 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-17c8bac4-245e-4c20-b1cb-910e05b6b577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e02a1df275d412f932f9fa537e4b6e2', 'request_id': 'req-17c8bac4-245e-4c20-b1cb-910e05b6b577'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:00.958381 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:00.976998 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-17c8bac4-245e-4c20-b1cb-910e05b6b577 admin admin] The token cache is being invalidate because project 9e02a1df275d412f932f9fa537e4b6e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:00.977626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-17c8bac4-245e-4c20-b1cb-910e05b6b577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:00.978728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-17c8bac4-245e-4c20-b1cb-910e05b6b577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:00.986266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 833/1688] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:00 2022] DELETE /identity/v3/projects/9e02a1df275d412f932f9fa537e4b6e2 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:00.991311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e6fe8-203a-4155-a1bd-2060665c2abd None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:00.991748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e6fe8-203a-4155-a1bd-2060665c2abd None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:00.995587 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e6fe8-203a-4155-a1bd-2060665c2abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:01.011346 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c53dc-5f72-4197-9200-c9aad35e1987 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:01.025566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-9e5e6fe8-203a-4155-a1bd-2060665c2abd None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:01.027012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9e5e6fe8-203a-4155-a1bd-2060665c2abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:01.116557 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7689a-7970-42c6-9eb4-c50cce34f2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:01.117784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7689a-7970-42c6-9eb4-c50cce34f2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:01.118256 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7689a-7970-42c6-9eb4-c50cce34f2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:01.118742 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7689a-7970-42c6-9eb4-c50cce34f2eb admin admin] PATH_INFO: `/v3/users/211d5744e75b488090c87b065a2a34ef` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:01.120239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7689a-7970-42c6-9eb4-c50cce34f2eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=211d5744e75b488090c87b065a2a34ef)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:01.122589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7689a-7970-42c6-9eb4-c50cce34f2eb admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:01.237784 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 834/1689] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:01.237784 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a7769-2d78-4b16-a09e-87cf316c4719 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:01.237784 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a7769-2d78-4b16-a09e-87cf316c4719 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:01.243626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a7769-2d78-4b16-a09e-87cf316c4719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:01.282062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-609a7769-2d78-4b16-a09e-87cf316c4719 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:01.285399 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-609a7769-2d78-4b16-a09e-87cf316c4719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:01.301077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 835/1690] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:01.308852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dea95e-9b45-4265-a99e-334234ee8501 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:01.309771 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dea95e-9b45-4265-a99e-334234ee8501 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:01.314676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:01.315481 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dea95e-9b45-4265-a99e-334234ee8501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:01.323978 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e1e7689a-7970-42c6-9eb4-c50cce34f2eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211d5744e75b488090c87b065a2a34ef'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:01.324683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e1e7689a-7970-42c6-9eb4-c50cce34f2eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211d5744e75b488090c87b065a2a34ef'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:01.359239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e1e7689a-7970-42c6-9eb4-c50cce34f2eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211d5744e75b488090c87b065a2a34ef'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:01.361516 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-f1dea95e-9b45-4265-a99e-334234ee8501 None None] MFA Rules not processed for user `8207acca876a4af5ac75dd4283916763`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:01.362937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f1dea95e-9b45-4265-a99e-334234ee8501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:01.424521 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e1e7689a-7970-42c6-9eb4-c50cce34f2eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211d5744e75b488090c87b065a2a34ef'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:01.437670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e1e7689a-7970-42c6-9eb4-c50cce34f2eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211d5744e75b488090c87b065a2a34ef'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:01.450097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 856/1691] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:58:00 2022] DELETE /identity/v3/users/211d5744e75b488090c87b065a2a34ef => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:01.451808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909270a3-7381-4251-915b-560c75b6960b None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:01.452295 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909270a3-7381-4251-915b-560c75b6960b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:01.452740 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909270a3-7381-4251-915b-560c75b6960b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:01.523017 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-909270a3-7381-4251-915b-560c75b6960b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:01.525029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-909270a3-7381-4251-915b-560c75b6960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:01.540724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 836/1692] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:01.542681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c67dd-d9f3-4995-a2e7-f377d7889863 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:01.543016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c67dd-d9f3-4995-a2e7-f377d7889863 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:01.543304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c67dd-d9f3-4995-a2e7-f377d7889863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:01.578547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-678c67dd-d9f3-4995-a2e7-f377d7889863 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:01.580706 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-678c67dd-d9f3-4995-a2e7-f377d7889863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:01.673868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 857/1693] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:01.675617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eb229-dd70-4db7-aa5b-a58c45cbdcf7 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:01.675981 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eb229-dd70-4db7-aa5b-a58c45cbdcf7 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:01.676335 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eb229-dd70-4db7-aa5b-a58c45cbdcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:01.692796 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 837/1694] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:01.692796 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c67dd-d9f3-4995-a2e7-f377d7889863 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:01.693260 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-678c67dd-d9f3-4995-a2e7-f377d7889863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:01.700719 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-a62eb229-dd70-4db7-aa5b-a58c45cbdcf7 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:01.702738 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a62eb229-dd70-4db7-aa5b-a58c45cbdcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:01.721280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 858/1695] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:01.722193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eb229-dd70-4db7-aa5b-a58c45cbdcf7 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:01.741064 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eb229-dd70-4db7-aa5b-a58c45cbdcf7 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:01.748675 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99ad9f-d088-49e3-865b-6037d62e3524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:01.749576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99ad9f-d088-49e3-865b-6037d62e3524 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:01.749682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99ad9f-d088-49e3-865b-6037d62e3524 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:01.749948 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99ad9f-d088-49e3-865b-6037d62e3524 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:01.751798 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99ad9f-d088-49e3-865b-6037d62e3524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:58:01.751798 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99ad9f-d088-49e3-865b-6037d62e3524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:01.753051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99ad9f-d088-49e3-865b-6037d62e3524 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:01.777099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 859/1696] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:58:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:58:01.777615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99ad9f-d088-49e3-865b-6037d62e3524 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:01.800680 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99ad9f-d088-49e3-865b-6037d62e3524 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:01.815229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa06c61-b772-4300-ac35-9030574c1172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:01.815994 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa06c61-b772-4300-ac35-9030574c1172 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:01.816287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa06c61-b772-4300-ac35-9030574c1172 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:01.816640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa06c61-b772-4300-ac35-9030574c1172 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:01.817415 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa06c61-b772-4300-ac35-9030574c1172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:58:01.817699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa06c61-b772-4300-ac35-9030574c1172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:01.819391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa06c61-b772-4300-ac35-9030574c1172 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:01.826536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c67dd-d9f3-4995-a2e7-f377d7889863 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:01.836640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44edb5-6463-4df8-85a4-29782e5093a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:01.837437 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44edb5-6463-4df8-85a4-29782e5093a2 service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:01.837742 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44edb5-6463-4df8-85a4-29782e5093a2 service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:01.838152 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44edb5-6463-4df8-85a4-29782e5093a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:01.857298 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 860/1697] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:58:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:58:01.858138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa06c61-b772-4300-ac35-9030574c1172 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:01.862450 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-afa06c61-b772-4300-ac35-9030574c1172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:01.938999 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44edb5-6463-4df8-85a4-29782e5093a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:01.944020 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44edb5-6463-4df8-85a4-29782e5093a2 service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:01.960331 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 838/1698] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:01.961210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44edb5-6463-4df8-85a4-29782e5093a2 service nova] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:01.963897 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa06c61-b772-4300-ac35-9030574c1172 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:01.974664 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44edb5-6463-4df8-85a4-29782e5093a2 service nova] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:01.976675 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee52a4-6875-4c90-ad84-e57926a06965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:01.977451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee52a4-6875-4c90-ad84-e57926a06965 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:01.977742 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee52a4-6875-4c90-ad84-e57926a06965 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:01.978186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee52a4-6875-4c90-ad84-e57926a06965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:01.981896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb7c21-fce8-4dbc-b7df-7bb5223247df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:01.982690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb7c21-fce8-4dbc-b7df-7bb5223247df admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:01.982984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb7c21-fce8-4dbc-b7df-7bb5223247df admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:01.983269 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb7c21-fce8-4dbc-b7df-7bb5223247df admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:01.984394 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb7c21-fce8-4dbc-b7df-7bb5223247df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:01.987847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb7c21-fce8-4dbc-b7df-7bb5223247df admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:02.001826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee52a4-6875-4c90-ad84-e57926a06965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:02.003835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee52a4-6875-4c90-ad84-e57926a06965 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:02.017413 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 861/1699] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:02.018059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee52a4-6875-4c90-ad84-e57926a06965 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:02.029096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee52a4-6875-4c90-ad84-e57926a06965 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:02.038135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd090e3-ba3f-45f9-a362-89a8964f1a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:02.038727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd090e3-ba3f-45f9-a362-89a8964f1a98 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:02.039012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd090e3-ba3f-45f9-a362-89a8964f1a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:02.039289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd090e3-ba3f-45f9-a362-89a8964f1a98 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:02.046412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd090e3-ba3f-45f9-a362-89a8964f1a98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:02.046412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd090e3-ba3f-45f9-a362-89a8964f1a98 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:02.129985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 839/1700] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:01 2022] POST /identity/v3/projects => generated 376 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:02.131308 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb7c21-fce8-4dbc-b7df-7bb5223247df admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:02.203671 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 862/1701] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:02 2022] POST /identity/v3/projects => generated 386 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:02.209895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd090e3-ba3f-45f9-a362-89a8964f1a98 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:02.250981 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb7c21-fce8-4dbc-b7df-7bb5223247df admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:02.349864 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:02.366785 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd090e3-ba3f-45f9-a362-89a8964f1a98 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:02.373022 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b8b65-7cec-444d-9940-f2de556c26cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:02.374006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b8b65-7cec-444d-9940-f2de556c26cb admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:02.374385 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b8b65-7cec-444d-9940-f2de556c26cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:02.374753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b8b65-7cec-444d-9940-f2de556c26cb admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:02.375629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b8b65-7cec-444d-9940-f2de556c26cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:02.378922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b8b65-7cec-444d-9940-f2de556c26cb admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:02.396980 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a9ca6-f1fb-4954-a3aa-8c29b265177c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:02.397809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a9ca6-f1fb-4954-a3aa-8c29b265177c admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:02.400336 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a9ca6-f1fb-4954-a3aa-8c29b265177c admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:02.400644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a9ca6-f1fb-4954-a3aa-8c29b265177c admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:02.401372 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a9ca6-f1fb-4954-a3aa-8c29b265177c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:02.403842 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a9ca6-f1fb-4954-a3aa-8c29b265177c admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:02.480129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 863/1702] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:02 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:58:02.484148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b8b65-7cec-444d-9940-f2de556c26cb admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:02.505808 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 840/1703] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:02 2022] POST /identity/v3/users => generated 289 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:02.509913 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a9ca6-f1fb-4954-a3aa-8c29b265177c admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:02.521123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b8b65-7cec-444d-9940-f2de556c26cb admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:02.530217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a9ca6-f1fb-4954-a3aa-8c29b265177c admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:02.539257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473de3b2-bad5-4512-9fca-6c344134e5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:02.540049 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473de3b2-bad5-4512-9fca-6c344134e5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:02.540458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473de3b2-bad5-4512-9fca-6c344134e5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:02.540807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473de3b2-bad5-4512-9fca-6c344134e5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:02.542435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473de3b2-bad5-4512-9fca-6c344134e5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:02.544842 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a1975-5f33-44af-881f-bf03fcb95b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:02.545281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473de3b2-bad5-4512-9fca-6c344134e5b0 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:02.545708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a1975-5f33-44af-881f-bf03fcb95b8c admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:02.546010 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a1975-5f33-44af-881f-bf03fcb95b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:02.546298 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a1975-5f33-44af-881f-bf03fcb95b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:02.547230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a1975-5f33-44af-881f-bf03fcb95b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:02.549624 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a1975-5f33-44af-881f-bf03fcb95b8c admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:02.563348 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 864/1704] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:02 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:58:02.570070 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473de3b2-bad5-4512-9fca-6c344134e5b0 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:02.572804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 841/1705] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:02 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:58:02.576393 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a1975-5f33-44af-881f-bf03fcb95b8c admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:02.589428 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a1975-5f33-44af-881f-bf03fcb95b8c admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:02.598047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676c42e-27d9-4100-a781-7e88c744990a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:02.598047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676c42e-27d9-4100-a781-7e88c744990a admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:02.598047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676c42e-27d9-4100-a781-7e88c744990a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:02.598047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676c42e-27d9-4100-a781-7e88c744990a admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:02.602778 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676c42e-27d9-4100-a781-7e88c744990a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:02.604572 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676c42e-27d9-4100-a781-7e88c744990a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:02.605684 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473de3b2-bad5-4512-9fca-6c344134e5b0 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:02.624529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e57f2-021f-40c2-ba24-9b7c690a8bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:02.625336 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 842/1706] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:02 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:58:02.626752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676c42e-27d9-4100-a781-7e88c744990a admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:02.627137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e57f2-021f-40c2-ba24-9b7c690a8bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:02.627562 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e57f2-021f-40c2-ba24-9b7c690a8bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:02.627985 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e57f2-021f-40c2-ba24-9b7c690a8bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:02.629123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e57f2-021f-40c2-ba24-9b7c690a8bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:02.631855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e57f2-021f-40c2-ba24-9b7c690a8bf0 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:02.639097 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676c42e-27d9-4100-a781-7e88c744990a admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:02.645854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b8209-f412-450a-92d4-821e0568643a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:02.646925 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b8209-f412-450a-92d4-821e0568643a admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:02.647274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b8209-f412-450a-92d4-821e0568643a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:02.647631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b8209-f412-450a-92d4-821e0568643a admin admin] PATH_INFO: `/v3/projects/192071af082d49bf87c4abe82fce2c30/users/072af0302c3544c883857d398e44944f/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:02.655577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 865/1707] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:02 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:02.663766 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e57f2-021f-40c2-ba24-9b7c690a8bf0 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:02.672648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b8209-f412-450a-92d4-821e0568643a admin admin] RBAC: Authorizing `identity:create_grant(project_id=192071af082d49bf87c4abe82fce2c30, user_id=072af0302c3544c883857d398e44944f, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:02.675653 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e57f2-021f-40c2-ba24-9b7c690a8bf0 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:02.676573 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b8209-f412-450a-92d4-821e0568643a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:02.689906 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c5dc6-95d7-4ffc-accd-81bbb6d29ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:02.690852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c5dc6-95d7-4ffc-accd-81bbb6d29ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:02.691436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c5dc6-95d7-4ffc-accd-81bbb6d29ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:02.691613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c5dc6-95d7-4ffc-accd-81bbb6d29ccf admin admin] PATH_INFO: `/v3/projects/8338fe05934e45bc9ad554462dbd9b2c/users/eeb05edd89444b4fbecf7af7b4808c8a/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:02.715456 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c5dc6-95d7-4ffc-accd-81bbb6d29ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8338fe05934e45bc9ad554462dbd9b2c, user_id=eeb05edd89444b4fbecf7af7b4808c8a, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:02.718420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c5dc6-95d7-4ffc-accd-81bbb6d29ccf admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:02.751246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:02.801617 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 843/1708] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:02 2022] PUT /identity/v3/projects/192071af082d49bf87c4abe82fce2c30/users/072af0302c3544c883857d398e44944f/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:02.803374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f79ea-fb18-4a61-af3d-128e068b4517 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:02.804793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f79ea-fb18-4a61-af3d-128e068b4517 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:02.805183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f79ea-fb18-4a61-af3d-128e068b4517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:02.839482 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-452f79ea-fb18-4a61-af3d-128e068b4517 None None] MFA Rules not processed for user `072af0302c3544c883857d398e44944f`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:02.841410 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-452f79ea-fb18-4a61-af3d-128e068b4517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:02.859611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 866/1709] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:02 2022] PUT /identity/v3/projects/8338fe05934e45bc9ad554462dbd9b2c/users/eeb05edd89444b4fbecf7af7b4808c8a/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:58:02.871585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb217-6530-4ece-b63d-0d0cdfb7de69 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:02.871585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb217-6530-4ece-b63d-0d0cdfb7de69 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:02.872604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb217-6530-4ece-b63d-0d0cdfb7de69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:02.950277 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-615cb217-6530-4ece-b63d-0d0cdfb7de69 None None] MFA Rules not processed for user `eeb05edd89444b4fbecf7af7b4808c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:02.957416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 844/1710] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:02.966283 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-615cb217-6530-4ece-b63d-0d0cdfb7de69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:02.969833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f79ea-fb18-4a61-af3d-128e068b4517 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:03.120129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f79ea-fb18-4a61-af3d-128e068b4517 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:03.131679 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 867/1711] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:03.132948 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cb217-6530-4ece-b63d-0d0cdfb7de69 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:03.218022 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1ed36-eeb4-453a-a003-eff91bebda16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:03.219336 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1ed36-eeb4-453a-a003-eff91bebda16 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.219959 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1ed36-eeb4-453a-a003-eff91bebda16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.220493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1ed36-eeb4-453a-a003-eff91bebda16 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.222199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1ed36-eeb4-453a-a003-eff91bebda16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:03.225609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1ed36-eeb4-453a-a003-eff91bebda16 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:03.257544 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cb217-6530-4ece-b63d-0d0cdfb7de69 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:03.270921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999becf-1e01-4b9f-b2f9-7e4bbb0167b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:03.271622 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999becf-1e01-4b9f-b2f9-7e4bbb0167b2 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.271907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999becf-1e01-4b9f-b2f9-7e4bbb0167b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.272182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999becf-1e01-4b9f-b2f9-7e4bbb0167b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.273088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999becf-1e01-4b9f-b2f9-7e4bbb0167b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:03.275153 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999becf-1e01-4b9f-b2f9-7e4bbb0167b2 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:03.441650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 845/1712] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:02 2022] POST /identity/v3/projects => generated 376 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:03.445747 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 868/1713] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:03 2022] POST /identity/v3/projects => generated 388 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:58:03.447512 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1ed36-eeb4-453a-a003-eff91bebda16 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:03.449137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999becf-1e01-4b9f-b2f9-7e4bbb0167b2 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:03.456167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-74b1ed36-eeb4-453a-a003-eff91bebda16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:03.636999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999becf-1e01-4b9f-b2f9-7e4bbb0167b2 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:03.640510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1ed36-eeb4-453a-a003-eff91bebda16 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:03.644886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7fab5-2a5c-4c44-bbb8-2ea9ed61a5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:03.645850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7fab5-2a5c-4c44-bbb8-2ea9ed61a5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.646314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7fab5-2a5c-4c44-bbb8-2ea9ed61a5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.646683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7fab5-2a5c-4c44-bbb8-2ea9ed61a5f7 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.647448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7fab5-2a5c-4c44-bbb8-2ea9ed61a5f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:03.648576 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc49ec-dd6f-4b74-a018-5308a5975c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:03.652769 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc49ec-dd6f-4b74-a018-5308a5975c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.652769 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc49ec-dd6f-4b74-a018-5308a5975c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.652769 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc49ec-dd6f-4b74-a018-5308a5975c08 admin admin] PATH_INFO: `/v3/projects/b56aa3839b5046809cea98a15da74f70` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.653013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7fab5-2a5c-4c44-bbb8-2ea9ed61a5f7 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:03.653095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc49ec-dd6f-4b74-a018-5308a5975c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b56aa3839b5046809cea98a15da74f70)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:03.653831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc49ec-dd6f-4b74-a018-5308a5975c08 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:03.774220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 869/1714] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:03 2022] POST /identity/v3/users => generated 295 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:03.775210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7fab5-2a5c-4c44-bbb8-2ea9ed61a5f7 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:03.789372 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ddcc49ec-dd6f-4b74-a018-5308a5975c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b56aa3839b5046809cea98a15da74f70', 'request_id': 'req-ddcc49ec-dd6f-4b74-a018-5308a5975c08'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:03.796784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7fab5-2a5c-4c44-bbb8-2ea9ed61a5f7 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:03.852336 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ddcc49ec-dd6f-4b74-a018-5308a5975c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b56aa3839b5046809cea98a15da74f70', 'request_id': 'req-ddcc49ec-dd6f-4b74-a018-5308a5975c08'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:03.859859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ddcc49ec-dd6f-4b74-a018-5308a5975c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b56aa3839b5046809cea98a15da74f70', 'request_id': 'req-ddcc49ec-dd6f-4b74-a018-5308a5975c08'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:03.864486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b95a03-a058-4b50-9866-f80b7447a0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:03.865172 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b95a03-a058-4b50-9866-f80b7447a0af admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.865456 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b95a03-a058-4b50-9866-f80b7447a0af admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.865733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b95a03-a058-4b50-9866-f80b7447a0af admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.866448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b95a03-a058-4b50-9866-f80b7447a0af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:03.868373 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b95a03-a058-4b50-9866-f80b7447a0af admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:03.871628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ddcc49ec-dd6f-4b74-a018-5308a5975c08 admin admin] The token cache is being invalidate because project b56aa3839b5046809cea98a15da74f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:03.871951 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ddcc49ec-dd6f-4b74-a018-5308a5975c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:03.872579 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ddcc49ec-dd6f-4b74-a018-5308a5975c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:03.874142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 846/1715] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:03 2022] DELETE /identity/v3/projects/b56aa3839b5046809cea98a15da74f70 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:03.878381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e79ed-24e5-488f-a709-413af586875a None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.878679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e79ed-24e5-488f-a709-413af586875a None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.878967 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e79ed-24e5-488f-a709-413af586875a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.906024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-d84e79ed-24e5-488f-a709-413af586875a None None] MFA Rules not processed for user `9e09f6a92f064ec78231fa06782bafda`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:03.908054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d84e79ed-24e5-488f-a709-413af586875a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:03.971456 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 870/1716] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:03 2022] POST /identity/v3/users => generated 295 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:03.972606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b9cd8-5dc9-49e0-ad95-a1eb13602a45 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.972898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b9cd8-5dc9-49e0-ad95-a1eb13602a45 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.973176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b9cd8-5dc9-49e0-ad95-a1eb13602a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.999786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-798b9cd8-5dc9-49e0-ad95-a1eb13602a45 None None] MFA Rules not processed for user `289cb250e20344d28bd5fd17255d5896`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:04.001709 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-798b9cd8-5dc9-49e0-ad95-a1eb13602a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:04.013141 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 847/1717] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:04.014704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e79ed-24e5-488f-a709-413af586875a None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:04.017388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d84e79ed-24e5-488f-a709-413af586875a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:04.036389 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e79ed-24e5-488f-a709-413af586875a None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:04.042468 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14714dc8-f312-43a7-a423-8e4344b68384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:04.044843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14714dc8-f312-43a7-a423-8e4344b68384 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:04.045129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14714dc8-f312-43a7-a423-8e4344b68384 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:04.045460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14714dc8-f312-43a7-a423-8e4344b68384 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:04.046218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14714dc8-f312-43a7-a423-8e4344b68384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:04.047969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14714dc8-f312-43a7-a423-8e4344b68384 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:04.065347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 848/1718] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:04 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:04.066227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14714dc8-f312-43a7-a423-8e4344b68384 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:04.069879 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-14714dc8-f312-43a7-a423-8e4344b68384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:04.085929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14714dc8-f312-43a7-a423-8e4344b68384 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:04.091290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a196c0-a7d1-4dd3-82b5-6a1ffdc82b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:04.092266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a196c0-a7d1-4dd3-82b5-6a1ffdc82b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:04.092555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a196c0-a7d1-4dd3-82b5-6a1ffdc82b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:04.092844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a196c0-a7d1-4dd3-82b5-6a1ffdc82b27 admin admin] PATH_INFO: `/v3/users/f4f54542ccc34107a9da6660b8622651` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:04.094491 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a196c0-a7d1-4dd3-82b5-6a1ffdc82b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f54542ccc34107a9da6660b8622651)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:04.098651 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a196c0-a7d1-4dd3-82b5-6a1ffdc82b27 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:04.100033 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 871/1719] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:04.101025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b9cd8-5dc9-49e0-ad95-a1eb13602a45 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:04.102464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-798b9cd8-5dc9-49e0-ad95-a1eb13602a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:04.118297 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b9cd8-5dc9-49e0-ad95-a1eb13602a45 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:04.124337 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b8b8-c037-4a86-9fc7-5ed220ed5a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:04.125035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b8b8-c037-4a86-9fc7-5ed220ed5a97 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:04.125466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b8b8-c037-4a86-9fc7-5ed220ed5a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:04.126313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b8b8-c037-4a86-9fc7-5ed220ed5a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:04.127296 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217b8b8-c037-4a86-9fc7-5ed220ed5a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:04.129501 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217b8b8-c037-4a86-9fc7-5ed220ed5a97 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:04.147303 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 872/1720] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:04 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:04.148722 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b8b8-c037-4a86-9fc7-5ed220ed5a97 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:04.151884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e217b8b8-c037-4a86-9fc7-5ed220ed5a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:04.235956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b8b8-c037-4a86-9fc7-5ed220ed5a97 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:04.252894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcd661-35ec-4989-bf22-d43ae0b606e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:04.257245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcd661-35ec-4989-bf22-d43ae0b606e6 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:04.257245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcd661-35ec-4989-bf22-d43ae0b606e6 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:04.257245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcd661-35ec-4989-bf22-d43ae0b606e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:04.264184 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcd661-35ec-4989-bf22-d43ae0b606e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:04.266227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcd661-35ec-4989-bf22-d43ae0b606e6 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:04.272360 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:04.280434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 873/1721] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:04.282491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcd661-35ec-4989-bf22-d43ae0b606e6 service nova] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:04.299220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcd661-35ec-4989-bf22-d43ae0b606e6 service nova] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:04.316082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e838d1-4ed4-427c-b008-81b89be004fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:04.317001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e838d1-4ed4-427c-b008-81b89be004fb admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:04.317287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e838d1-4ed4-427c-b008-81b89be004fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:04.317573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e838d1-4ed4-427c-b008-81b89be004fb admin admin] PATH_INFO: `/v3/projects/0b3d658cc1ee46b1b4d297fb3eab2878/users/6497c50fdddf423a8334f0bc6973432d/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:04.362253 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e838d1-4ed4-427c-b008-81b89be004fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3d658cc1ee46b1b4d297fb3eab2878, user_id=6497c50fdddf423a8334f0bc6973432d, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:04.364884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e838d1-4ed4-427c-b008-81b89be004fb admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:04.400389 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-44a196c0-a7d1-4dd3-82b5-6a1ffdc82b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f54542ccc34107a9da6660b8622651'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:04.404916 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-44a196c0-a7d1-4dd3-82b5-6a1ffdc82b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f54542ccc34107a9da6660b8622651'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:04.405696 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-44a196c0-a7d1-4dd3-82b5-6a1ffdc82b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f54542ccc34107a9da6660b8622651'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:04.454811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 874/1722] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:04 2022] PUT /identity/v3/projects/0b3d658cc1ee46b1b4d297fb3eab2878/users/6497c50fdddf423a8334f0bc6973432d/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:04.457051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e838d1-4ed4-427c-b008-81b89be004fb admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:04.462669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c7e838d1-4ed4-427c-b008-81b89be004fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:04.515659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-44a196c0-a7d1-4dd3-82b5-6a1ffdc82b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f54542ccc34107a9da6660b8622651'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:04.555173 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-44a196c0-a7d1-4dd3-82b5-6a1ffdc82b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f54542ccc34107a9da6660b8622651'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:04.587820 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 849/1723] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:58:04 2022] DELETE /identity/v3/users/f4f54542ccc34107a9da6660b8622651 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:04.600041 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a196c0-a7d1-4dd3-82b5-6a1ffdc82b27 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:04.603925 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-44a196c0-a7d1-4dd3-82b5-6a1ffdc82b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:04.759142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a196c0-a7d1-4dd3-82b5-6a1ffdc82b27 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:04.765549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4c3e8-6087-4e67-ac2e-a493dccc675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:04.766251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4c3e8-6087-4e67-ac2e-a493dccc675f admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:04.767169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4c3e8-6087-4e67-ac2e-a493dccc675f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:04.767874 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4c3e8-6087-4e67-ac2e-a493dccc675f admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:04.768829 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4c3e8-6087-4e67-ac2e-a493dccc675f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:04.770581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4c3e8-6087-4e67-ac2e-a493dccc675f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:04.786377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 850/1724] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:04 2022] GET /identity/v3/roles => generated 1427 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:04.790678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4c3e8-6087-4e67-ac2e-a493dccc675f admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:04.831874 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4c3e8-6087-4e67-ac2e-a493dccc675f admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:04.838178 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1877b-dd9a-4e92-8b9b-86c335b38fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:04.838646 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1877b-dd9a-4e92-8b9b-86c335b38fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:04.838935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1877b-dd9a-4e92-8b9b-86c335b38fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:04.839220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1877b-dd9a-4e92-8b9b-86c335b38fbb admin admin] PATH_INFO: `/v3/projects/0b3d658cc1ee46b1b4d297fb3eab2878/users/6497c50fdddf423a8334f0bc6973432d/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:04.847128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1877b-dd9a-4e92-8b9b-86c335b38fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3d658cc1ee46b1b4d297fb3eab2878, user_id=6497c50fdddf423a8334f0bc6973432d, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:04.850513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1877b-dd9a-4e92-8b9b-86c335b38fbb admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:04.853269 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e838d1-4ed4-427c-b008-81b89be004fb admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:04.871638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 851/1725] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:04 2022] PUT /identity/v3/projects/0b3d658cc1ee46b1b4d297fb3eab2878/users/6497c50fdddf423a8334f0bc6973432d/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:04.874047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7b723-29fb-42c7-9add-c35c04845a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:04.876620 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7b723-29fb-42c7-9add-c35c04845a5e admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:04.876882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7b723-29fb-42c7-9add-c35c04845a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:04.877166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7b723-29fb-42c7-9add-c35c04845a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:04.877927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7b723-29fb-42c7-9add-c35c04845a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:04.880206 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7b723-29fb-42c7-9add-c35c04845a5e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:04.887873 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:04.893935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c134d19-04ab-40c3-b36f-9ee10d7389dd None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:04.895342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c134d19-04ab-40c3-b36f-9ee10d7389dd None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:04.897457 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c134d19-04ab-40c3-b36f-9ee10d7389dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:04.932219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 875/1726] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:04 2022] GET /identity/v3/roles => generated 1427 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:04.935949 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7b723-29fb-42c7-9add-c35c04845a5e admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:04.958625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7b723-29fb-42c7-9add-c35c04845a5e admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:04.977420 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-2c134d19-04ab-40c3-b36f-9ee10d7389dd None None] MFA Rules not processed for user `6497c50fdddf423a8334f0bc6973432d`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:04.981213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2c134d19-04ab-40c3-b36f-9ee10d7389dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:05.152805 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9869f-8c2f-48c3-86de-f4cf8e41768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:05.153890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9869f-8c2f-48c3-86de-f4cf8e41768e admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:05.154179 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9869f-8c2f-48c3-86de-f4cf8e41768e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:05.154559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9869f-8c2f-48c3-86de-f4cf8e41768e admin admin] PATH_INFO: `/v3/projects/439e76036bb64e539a12f40608c576e6/users/58627ff511b64001aa0d5ddede850285/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:05.192895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9869f-8c2f-48c3-86de-f4cf8e41768e admin admin] RBAC: Authorizing `identity:create_grant(project_id=439e76036bb64e539a12f40608c576e6, user_id=58627ff511b64001aa0d5ddede850285, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:05.196486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9869f-8c2f-48c3-86de-f4cf8e41768e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:05.207336 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 852/1727] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:05.221381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c134d19-04ab-40c3-b36f-9ee10d7389dd None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:05.223831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2c134d19-04ab-40c3-b36f-9ee10d7389dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:05.322456 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 876/1728] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:04 2022] PUT /identity/v3/projects/439e76036bb64e539a12f40608c576e6/users/58627ff511b64001aa0d5ddede850285/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:05.325430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bcf07-3c8b-499d-9113-93dccc63f94c None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:05.325715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bcf07-3c8b-499d-9113-93dccc63f94c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:05.325994 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bcf07-3c8b-499d-9113-93dccc63f94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:05.342821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c134d19-04ab-40c3-b36f-9ee10d7389dd None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:05.379719 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-595bcf07-3c8b-499d-9113-93dccc63f94c None None] MFA Rules not processed for user `58627ff511b64001aa0d5ddede850285`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:05.380584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-595bcf07-3c8b-499d-9113-93dccc63f94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:05.412345 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ea896-3e0b-4898-8f74-2bfb75ce38cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:05.413453 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ea896-3e0b-4898-8f74-2bfb75ce38cb service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:05.413765 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ea896-3e0b-4898-8f74-2bfb75ce38cb service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:05.414096 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ea896-3e0b-4898-8f74-2bfb75ce38cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:05.417231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8d4ea896-3e0b-4898-8f74-2bfb75ce38cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:05.529425 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 877/1729] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:05.531284 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ea896-3e0b-4898-8f74-2bfb75ce38cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:05.531478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bcf07-3c8b-499d-9113-93dccc63f94c None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:05.534482 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ea896-3e0b-4898-8f74-2bfb75ce38cb service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:05.558311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 853/1730] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:05.615939 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:05.660018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bcf07-3c8b-499d-9113-93dccc63f94c None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:05.676078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc84a8e-b433-4ee1-bbef-ea311a654553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:05.678881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc84a8e-b433-4ee1-bbef-ea311a654553 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:05.679178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc84a8e-b433-4ee1-bbef-ea311a654553 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:05.679469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc84a8e-b433-4ee1-bbef-ea311a654553 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:05.682978 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc84a8e-b433-4ee1-bbef-ea311a654553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:05.690462 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc84a8e-b433-4ee1-bbef-ea311a654553 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:05.707257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ea896-3e0b-4898-8f74-2bfb75ce38cb service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:05.709186 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8d4ea896-3e0b-4898-8f74-2bfb75ce38cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:05.773985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ea896-3e0b-4898-8f74-2bfb75ce38cb service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:05.796682 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813e425-92d3-4ac5-9711-590a2a06a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:05.797493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813e425-92d3-4ac5-9711-590a2a06a720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:05.799055 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813e425-92d3-4ac5-9711-590a2a06a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:05.799234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813e425-92d3-4ac5-9711-590a2a06a720 admin admin] PATH_INFO: `/v3/projects/a6a4d83b2cef47a38a23aab7fc470d51` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:05.800811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813e425-92d3-4ac5-9711-590a2a06a720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a4d83b2cef47a38a23aab7fc470d51)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:05.802859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813e425-92d3-4ac5-9711-590a2a06a720 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:05.835651 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 878/1731] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:05 2022] POST /identity/v3/projects => generated 388 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:05.840227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc84a8e-b433-4ee1-bbef-ea311a654553 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:05.983573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc84a8e-b433-4ee1-bbef-ea311a654553 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:06.025831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f813e425-92d3-4ac5-9711-590a2a06a720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a4d83b2cef47a38a23aab7fc470d51', 'request_id': 'req-f813e425-92d3-4ac5-9711-590a2a06a720'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:06.114641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f813e425-92d3-4ac5-9711-590a2a06a720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a4d83b2cef47a38a23aab7fc470d51', 'request_id': 'req-f813e425-92d3-4ac5-9711-590a2a06a720'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:06.128608 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f813e425-92d3-4ac5-9711-590a2a06a720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a4d83b2cef47a38a23aab7fc470d51', 'request_id': 'req-f813e425-92d3-4ac5-9711-590a2a06a720'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:06.154889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f813e425-92d3-4ac5-9711-590a2a06a720 admin admin] The token cache is being invalidate because project a6a4d83b2cef47a38a23aab7fc470d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:06.155404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f813e425-92d3-4ac5-9711-590a2a06a720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:06.159711 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f813e425-92d3-4ac5-9711-590a2a06a720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:06.162387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:06.164125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 854/1732] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:05 2022] DELETE /identity/v3/projects/a6a4d83b2cef47a38a23aab7fc470d51 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:06.174693 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320857f-5e2a-4784-a34f-eeded09c3b48 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:06.178717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320857f-5e2a-4784-a34f-eeded09c3b48 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:06.179156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320857f-5e2a-4784-a34f-eeded09c3b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:06.226359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112e400-6673-4381-85b3-6a0c8062a9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:06.226359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112e400-6673-4381-85b3-6a0c8062a9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:06.226359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112e400-6673-4381-85b3-6a0c8062a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:06.226359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112e400-6673-4381-85b3-6a0c8062a9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:06.226772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112e400-6673-4381-85b3-6a0c8062a9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:06.236088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112e400-6673-4381-85b3-6a0c8062a9c6 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:06.243100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-4320857f-5e2a-4784-a34f-eeded09c3b48 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:06.247319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4320857f-5e2a-4784-a34f-eeded09c3b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:06.270729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 855/1733] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:06.280217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964e2f1-3543-4dd7-900e-a3ed4d79d02b None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:06.280501 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964e2f1-3543-4dd7-900e-a3ed4d79d02b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:06.280830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964e2f1-3543-4dd7-900e-a3ed4d79d02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:06.308534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 879/1734] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:05 2022] POST /identity/v3/users => generated 301 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:06.309923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112e400-6673-4381-85b3-6a0c8062a9c6 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:06.317175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0112e400-6673-4381-85b3-6a0c8062a9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:06.344088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112e400-6673-4381-85b3-6a0c8062a9c6 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:06.358056 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-e964e2f1-3543-4dd7-900e-a3ed4d79d02b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:06.362523 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55141b9-2d24-40d0-8233-4ca8707356fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:06.364917 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-e964e2f1-3543-4dd7-900e-a3ed4d79d02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:06.365377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55141b9-2d24-40d0-8233-4ca8707356fe admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:06.375460 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55141b9-2d24-40d0-8233-4ca8707356fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:06.375460 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55141b9-2d24-40d0-8233-4ca8707356fe admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:06.375460 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55141b9-2d24-40d0-8233-4ca8707356fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:06.375460 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55141b9-2d24-40d0-8233-4ca8707356fe admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:06.397332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 856/1735] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:06.398301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964e2f1-3543-4dd7-900e-a3ed4d79d02b None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:06.409371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 880/1736] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:06 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:06.414351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55141b9-2d24-40d0-8233-4ca8707356fe admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:06.425594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964e2f1-3543-4dd7-900e-a3ed4d79d02b None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:06.436252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55141b9-2d24-40d0-8233-4ca8707356fe admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:06.437087 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1a81f-d9f6-4949-87ee-db91fd3c3a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:06.437781 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1a81f-d9f6-4949-87ee-db91fd3c3a3d admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:06.438071 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1a81f-d9f6-4949-87ee-db91fd3c3a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:06.439572 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1a81f-d9f6-4949-87ee-db91fd3c3a3d admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:06.440447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1a81f-d9f6-4949-87ee-db91fd3c3a3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:58:06.440784 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1a81f-d9f6-4949-87ee-db91fd3c3a3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:06.445569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1a81f-d9f6-4949-87ee-db91fd3c3a3d admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:06.449754 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed613ecc-2f2f-4b51-b99b-021547ba6400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:06.450729 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed613ecc-2f2f-4b51-b99b-021547ba6400 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:06.451215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed613ecc-2f2f-4b51-b99b-021547ba6400 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:06.451496 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed613ecc-2f2f-4b51-b99b-021547ba6400 admin admin] PATH_INFO: `/v3/projects/5a9356b847ba426ea5dcd9dad62dc7d3/users/16729ddc9bb94c31ae22c992faba650e/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:06.478923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 857/1737] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:58:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:58:06.485668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1a81f-d9f6-4949-87ee-db91fd3c3a3d admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:06.488649 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed613ecc-2f2f-4b51-b99b-021547ba6400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9356b847ba426ea5dcd9dad62dc7d3, user_id=16729ddc9bb94c31ae22c992faba650e, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:06.492176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed613ecc-2f2f-4b51-b99b-021547ba6400 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:06.499898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1a81f-d9f6-4949-87ee-db91fd3c3a3d admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:06.505400 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f6989-bd36-4d78-9c33-b7d936290256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:06.506212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f6989-bd36-4d78-9c33-b7d936290256 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:06.506853 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f6989-bd36-4d78-9c33-b7d936290256 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:06.507325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f6989-bd36-4d78-9c33-b7d936290256 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:06.508097 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f6989-bd36-4d78-9c33-b7d936290256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:06.510342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f6989-bd36-4d78-9c33-b7d936290256 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:06.581346 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 881/1738] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:06 2022] PUT /identity/v3/projects/5a9356b847ba426ea5dcd9dad62dc7d3/users/16729ddc9bb94c31ae22c992faba650e/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:06.585808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed613ecc-2f2f-4b51-b99b-021547ba6400 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:06.656981 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 858/1739] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:06 2022] POST /identity/v3/projects => generated 384 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:06.663843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f6989-bd36-4d78-9c33-b7d936290256 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:06.687852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed613ecc-2f2f-4b51-b99b-021547ba6400 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:06.824276 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f6989-bd36-4d78-9c33-b7d936290256 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:06.833910 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5a088-9b67-40d5-8456-2d31d2b32164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:06.836080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5a088-9b67-40d5-8456-2d31d2b32164 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:06.836490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5a088-9b67-40d5-8456-2d31d2b32164 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:06.838462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5a088-9b67-40d5-8456-2d31d2b32164 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:06.839107 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5a088-9b67-40d5-8456-2d31d2b32164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:06.844129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5a088-9b67-40d5-8456-2d31d2b32164 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:06.855169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f1f6b-1496-434b-95fc-9bf09b9c43e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:06.856218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f1f6b-1496-434b-95fc-9bf09b9c43e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:06.856501 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f1f6b-1496-434b-95fc-9bf09b9c43e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:06.856854 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f1f6b-1496-434b-95fc-9bf09b9c43e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:06.857664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f1f6b-1496-434b-95fc-9bf09b9c43e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:06.859620 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f1f6b-1496-434b-95fc-9bf09b9c43e5 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:06.880853 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 882/1740] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:06 2022] GET /identity/v3/roles => generated 1427 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:06.882885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f1f6b-1496-434b-95fc-9bf09b9c43e5 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:06.903088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f1f6b-1496-434b-95fc-9bf09b9c43e5 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:06.918103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f06ca0-4d26-45f9-b8a6-43a32a51ec12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:06.923166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f06ca0-4d26-45f9-b8a6-43a32a51ec12 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:06.923166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f06ca0-4d26-45f9-b8a6-43a32a51ec12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:06.923166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f06ca0-4d26-45f9-b8a6-43a32a51ec12 admin admin] PATH_INFO: `/v3/projects/5a9356b847ba426ea5dcd9dad62dc7d3/users/16729ddc9bb94c31ae22c992faba650e/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:06.925161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f06ca0-4d26-45f9-b8a6-43a32a51ec12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9356b847ba426ea5dcd9dad62dc7d3, user_id=16729ddc9bb94c31ae22c992faba650e, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:06.933236 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f06ca0-4d26-45f9-b8a6-43a32a51ec12 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:06.979306 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 883/1741] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:06 2022] PUT /identity/v3/projects/5a9356b847ba426ea5dcd9dad62dc7d3/users/16729ddc9bb94c31ae22c992faba650e/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:06.982070 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3e607-470a-4818-9d43-52159a3adcb7 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:06.985360 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3e607-470a-4818-9d43-52159a3adcb7 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:06.985842 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3e607-470a-4818-9d43-52159a3adcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:07.012354 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 859/1742] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:06 2022] POST /identity/v3/users => generated 293 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:07.017097 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5a088-9b67-40d5-8456-2d31d2b32164 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:07.049856 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5a088-9b67-40d5-8456-2d31d2b32164 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:07.070278 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e9a3e607-470a-4818-9d43-52159a3adcb7 None None] MFA Rules not processed for user `16729ddc9bb94c31ae22c992faba650e`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:07.071774 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e9a3e607-470a-4818-9d43-52159a3adcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:07.199644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349e167-3907-4b2d-a75f-2d3c739a206e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:07.199644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349e167-3907-4b2d-a75f-2d3c739a206e admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:07.210869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349e167-3907-4b2d-a75f-2d3c739a206e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:07.210869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349e167-3907-4b2d-a75f-2d3c739a206e admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:07.210869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349e167-3907-4b2d-a75f-2d3c739a206e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:07.210869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349e167-3907-4b2d-a75f-2d3c739a206e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:07.238294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 860/1743] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:07 2022] GET /identity/v3/roles => generated 1427 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:07.241288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3632e6-d08c-4383-a589-9241661afdd7 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:07.241410 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3632e6-d08c-4383-a589-9241661afdd7 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:07.241599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3632e6-d08c-4383-a589-9241661afdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:07.260949 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 884/1744] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:07.262169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3e607-470a-4818-9d43-52159a3adcb7 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:07.263758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-8d3632e6-d08c-4383-a589-9241661afdd7 None None] MFA Rules not processed for user `8207acca876a4af5ac75dd4283916763`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:07.265045 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8d3632e6-d08c-4383-a589-9241661afdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:07.276656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3e607-470a-4818-9d43-52159a3adcb7 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:07.288288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a0f75-bf7d-4ef3-96d1-7eb228881eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:07.291766 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a0f75-bf7d-4ef3-96d1-7eb228881eeb admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:07.294939 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a0f75-bf7d-4ef3-96d1-7eb228881eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:07.295384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a0f75-bf7d-4ef3-96d1-7eb228881eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:07.297218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a0f75-bf7d-4ef3-96d1-7eb228881eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:07.299825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a0f75-bf7d-4ef3-96d1-7eb228881eeb admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:07.322586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 885/1745] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:07 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:07.336951 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:07.339551 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a0f75-bf7d-4ef3-96d1-7eb228881eeb admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:07.343167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a46a0f75-bf7d-4ef3-96d1-7eb228881eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:07.384963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 861/1746] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:07.385943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3632e6-d08c-4383-a589-9241661afdd7 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:07.407784 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3632e6-d08c-4383-a589-9241661afdd7 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:07.414100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604e77b-6d57-4344-a237-8b1f130b8747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:07.415383 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604e77b-6d57-4344-a237-8b1f130b8747 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:07.415677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604e77b-6d57-4344-a237-8b1f130b8747 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:07.415961 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604e77b-6d57-4344-a237-8b1f130b8747 admin admin] PATH_INFO: `/v3/projects/35fba83dbdf94c8caa718021be9666be/users/f9201414c28e4ec3a7a30abb747d0b7a/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:07.441717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604e77b-6d57-4344-a237-8b1f130b8747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35fba83dbdf94c8caa718021be9666be, user_id=f9201414c28e4ec3a7a30abb747d0b7a, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:07.443883 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604e77b-6d57-4344-a237-8b1f130b8747 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:07.486409 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a0f75-bf7d-4ef3-96d1-7eb228881eeb admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:07.493535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a63f7-8455-494e-b6a9-1c4eae8d7ca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:07.494299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a63f7-8455-494e-b6a9-1c4eae8d7ca6 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:07.494707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a63f7-8455-494e-b6a9-1c4eae8d7ca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:07.495059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a63f7-8455-494e-b6a9-1c4eae8d7ca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:07.511158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a63f7-8455-494e-b6a9-1c4eae8d7ca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:07.512652 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a63f7-8455-494e-b6a9-1c4eae8d7ca6 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:07.525865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 886/1747] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:07.561087 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 862/1748] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:07 2022] PUT /identity/v3/projects/35fba83dbdf94c8caa718021be9666be/users/f9201414c28e4ec3a7a30abb747d0b7a/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:07.562524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b55bed-2bee-4ca6-9edf-9c889f3695b9 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:07.562947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b55bed-2bee-4ca6-9edf-9c889f3695b9 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:07.563284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b55bed-2bee-4ca6-9edf-9c889f3695b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:07.612175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-a1b55bed-2bee-4ca6-9edf-9c889f3695b9 None None] MFA Rules not processed for user `f9201414c28e4ec3a7a30abb747d0b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:07.614415 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a1b55bed-2bee-4ca6-9edf-9c889f3695b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:07.797660 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 887/1749] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:58:07.802441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604e77b-6d57-4344-a237-8b1f130b8747 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:08.039437 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:08.055904 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604e77b-6d57-4344-a237-8b1f130b8747 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:08.067359 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c216c7-13c3-44c1-8599-bc2cbcbc952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:08.075501 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c216c7-13c3-44c1-8599-bc2cbcbc952b admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:08.079631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c216c7-13c3-44c1-8599-bc2cbcbc952b admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:08.079631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c216c7-13c3-44c1-8599-bc2cbcbc952b admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:08.079631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c216c7-13c3-44c1-8599-bc2cbcbc952b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:08.081231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c216c7-13c3-44c1-8599-bc2cbcbc952b admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:08.225322 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 863/1750] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:07 2022] POST /identity/v3/projects => generated 384 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:08.229505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b55bed-2bee-4ca6-9edf-9c889f3695b9 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:08.247958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b55bed-2bee-4ca6-9edf-9c889f3695b9 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:08.286354 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276bc0d-bb88-408d-8148-c5d45177ec2c None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:08.286892 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276bc0d-bb88-408d-8148-c5d45177ec2c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:08.286996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276bc0d-bb88-408d-8148-c5d45177ec2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:08.324292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-0276bc0d-bb88-408d-8148-c5d45177ec2c None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:08.325518 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0276bc0d-bb88-408d-8148-c5d45177ec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:08.393726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01271e-bf32-49be-8360-49b97ee7063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:08.395015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01271e-bf32-49be-8360-49b97ee7063b admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:08.396064 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01271e-bf32-49be-8360-49b97ee7063b admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:08.396885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01271e-bf32-49be-8360-49b97ee7063b admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:08.398036 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01271e-bf32-49be-8360-49b97ee7063b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:08.402997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01271e-bf32-49be-8360-49b97ee7063b admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:08.450525 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 864/1751] 10.222.0.112 () {58 vars in 1014 bytes} [Thu May 26 16:58:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:08.525638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276bc0d-bb88-408d-8148-c5d45177ec2c None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:08.540065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 888/1752] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:08 2022] POST /identity/v3/users => generated 299 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:08.548305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276bc0d-bb88-408d-8148-c5d45177ec2c None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:08.554505 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efec4c6-8942-4ee0-97e0-fd20bf0ffa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:08.558673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec4c6-8942-4ee0-97e0-fd20bf0ffa17 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:08.558673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec4c6-8942-4ee0-97e0-fd20bf0ffa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:08.558673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec4c6-8942-4ee0-97e0-fd20bf0ffa17 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:08.558673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efec4c6-8942-4ee0-97e0-fd20bf0ffa17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:08.560808 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efec4c6-8942-4ee0-97e0-fd20bf0ffa17 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:08.608186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01271e-bf32-49be-8360-49b97ee7063b admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:08.621413 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 865/1753] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:08 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:08.626580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01271e-bf32-49be-8360-49b97ee7063b admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:08.633547 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954b268-4814-4e72-8206-b63f32263574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:08.635246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b268-4814-4e72-8206-b63f32263574 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:08.635600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b268-4814-4e72-8206-b63f32263574 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:08.635930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b268-4814-4e72-8206-b63f32263574 admin admin] PATH_INFO: `/v3/projects/14fd49ecea484a038357074d7e103d81/users/f798a231eb6b4f8480824045b5d4bf3b/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:08.666693 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954b268-4814-4e72-8206-b63f32263574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14fd49ecea484a038357074d7e103d81, user_id=f798a231eb6b4f8480824045b5d4bf3b, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:08.670684 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954b268-4814-4e72-8206-b63f32263574 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:08.813019 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 889/1754] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:08 2022] PUT /identity/v3/projects/14fd49ecea484a038357074d7e103d81/users/f798a231eb6b4f8480824045b5d4bf3b/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:08.813729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efec4c6-8942-4ee0-97e0-fd20bf0ffa17 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:08.826809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efec4c6-8942-4ee0-97e0-fd20bf0ffa17 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:08.967594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954b268-4814-4e72-8206-b63f32263574 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:08.971630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c954b268-4814-4e72-8206-b63f32263574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:08.972401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1a0d5-433c-4f97-8918-e354ab1a4734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:08.973206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1a0d5-433c-4f97-8918-e354ab1a4734 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:08.973495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1a0d5-433c-4f97-8918-e354ab1a4734 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:08.973776 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1a0d5-433c-4f97-8918-e354ab1a4734 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:08.976529 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1a0d5-433c-4f97-8918-e354ab1a4734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:08.980608 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1a0d5-433c-4f97-8918-e354ab1a4734 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:09.028934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 866/1755] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:08 2022] GET /identity/v3/roles => generated 1427 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:09.030051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1a0d5-433c-4f97-8918-e354ab1a4734 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:09.076216 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1a0d5-433c-4f97-8918-e354ab1a4734 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:09.084671 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca361e2-0a6c-4548-b616-6516805501b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:09.086550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca361e2-0a6c-4548-b616-6516805501b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:09.090967 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca361e2-0a6c-4548-b616-6516805501b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:09.090967 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca361e2-0a6c-4548-b616-6516805501b5 admin admin] PATH_INFO: `/v3/projects/14fd49ecea484a038357074d7e103d81/users/f798a231eb6b4f8480824045b5d4bf3b/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:09.090967 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca361e2-0a6c-4548-b616-6516805501b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14fd49ecea484a038357074d7e103d81, user_id=f798a231eb6b4f8480824045b5d4bf3b, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:09.092466 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca361e2-0a6c-4548-b616-6516805501b5 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:09.107152 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 867/1756] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:09 2022] PUT /identity/v3/projects/14fd49ecea484a038357074d7e103d81/users/f798a231eb6b4f8480824045b5d4bf3b/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:58:09.165402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2cf1d-94b9-4e8f-9594-850c18e5c3ed None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:09.166926 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2cf1d-94b9-4e8f-9594-850c18e5c3ed None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:09.167232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2cf1d-94b9-4e8f-9594-850c18e5c3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:09.226751 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:09.255638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954b268-4814-4e72-8206-b63f32263574 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:09.277915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-55b2cf1d-94b9-4e8f-9594-850c18e5c3ed None None] MFA Rules not processed for user `f798a231eb6b4f8480824045b5d4bf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:09.279260 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-55b2cf1d-94b9-4e8f-9594-850c18e5c3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:09.371201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4d1b1-0ed3-4fcb-bcf4-6867819ad68b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:09.371887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4d1b1-0ed3-4fcb-bcf4-6867819ad68b service swift] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:09.372279 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4d1b1-0ed3-4fcb-bcf4-6867819ad68b service swift] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:09.373118 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4d1b1-0ed3-4fcb-bcf4-6867819ad68b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:09.445827 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 868/1757] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:09.448440 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd6fa7-3819-4822-8097-d00ce313bcaf None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:09.449534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd6fa7-3819-4822-8097-d00ce313bcaf None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:09.450132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd6fa7-3819-4822-8097-d00ce313bcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:09.501372 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-6edd6fa7-3819-4822-8097-d00ce313bcaf None None] MFA Rules not processed for user `9e09f6a92f064ec78231fa06782bafda`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:09.505887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-6edd6fa7-3819-4822-8097-d00ce313bcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:09.511591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4d1b1-0ed3-4fcb-bcf4-6867819ad68b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:09.515342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4d1b1-0ed3-4fcb-bcf4-6867819ad68b service swift] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:09.537161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 890/1758] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 16:58:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 16:58:09.611319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 869/1759] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:09.722664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4d1b1-0ed3-4fcb-bcf4-6867819ad68b service swift] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:09.724635 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-76f4d1b1-0ed3-4fcb-bcf4-6867819ad68b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:09.957047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4d1b1-0ed3-4fcb-bcf4-6867819ad68b service swift] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:09.966880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d20ee8-8e01-4680-990c-f00281c61dba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:09.967566 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d20ee8-8e01-4680-990c-f00281c61dba service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:09.967860 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d20ee8-8e01-4680-990c-f00281c61dba service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:09.968299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d20ee8-8e01-4680-990c-f00281c61dba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:09.989963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd6fa7-3819-4822-8097-d00ce313bcaf None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:09.992218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d20ee8-8e01-4680-990c-f00281c61dba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:10.014387 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d20ee8-8e01-4680-990c-f00281c61dba service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:10.015238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd6fa7-3819-4822-8097-d00ce313bcaf None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:10.026853 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d0626-c572-4815-b397-afacb49d5ab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:10.030832 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d0626-c572-4815-b397-afacb49d5ab6 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:10.031280 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d0626-c572-4815-b397-afacb49d5ab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:10.033679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d0626-c572-4815-b397-afacb49d5ab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:10.040183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-976d0626-c572-4815-b397-afacb49d5ab6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:10.041913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 891/1760] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:58:10.168591 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d0626-c572-4815-b397-afacb49d5ab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:10.170741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d0626-c572-4815-b397-afacb49d5ab6 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:10.192403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:10.193300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 870/1761] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:10.545587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d20ee8-8e01-4680-990c-f00281c61dba service cinder] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:10.554969 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d20ee8-8e01-4680-990c-f00281c61dba service cinder] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:10.558841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e05ba-1fe6-4ab5-b8d9-35887f762e62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:10.559620 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e05ba-1fe6-4ab5-b8d9-35887f762e62 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:10.559939 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e05ba-1fe6-4ab5-b8d9-35887f762e62 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:10.560223 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e05ba-1fe6-4ab5-b8d9-35887f762e62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:10.672838 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e05ba-1fe6-4ab5-b8d9-35887f762e62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:10.674166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e05ba-1fe6-4ab5-b8d9-35887f762e62 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:10.686190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 892/1762] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:12.193435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d0626-c572-4815-b397-afacb49d5ab6 service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:12.225030 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:12.272383 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d0626-c572-4815-b397-afacb49d5ab6 service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:12.277627 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048e24f-71d5-4f77-a78f-bb0d4706b9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:12.278508 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048e24f-71d5-4f77-a78f-bb0d4706b9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:12.278802 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048e24f-71d5-4f77-a78f-bb0d4706b9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:12.279282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048e24f-71d5-4f77-a78f-bb0d4706b9ee admin admin] PATH_INFO: `/v3/users/f9201414c28e4ec3a7a30abb747d0b7a` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:12.280825 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048e24f-71d5-4f77-a78f-bb0d4706b9ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9201414c28e4ec3a7a30abb747d0b7a)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:12.283074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048e24f-71d5-4f77-a78f-bb0d4706b9ee admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:12.507387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4048e24f-71d5-4f77-a78f-bb0d4706b9ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9201414c28e4ec3a7a30abb747d0b7a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:12.509289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4048e24f-71d5-4f77-a78f-bb0d4706b9ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9201414c28e4ec3a7a30abb747d0b7a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:12.509289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4048e24f-71d5-4f77-a78f-bb0d4706b9ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9201414c28e4ec3a7a30abb747d0b7a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:12.606925 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4048e24f-71d5-4f77-a78f-bb0d4706b9ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9201414c28e4ec3a7a30abb747d0b7a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:12.627145 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4048e24f-71d5-4f77-a78f-bb0d4706b9ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9201414c28e4ec3a7a30abb747d0b7a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:12.644081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 871/1763] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:58:12 2022] DELETE /identity/v3/users/f9201414c28e4ec3a7a30abb747d0b7a => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:12.648659 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98f4ef-88a6-42e2-a2de-f979f8feba7b None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:12.648956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98f4ef-88a6-42e2-a2de-f979f8feba7b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:12.649241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98f4ef-88a6-42e2-a2de-f979f8feba7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:12.671676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-0e98f4ef-88a6-42e2-a2de-f979f8feba7b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:12.673631 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0e98f4ef-88a6-42e2-a2de-f979f8feba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:12.733395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 893/1764] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:12.743974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048e24f-71d5-4f77-a78f-bb0d4706b9ee admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:12.745418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4048e24f-71d5-4f77-a78f-bb0d4706b9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:12.808135 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048e24f-71d5-4f77-a78f-bb0d4706b9ee admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:12.811630 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c117d7-d116-4ca1-b4c3-5da26f9d3903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:12.812282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c117d7-d116-4ca1-b4c3-5da26f9d3903 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:12.812569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c117d7-d116-4ca1-b4c3-5da26f9d3903 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:12.812847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c117d7-d116-4ca1-b4c3-5da26f9d3903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:12.827393 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c117d7-d116-4ca1-b4c3-5da26f9d3903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:12.828970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c117d7-d116-4ca1-b4c3-5da26f9d3903 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:12.838800 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 872/1765] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:13.323436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98f4ef-88a6-42e2-a2de-f979f8feba7b None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:13.324927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0e98f4ef-88a6-42e2-a2de-f979f8feba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:13.338453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98f4ef-88a6-42e2-a2de-f979f8feba7b None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:13.344451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ea362-b824-4ec7-9a35-ba825a81ff31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:13.348166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ea362-b824-4ec7-9a35-ba825a81ff31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:13.348166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ea362-b824-4ec7-9a35-ba825a81ff31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:13.348166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ea362-b824-4ec7-9a35-ba825a81ff31 admin admin] PATH_INFO: `/v3/projects/35fba83dbdf94c8caa718021be9666be` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:13.348166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ea362-b824-4ec7-9a35-ba825a81ff31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35fba83dbdf94c8caa718021be9666be)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:13.350552 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ea362-b824-4ec7-9a35-ba825a81ff31 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:13.488852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-839ea362-b824-4ec7-9a35-ba825a81ff31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35fba83dbdf94c8caa718021be9666be', 'request_id': 'req-839ea362-b824-4ec7-9a35-ba825a81ff31'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:13.538666 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-839ea362-b824-4ec7-9a35-ba825a81ff31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35fba83dbdf94c8caa718021be9666be', 'request_id': 'req-839ea362-b824-4ec7-9a35-ba825a81ff31'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:13.545284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-839ea362-b824-4ec7-9a35-ba825a81ff31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35fba83dbdf94c8caa718021be9666be', 'request_id': 'req-839ea362-b824-4ec7-9a35-ba825a81ff31'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:13.556609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-839ea362-b824-4ec7-9a35-ba825a81ff31 admin admin] The token cache is being invalidate because project 35fba83dbdf94c8caa718021be9666be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:13.556900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-839ea362-b824-4ec7-9a35-ba825a81ff31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:13.557549 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-839ea362-b824-4ec7-9a35-ba825a81ff31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:13.559147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 894/1766] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:13 2022] DELETE /identity/v3/projects/35fba83dbdf94c8caa718021be9666be => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:13.563209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c117d7-d116-4ca1-b4c3-5da26f9d3903 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:13.573811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c117d7-d116-4ca1-b4c3-5da26f9d3903 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:13.630644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394553e6-179a-460d-8baf-85a91b9483e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:13.631538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394553e6-179a-460d-8baf-85a91b9483e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:13.631806 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394553e6-179a-460d-8baf-85a91b9483e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:13.632082 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394553e6-179a-460d-8baf-85a91b9483e5 admin admin] PATH_INFO: `/v3/users/f798a231eb6b4f8480824045b5d4bf3b` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:13.633260 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394553e6-179a-460d-8baf-85a91b9483e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f798a231eb6b4f8480824045b5d4bf3b)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:13.635265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394553e6-179a-460d-8baf-85a91b9483e5 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:14.037623 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-394553e6-179a-460d-8baf-85a91b9483e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f798a231eb6b4f8480824045b5d4bf3b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:14.038281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-394553e6-179a-460d-8baf-85a91b9483e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f798a231eb6b4f8480824045b5d4bf3b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:14.038923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-394553e6-179a-460d-8baf-85a91b9483e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f798a231eb6b4f8480824045b5d4bf3b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:14.121124 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-394553e6-179a-460d-8baf-85a91b9483e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f798a231eb6b4f8480824045b5d4bf3b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:14.136442 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-394553e6-179a-460d-8baf-85a91b9483e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f798a231eb6b4f8480824045b5d4bf3b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:14.151146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 873/1767] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:58:13 2022] DELETE /identity/v3/users/f798a231eb6b4f8480824045b5d4bf3b => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:14.178692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:14.310231 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:14.694573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ea362-b824-4ec7-9a35-ba825a81ff31 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:14.696067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-839ea362-b824-4ec7-9a35-ba825a81ff31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:14.709448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ea362-b824-4ec7-9a35-ba825a81ff31 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:14.766954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3d635-ecb0-4f47-afb1-ec5e1b1058f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:14.767824 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3d635-ecb0-4f47-afb1-ec5e1b1058f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:14.768113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3d635-ecb0-4f47-afb1-ec5e1b1058f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:14.768395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3d635-ecb0-4f47-afb1-ec5e1b1058f4 admin admin] PATH_INFO: `/v3/projects/14fd49ecea484a038357074d7e103d81` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:14.769898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3d635-ecb0-4f47-afb1-ec5e1b1058f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14fd49ecea484a038357074d7e103d81)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:14.771561 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3d635-ecb0-4f47-afb1-ec5e1b1058f4 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:14.927628 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a0c3d635-ecb0-4f47-afb1-ec5e1b1058f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14fd49ecea484a038357074d7e103d81', 'request_id': 'req-a0c3d635-ecb0-4f47-afb1-ec5e1b1058f4'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:15.006688 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a0c3d635-ecb0-4f47-afb1-ec5e1b1058f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14fd49ecea484a038357074d7e103d81', 'request_id': 'req-a0c3d635-ecb0-4f47-afb1-ec5e1b1058f4'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:15.013633 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a0c3d635-ecb0-4f47-afb1-ec5e1b1058f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14fd49ecea484a038357074d7e103d81', 'request_id': 'req-a0c3d635-ecb0-4f47-afb1-ec5e1b1058f4'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:15.024211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a0c3d635-ecb0-4f47-afb1-ec5e1b1058f4 admin admin] The token cache is being invalidate because project 14fd49ecea484a038357074d7e103d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:15.024495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a0c3d635-ecb0-4f47-afb1-ec5e1b1058f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:15.025129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a0c3d635-ecb0-4f47-afb1-ec5e1b1058f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:15.026694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 895/1768] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:14 2022] DELETE /identity/v3/projects/14fd49ecea484a038357074d7e103d81 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:15.031612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd313d42-71ef-4583-bf85-d5206d38b9d2 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:15.032261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd313d42-71ef-4583-bf85-d5206d38b9d2 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:15.032261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd313d42-71ef-4583-bf85-d5206d38b9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:15.050669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-dd313d42-71ef-4583-bf85-d5206d38b9d2 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:15.051866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-dd313d42-71ef-4583-bf85-d5206d38b9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:15.109794 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 874/1769] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:15.118842 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cc798-c0b1-4fe2-a873-1eee725ac10e None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:15.119078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cc798-c0b1-4fe2-a873-1eee725ac10e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:15.119356 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cc798-c0b1-4fe2-a873-1eee725ac10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:15.138276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-a77cc798-c0b1-4fe2-a873-1eee725ac10e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:15.139491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a77cc798-c0b1-4fe2-a873-1eee725ac10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:15.147807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 896/1770] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:15.152044 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd313d42-71ef-4583-bf85-d5206d38b9d2 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:15.161994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd313d42-71ef-4583-bf85-d5206d38b9d2 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:15.166663 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6190e-272c-4bab-9651-56985e908a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:15.167317 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6190e-272c-4bab-9651-56985e908a67 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:15.167606 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6190e-272c-4bab-9651-56985e908a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:15.167886 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6190e-272c-4bab-9651-56985e908a67 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:15.168609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6190e-272c-4bab-9651-56985e908a67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:58:15.168920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6190e-272c-4bab-9651-56985e908a67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:15.170622 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6190e-272c-4bab-9651-56985e908a67 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:15.183361 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 875/1771] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:58:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:58:15.187786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cc798-c0b1-4fe2-a873-1eee725ac10e None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:15.197839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cc798-c0b1-4fe2-a873-1eee725ac10e None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:15.202740 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a844de2-dbbc-4dfe-9197-d80c1b7ae967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:15.203277 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a844de2-dbbc-4dfe-9197-d80c1b7ae967 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:15.203682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a844de2-dbbc-4dfe-9197-d80c1b7ae967 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:15.204084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a844de2-dbbc-4dfe-9197-d80c1b7ae967 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:15.205170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a844de2-dbbc-4dfe-9197-d80c1b7ae967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:15.207150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a844de2-dbbc-4dfe-9197-d80c1b7ae967 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:15.293687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 897/1772] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:15 2022] POST /identity/v3/projects => generated 384 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:15.298911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:15.300304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6190e-272c-4bab-9651-56985e908a67 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:15.310077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6190e-272c-4bab-9651-56985e908a67 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:15.364362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab0447-474c-45dc-b1f2-5d6f1f77bff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:15.365131 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab0447-474c-45dc-b1f2-5d6f1f77bff1 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:15.365420 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab0447-474c-45dc-b1f2-5d6f1f77bff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:15.365697 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab0447-474c-45dc-b1f2-5d6f1f77bff1 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:15.366577 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab0447-474c-45dc-b1f2-5d6f1f77bff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:15.368403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab0447-474c-45dc-b1f2-5d6f1f77bff1 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:15.440873 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 876/1773] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:15 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:15.444975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a844de2-dbbc-4dfe-9197-d80c1b7ae967 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:15.455613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a844de2-dbbc-4dfe-9197-d80c1b7ae967 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:15.460330 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ec6dd-70d3-4563-be2c-bfbe5ff41603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:15.460970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ec6dd-70d3-4563-be2c-bfbe5ff41603 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:15.461257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ec6dd-70d3-4563-be2c-bfbe5ff41603 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:15.461538 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ec6dd-70d3-4563-be2c-bfbe5ff41603 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:15.462256 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ec6dd-70d3-4563-be2c-bfbe5ff41603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:15.463929 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ec6dd-70d3-4563-be2c-bfbe5ff41603 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:15.474719 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 898/1774] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:15 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:58:15.478778 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab0447-474c-45dc-b1f2-5d6f1f77bff1 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:15.489759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab0447-474c-45dc-b1f2-5d6f1f77bff1 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:15.494995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff9600-08c6-4dd3-9b72-3a335fc30853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:15.495656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff9600-08c6-4dd3-9b72-3a335fc30853 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:15.495940 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff9600-08c6-4dd3-9b72-3a335fc30853 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:15.496220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff9600-08c6-4dd3-9b72-3a335fc30853 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:15.496939 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff9600-08c6-4dd3-9b72-3a335fc30853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:15.498556 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff9600-08c6-4dd3-9b72-3a335fc30853 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:15.512590 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 877/1775] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:15 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:15.513742 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ec6dd-70d3-4563-be2c-bfbe5ff41603 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:15.523862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ec6dd-70d3-4563-be2c-bfbe5ff41603 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:15.528662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d23b11-1058-415e-acfe-e8977a16c349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:15.529597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d23b11-1058-415e-acfe-e8977a16c349 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:15.529957 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d23b11-1058-415e-acfe-e8977a16c349 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:15.530243 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d23b11-1058-415e-acfe-e8977a16c349 admin admin] PATH_INFO: `/v3/projects/eb9fa21d9c4148aa9d998cab7ee962e6/users/5c4934640e20413085d7c78663115247/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:15.533418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:15.546678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d23b11-1058-415e-acfe-e8977a16c349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9fa21d9c4148aa9d998cab7ee962e6, user_id=5c4934640e20413085d7c78663115247, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:15.550127 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d23b11-1058-415e-acfe-e8977a16c349 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:15.653393 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 899/1776] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:15 2022] PUT /identity/v3/projects/eb9fa21d9c4148aa9d998cab7ee962e6/users/5c4934640e20413085d7c78663115247/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:15.665209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83dba2-3bc5-4a5c-995a-ce22af5f1812 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:15.665787 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83dba2-3bc5-4a5c-995a-ce22af5f1812 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:15.666077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83dba2-3bc5-4a5c-995a-ce22af5f1812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:15.699414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-df83dba2-3bc5-4a5c-995a-ce22af5f1812 None None] MFA Rules not processed for user `5c4934640e20413085d7c78663115247`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:15.700541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-df83dba2-3bc5-4a5c-995a-ce22af5f1812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:15.776625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 878/1777] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:15.788697 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d23b11-1058-415e-acfe-e8977a16c349 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:15.791086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-67d23b11-1058-415e-acfe-e8977a16c349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:15.858913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d23b11-1058-415e-acfe-e8977a16c349 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:15.862840 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fd26c-7831-4a9a-9393-9f6781023750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:15.863499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fd26c-7831-4a9a-9393-9f6781023750 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:15.863782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fd26c-7831-4a9a-9393-9f6781023750 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:15.864057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fd26c-7831-4a9a-9393-9f6781023750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:15.874031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fd26c-7831-4a9a-9393-9f6781023750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:15.875756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fd26c-7831-4a9a-9393-9f6781023750 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:15.888566 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 900/1778] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:15.924510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83dba2-3bc5-4a5c-995a-ce22af5f1812 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:15.986238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:16.014368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83dba2-3bc5-4a5c-995a-ce22af5f1812 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:16.020461 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d8a75-f416-4cb4-8752-b112e3129426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:16.021359 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d8a75-f416-4cb4-8752-b112e3129426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:16.021647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d8a75-f416-4cb4-8752-b112e3129426 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:16.021932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d8a75-f416-4cb4-8752-b112e3129426 admin admin] PATH_INFO: `/v3/users/5c4934640e20413085d7c78663115247` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:16.023185 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d8a75-f416-4cb4-8752-b112e3129426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c4934640e20413085d7c78663115247)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:16.025158 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d8a75-f416-4cb4-8752-b112e3129426 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:16.053310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:16.276442 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ba2d8a75-f416-4cb4-8752-b112e3129426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c4934640e20413085d7c78663115247'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:16.278212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ba2d8a75-f416-4cb4-8752-b112e3129426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c4934640e20413085d7c78663115247'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:16.278661 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ba2d8a75-f416-4cb4-8752-b112e3129426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c4934640e20413085d7c78663115247'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:16.384177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ba2d8a75-f416-4cb4-8752-b112e3129426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c4934640e20413085d7c78663115247'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:16.396841 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ba2d8a75-f416-4cb4-8752-b112e3129426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c4934640e20413085d7c78663115247'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:16.409722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 879/1779] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:58:15 2022] DELETE /identity/v3/users/5c4934640e20413085d7c78663115247 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:16.414221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d6581-a27a-4dad-bf1f-f19972a40bad None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:16.414551 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d6581-a27a-4dad-bf1f-f19972a40bad None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:16.414836 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d6581-a27a-4dad-bf1f-f19972a40bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:16.433483 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-888d6581-a27a-4dad-bf1f-f19972a40bad None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:16.434738 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-888d6581-a27a-4dad-bf1f-f19972a40bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:16.494207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 901/1780] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:16.503641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d8a75-f416-4cb4-8752-b112e3129426 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:16.505163 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-ba2d8a75-f416-4cb4-8752-b112e3129426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:16.566093 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d8a75-f416-4cb4-8752-b112e3129426 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:16.569772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67945f50-d586-4356-8cda-b09197763591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:16.570509 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67945f50-d586-4356-8cda-b09197763591 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:16.570806 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67945f50-d586-4356-8cda-b09197763591 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:16.571088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67945f50-d586-4356-8cda-b09197763591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:16.581599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67945f50-d586-4356-8cda-b09197763591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:16.583080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67945f50-d586-4356-8cda-b09197763591 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:16.592884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 880/1781] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:17.123651 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d6581-a27a-4dad-bf1f-f19972a40bad None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:17.125121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-888d6581-a27a-4dad-bf1f-f19972a40bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:17.144186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d6581-a27a-4dad-bf1f-f19972a40bad None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:17.152754 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ede8cc-e969-4edb-9e7b-193ba14dc835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:17.153669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ede8cc-e969-4edb-9e7b-193ba14dc835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:17.153954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ede8cc-e969-4edb-9e7b-193ba14dc835 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:17.154447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ede8cc-e969-4edb-9e7b-193ba14dc835 admin admin] PATH_INFO: `/v3/projects/eb9fa21d9c4148aa9d998cab7ee962e6` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:17.158115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ede8cc-e969-4edb-9e7b-193ba14dc835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9fa21d9c4148aa9d998cab7ee962e6)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:17.160133 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ede8cc-e969-4edb-9e7b-193ba14dc835 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:17.247129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:17.317075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a1ede8cc-e969-4edb-9e7b-193ba14dc835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9fa21d9c4148aa9d998cab7ee962e6', 'request_id': 'req-a1ede8cc-e969-4edb-9e7b-193ba14dc835'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:17.430010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a1ede8cc-e969-4edb-9e7b-193ba14dc835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9fa21d9c4148aa9d998cab7ee962e6', 'request_id': 'req-a1ede8cc-e969-4edb-9e7b-193ba14dc835'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:17.438277 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a1ede8cc-e969-4edb-9e7b-193ba14dc835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9fa21d9c4148aa9d998cab7ee962e6', 'request_id': 'req-a1ede8cc-e969-4edb-9e7b-193ba14dc835'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:17.450246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a1ede8cc-e969-4edb-9e7b-193ba14dc835 admin admin] The token cache is being invalidate because project eb9fa21d9c4148aa9d998cab7ee962e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:17.450576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a1ede8cc-e969-4edb-9e7b-193ba14dc835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:17.451586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a1ede8cc-e969-4edb-9e7b-193ba14dc835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:17.453370 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 902/1782] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:17 2022] DELETE /identity/v3/projects/eb9fa21d9c4148aa9d998cab7ee962e6 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:17.459233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77195ac-0b94-40a8-9701-1e3c43c5d33d None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:17.463277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77195ac-0b94-40a8-9701-1e3c43c5d33d None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:17.463277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77195ac-0b94-40a8-9701-1e3c43c5d33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:17.479871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-c77195ac-0b94-40a8-9701-1e3c43c5d33d None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:17.481127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-c77195ac-0b94-40a8-9701-1e3c43c5d33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:17.517261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:17.547402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 881/1783] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:17.556911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6535b3-bf22-4f2f-a66c-16c5f0471b76 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:17.557287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6535b3-bf22-4f2f-a66c-16c5f0471b76 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:17.557639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6535b3-bf22-4f2f-a66c-16c5f0471b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:17.578168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-8f6535b3-bf22-4f2f-a66c-16c5f0471b76 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:17.580739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8f6535b3-bf22-4f2f-a66c-16c5f0471b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:17.590876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 903/1784] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:17.595280 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77195ac-0b94-40a8-9701-1e3c43c5d33d None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:17.605279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77195ac-0b94-40a8-9701-1e3c43c5d33d None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:17.611392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5bbdf-6162-49ce-a7b0-1f73607f4ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:17.611392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5bbdf-6162-49ce-a7b0-1f73607f4ffe admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:17.611392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5bbdf-6162-49ce-a7b0-1f73607f4ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:17.611392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5bbdf-6162-49ce-a7b0-1f73607f4ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:17.612019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5bbdf-6162-49ce-a7b0-1f73607f4ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:58:17.612332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5bbdf-6162-49ce-a7b0-1f73607f4ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:17.613956 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5bbdf-6162-49ce-a7b0-1f73607f4ffe admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:17.626958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 882/1785] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:58:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:58:17.631428 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6535b3-bf22-4f2f-a66c-16c5f0471b76 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:17.642008 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6535b3-bf22-4f2f-a66c-16c5f0471b76 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:17.648223 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d37a7-7cb7-4dcb-8cf0-5ed740688d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:17.649022 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d37a7-7cb7-4dcb-8cf0-5ed740688d3a admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:17.649424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d37a7-7cb7-4dcb-8cf0-5ed740688d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:17.649766 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d37a7-7cb7-4dcb-8cf0-5ed740688d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:17.650597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d37a7-7cb7-4dcb-8cf0-5ed740688d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:17.652683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d37a7-7cb7-4dcb-8cf0-5ed740688d3a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:17.782743 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5bbdf-6162-49ce-a7b0-1f73607f4ffe admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:17.784587 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-bab5bbdf-6162-49ce-a7b0-1f73607f4ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:17.804178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 904/1786] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:17 2022] POST /identity/v3/projects => generated 376 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:58:17.808754 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d37a7-7cb7-4dcb-8cf0-5ed740688d3a admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:17.863869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5bbdf-6162-49ce-a7b0-1f73607f4ffe admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:17.905554 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d37a7-7cb7-4dcb-8cf0-5ed740688d3a admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:17.911506 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cd70a-ed78-4fff-8fc8-5249defd70cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:17.912186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cd70a-ed78-4fff-8fc8-5249defd70cf admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:17.914262 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cd70a-ed78-4fff-8fc8-5249defd70cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:17.914262 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cd70a-ed78-4fff-8fc8-5249defd70cf admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:17.914262 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cd70a-ed78-4fff-8fc8-5249defd70cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:17.915500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cd70a-ed78-4fff-8fc8-5249defd70cf admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:17.917291 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b574d8-9f56-48da-b18f-184a06f65cf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:17.918030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b574d8-9f56-48da-b18f-184a06f65cf8 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:17.918436 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b574d8-9f56-48da-b18f-184a06f65cf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:17.918789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b574d8-9f56-48da-b18f-184a06f65cf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:17.924155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b6b574d8-9f56-48da-b18f-184a06f65cf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:18.013498 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b574d8-9f56-48da-b18f-184a06f65cf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:18.015232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b574d8-9f56-48da-b18f-184a06f65cf8 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:18.028625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 883/1787] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:18.050294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 905/1788] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:17 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:58:18.054422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b574d8-9f56-48da-b18f-184a06f65cf8 service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:18.078096 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b574d8-9f56-48da-b18f-184a06f65cf8 service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:18.085510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2d008-4632-4ee5-8a5b-b0f5beb3da0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:18.086773 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2d008-4632-4ee5-8a5b-b0f5beb3da0d admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:18.087074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2d008-4632-4ee5-8a5b-b0f5beb3da0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:18.087362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2d008-4632-4ee5-8a5b-b0f5beb3da0d admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:18.088126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2d008-4632-4ee5-8a5b-b0f5beb3da0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:18.091851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2d008-4632-4ee5-8a5b-b0f5beb3da0d admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:18.112027 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cd70a-ed78-4fff-8fc8-5249defd70cf admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:18.112240 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 884/1789] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:18 2022] GET /identity/v3/roles => generated 1427 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:18.135151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cd70a-ed78-4fff-8fc8-5249defd70cf admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:18.140969 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701efeb-9670-4f47-8f3c-9788fdf6be12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:18.146604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701efeb-9670-4f47-8f3c-9788fdf6be12 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:18.146604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701efeb-9670-4f47-8f3c-9788fdf6be12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:18.146604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701efeb-9670-4f47-8f3c-9788fdf6be12 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:18.146604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701efeb-9670-4f47-8f3c-9788fdf6be12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:18.156408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701efeb-9670-4f47-8f3c-9788fdf6be12 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:18.170487 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 906/1790] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:18 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:58:18.175649 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2d008-4632-4ee5-8a5b-b0f5beb3da0d admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:18.190864 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2d008-4632-4ee5-8a5b-b0f5beb3da0d admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:18.231224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacfc54-f474-4066-aa1b-ccb2924f8ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:18.238391 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacfc54-f474-4066-aa1b-ccb2924f8ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:18.238391 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacfc54-f474-4066-aa1b-ccb2924f8ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:18.238391 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacfc54-f474-4066-aa1b-ccb2924f8ebd admin admin] PATH_INFO: `/v3/projects/713002c7471a475c956b7c903bc29103/users/36fec741cf9241eba3dd92566f945e00/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:18.272133 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacfc54-f474-4066-aa1b-ccb2924f8ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=713002c7471a475c956b7c903bc29103, user_id=36fec741cf9241eba3dd92566f945e00, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:18.274807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacfc54-f474-4066-aa1b-ccb2924f8ebd admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:18.429193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 885/1791] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:18 2022] PUT /identity/v3/projects/713002c7471a475c956b7c903bc29103/users/36fec741cf9241eba3dd92566f945e00/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:18.442046 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017e9b-68f1-464e-8c93-33d94365464a None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:18.442573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017e9b-68f1-464e-8c93-33d94365464a None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:18.443754 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017e9b-68f1-464e-8c93-33d94365464a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:18.479216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-02017e9b-68f1-464e-8c93-33d94365464a None None] MFA Rules not processed for user `36fec741cf9241eba3dd92566f945e00`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:18.480567 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-02017e9b-68f1-464e-8c93-33d94365464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:18.597184 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 907/1792] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:18.601874 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacfc54-f474-4066-aa1b-ccb2924f8ebd admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:18.615767 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:18.688936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacfc54-f474-4066-aa1b-ccb2924f8ebd admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:18.695677 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:18.699951 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f24994-2068-404e-91f2-fa4564fdf40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:18.700662 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24994-2068-404e-91f2-fa4564fdf40b admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:18.700943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24994-2068-404e-91f2-fa4564fdf40b admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:18.701225 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24994-2068-404e-91f2-fa4564fdf40b admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:18.702192 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f24994-2068-404e-91f2-fa4564fdf40b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:18.705557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f24994-2068-404e-91f2-fa4564fdf40b admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:18.894540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 886/1793] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:18 2022] POST /identity/v3/projects => generated 376 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:18.895577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02017e9b-68f1-464e-8c93-33d94365464a None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:18.918139 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02017e9b-68f1-464e-8c93-33d94365464a None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:18.999478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6394a-20fc-436e-911a-522cac0398a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:19.000169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6394a-20fc-436e-911a-522cac0398a7 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:19.000458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6394a-20fc-436e-911a-522cac0398a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:19.001311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6394a-20fc-436e-911a-522cac0398a7 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:19.002348 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6394a-20fc-436e-911a-522cac0398a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:19.004292 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6394a-20fc-436e-911a-522cac0398a7 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:19.089085 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 908/1794] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:18 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:19.093493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f24994-2068-404e-91f2-fa4564fdf40b admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:19.107311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f24994-2068-404e-91f2-fa4564fdf40b admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:19.113516 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e4f4f-6f6c-4c9f-adc9-9f05efc83066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:19.114280 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e4f4f-6f6c-4c9f-adc9-9f05efc83066 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:19.114603 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e4f4f-6f6c-4c9f-adc9-9f05efc83066 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:19.117172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e4f4f-6f6c-4c9f-adc9-9f05efc83066 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:19.117172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e4f4f-6f6c-4c9f-adc9-9f05efc83066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:19.117487 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e4f4f-6f6c-4c9f-adc9-9f05efc83066 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:19.131277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 887/1795] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:19 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:19.135485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6394a-20fc-436e-911a-522cac0398a7 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:19.149821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6394a-20fc-436e-911a-522cac0398a7 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:19.156072 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dfd64-3568-4e00-b835-05ca36cd8728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:19.157327 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dfd64-3568-4e00-b835-05ca36cd8728 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:19.157613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dfd64-3568-4e00-b835-05ca36cd8728 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:19.157895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dfd64-3568-4e00-b835-05ca36cd8728 admin admin] PATH_INFO: `/v3/projects/829ec561784c4d81ada4b4f32e70c5e6/users/4cdd90cde8324eab996329a7dc93e947/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:19.175564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659dfd64-3568-4e00-b835-05ca36cd8728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829ec561784c4d81ada4b4f32e70c5e6, user_id=4cdd90cde8324eab996329a7dc93e947, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:19.178931 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659dfd64-3568-4e00-b835-05ca36cd8728 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:19.329773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 909/1796] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:19 2022] PUT /identity/v3/projects/829ec561784c4d81ada4b4f32e70c5e6/users/4cdd90cde8324eab996329a7dc93e947/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:19.333847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e4f4f-6f6c-4c9f-adc9-9f05efc83066 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:19.357039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e4f4f-6f6c-4c9f-adc9-9f05efc83066 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:19.425233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633cf6d-578b-4431-aba3-df6a4dd22f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:19.438909 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633cf6d-578b-4431-aba3-df6a4dd22f27 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:19.438909 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633cf6d-578b-4431-aba3-df6a4dd22f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:19.438909 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633cf6d-578b-4431-aba3-df6a4dd22f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:19.438909 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633cf6d-578b-4431-aba3-df6a4dd22f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:19.441109 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633cf6d-578b-4431-aba3-df6a4dd22f27 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:19.468088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 888/1797] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:19 2022] GET /identity/v3/roles => generated 1427 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:19.472697 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dfd64-3568-4e00-b835-05ca36cd8728 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:19.487875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:19.489658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dfd64-3568-4e00-b835-05ca36cd8728 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:19.496784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56985a7-4ce7-4b38-bcdb-1efd533500ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:19.498661 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56985a7-4ce7-4b38-bcdb-1efd533500ce admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:19.499314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56985a7-4ce7-4b38-bcdb-1efd533500ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:19.503711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56985a7-4ce7-4b38-bcdb-1efd533500ce admin admin] PATH_INFO: `/v3/projects/829ec561784c4d81ada4b4f32e70c5e6/users/4cdd90cde8324eab996329a7dc93e947/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:19.506386 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56985a7-4ce7-4b38-bcdb-1efd533500ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=829ec561784c4d81ada4b4f32e70c5e6, user_id=4cdd90cde8324eab996329a7dc93e947, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:19.509254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56985a7-4ce7-4b38-bcdb-1efd533500ce admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:19.524871 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 910/1798] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:19 2022] PUT /identity/v3/projects/829ec561784c4d81ada4b4f32e70c5e6/users/4cdd90cde8324eab996329a7dc93e947/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:19.536835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a159ad-c759-4837-bf72-4cdad7d7e04d None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:19.537240 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a159ad-c759-4837-bf72-4cdad7d7e04d None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:19.537552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a159ad-c759-4837-bf72-4cdad7d7e04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:19.582541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-65a159ad-c759-4837-bf72-4cdad7d7e04d None None] MFA Rules not processed for user `4cdd90cde8324eab996329a7dc93e947`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:19.583786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-65a159ad-c759-4837-bf72-4cdad7d7e04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:19.684956 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 889/1799] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:19.698993 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56985a7-4ce7-4b38-bcdb-1efd533500ce admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:19.758455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56985a7-4ce7-4b38-bcdb-1efd533500ce admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:19.762456 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3f2c9-afc9-4ad0-9fae-ccaa0ecb7e91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:19.763212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3f2c9-afc9-4ad0-9fae-ccaa0ecb7e91 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:19.763594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3f2c9-afc9-4ad0-9fae-ccaa0ecb7e91 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:19.763974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3f2c9-afc9-4ad0-9fae-ccaa0ecb7e91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:19.846356 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3f2c9-afc9-4ad0-9fae-ccaa0ecb7e91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:19.847980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3f2c9-afc9-4ad0-9fae-ccaa0ecb7e91 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:19.859124 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 911/1800] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:20.790543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:21.224546 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:21.481684 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:21.728533 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:21.973405 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:22.161664 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:22.258522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:30.166443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8facf-fe43-4843-9dad-ec301ad89c89 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:30.167127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8facf-fe43-4843-9dad-ec301ad89c89 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:30.167127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8facf-fe43-4843-9dad-ec301ad89c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:30.217831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-1ae8facf-fe43-4843-9dad-ec301ad89c89 None None] MFA Rules not processed for user `0288901db0244eab9a737af460ce1bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:30.222474 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1ae8facf-fe43-4843-9dad-ec301ad89c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:30.373758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 890/1801] 10.222.0.45 () {58 vars in 1019 bytes} [Thu May 26 16:58:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:30.426638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3f2c9-afc9-4ad0-9fae-ccaa0ecb7e91 service cinder] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:30.428115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a1d3f2c9-afc9-4ad0-9fae-ccaa0ecb7e91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:30.451511 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3f2c9-afc9-4ad0-9fae-ccaa0ecb7e91 service cinder] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:30.456917 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689f4f8-80b1-45c5-9318-1e13a8422352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:30.457685 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689f4f8-80b1-45c5-9318-1e13a8422352 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:30.458037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689f4f8-80b1-45c5-9318-1e13a8422352 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:30.458359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689f4f8-80b1-45c5-9318-1e13a8422352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:30.468945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689f4f8-80b1-45c5-9318-1e13a8422352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:30.471354 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689f4f8-80b1-45c5-9318-1e13a8422352 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:30.491600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 912/1802] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:30.710571 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8facf-fe43-4843-9dad-ec301ad89c89 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:30.714270 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1ae8facf-fe43-4843-9dad-ec301ad89c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:30.824610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8facf-fe43-4843-9dad-ec301ad89c89 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:30.834774 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78922ac9-2dc1-4f30-9cf8-3f6a6218b4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:30.836014 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922ac9-2dc1-4f30-9cf8-3f6a6218b4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:30.836831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922ac9-2dc1-4f30-9cf8-3f6a6218b4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:30.837361 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922ac9-2dc1-4f30-9cf8-3f6a6218b4ad admin admin] PATH_INFO: `/v3/users/c4c90777ae734707a4f7245ea8035851` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:30.839161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78922ac9-2dc1-4f30-9cf8-3f6a6218b4ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c90777ae734707a4f7245ea8035851)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:30.841769 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78922ac9-2dc1-4f30-9cf8-3f6a6218b4ad admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:30.865623 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:31.173699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-78922ac9-2dc1-4f30-9cf8-3f6a6218b4ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c90777ae734707a4f7245ea8035851'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:31.176152 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-78922ac9-2dc1-4f30-9cf8-3f6a6218b4ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c90777ae734707a4f7245ea8035851'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:31.177861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-78922ac9-2dc1-4f30-9cf8-3f6a6218b4ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c90777ae734707a4f7245ea8035851'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:31.343122 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-78922ac9-2dc1-4f30-9cf8-3f6a6218b4ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c90777ae734707a4f7245ea8035851'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:31.358233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-78922ac9-2dc1-4f30-9cf8-3f6a6218b4ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c90777ae734707a4f7245ea8035851'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:31.376475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 891/1803] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:58:30 2022] DELETE /identity/v3/users/c4c90777ae734707a4f7245ea8035851 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:31.378466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863fda4-cd64-47fa-a42b-b3cb4638fac6 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:31.378871 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863fda4-cd64-47fa-a42b-b3cb4638fac6 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:31.379910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863fda4-cd64-47fa-a42b-b3cb4638fac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:31.410856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-8863fda4-cd64-47fa-a42b-b3cb4638fac6 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:31.412085 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8863fda4-cd64-47fa-a42b-b3cb4638fac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:31.480750 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 913/1804] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:58:31.501451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78922ac9-2dc1-4f30-9cf8-3f6a6218b4ad admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:31.503274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-78922ac9-2dc1-4f30-9cf8-3f6a6218b4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:31.556223 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863fda4-cd64-47fa-a42b-b3cb4638fac6 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:31.563423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8863fda4-cd64-47fa-a42b-b3cb4638fac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:31.564587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:31.583299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78922ac9-2dc1-4f30-9cf8-3f6a6218b4ad admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:31.592066 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed08a8d-aa6a-4db2-8482-e8dc94f06ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:31.592066 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed08a8d-aa6a-4db2-8482-e8dc94f06ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:31.592066 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed08a8d-aa6a-4db2-8482-e8dc94f06ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:31.592066 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed08a8d-aa6a-4db2-8482-e8dc94f06ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:31.601350 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed08a8d-aa6a-4db2-8482-e8dc94f06ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:31.602795 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed08a8d-aa6a-4db2-8482-e8dc94f06ea4 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:31.616899 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 892/1805] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:31.638678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863fda4-cd64-47fa-a42b-b3cb4638fac6 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:31.653676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a5ff0-8e09-4574-8013-1f81bd8300f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:31.654287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a5ff0-8e09-4574-8013-1f81bd8300f5 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:31.654616 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a5ff0-8e09-4574-8013-1f81bd8300f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:31.655577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a5ff0-8e09-4574-8013-1f81bd8300f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:31.658530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-655a5ff0-8e09-4574-8013-1f81bd8300f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:31.730907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a5ff0-8e09-4574-8013-1f81bd8300f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:31.732660 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a5ff0-8e09-4574-8013-1f81bd8300f5 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:31.746675 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 914/1806] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:32.263294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d513f-0177-4862-9034-572d314fa37f None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:32.264876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d513f-0177-4862-9034-572d314fa37f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:32.265457 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d513f-0177-4862-9034-572d314fa37f None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:32.267212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 893/1807] 10.222.0.112 () {54 vars in 926 bytes} [Thu May 26 16:58:32 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:58:32.280633 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aef07c-041f-4b0c-817e-1737ad1c525a None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:32.281155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aef07c-041f-4b0c-817e-1737ad1c525a None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:32.281597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aef07c-041f-4b0c-817e-1737ad1c525a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:32.307430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d513f-0177-4862-9034-572d314fa37f None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:32.309244 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-275d513f-0177-4862-9034-572d314fa37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:32.331982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-89aef07c-041f-4b0c-817e-1737ad1c525a None None] MFA Rules not processed for user `5f2ec4c76f8f4d858bce53f30cc198fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:32.333287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-89aef07c-041f-4b0c-817e-1737ad1c525a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:32.353221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d513f-0177-4862-9034-572d314fa37f None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:32.370692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fff48e-bf3c-4239-ac0f-90bcd76cd599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:32.371780 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fff48e-bf3c-4239-ac0f-90bcd76cd599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:32.372096 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fff48e-bf3c-4239-ac0f-90bcd76cd599 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:32.372372 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fff48e-bf3c-4239-ac0f-90bcd76cd599 admin admin] PATH_INFO: `/v3/projects/59358446c4044832a7794ce504dfc92a` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:32.374635 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fff48e-bf3c-4239-ac0f-90bcd76cd599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59358446c4044832a7794ce504dfc92a)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:32.378722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fff48e-bf3c-4239-ac0f-90bcd76cd599 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:32.459843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 915/1808] 10.222.0.112 () {58 vars in 1023 bytes} [Thu May 26 16:58:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:58:32.474868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aef07c-041f-4b0c-817e-1737ad1c525a None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:32.476280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-89aef07c-041f-4b0c-817e-1737ad1c525a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:32.498035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aef07c-041f-4b0c-817e-1737ad1c525a None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:32.514312 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c28604-f7f3-41ec-8713-7ab448d6153b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:32.515410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c28604-f7f3-41ec-8713-7ab448d6153b service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:32.518048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c28604-f7f3-41ec-8713-7ab448d6153b service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:32.518544 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c28604-f7f3-41ec-8713-7ab448d6153b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:32.537954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c28604-f7f3-41ec-8713-7ab448d6153b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:32.539727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c28604-f7f3-41ec-8713-7ab448d6153b service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:32.571370 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-37fff48e-bf3c-4239-ac0f-90bcd76cd599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59358446c4044832a7794ce504dfc92a', 'request_id': 'req-37fff48e-bf3c-4239-ac0f-90bcd76cd599'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:32.626691 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 916/1809] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:58:32.700084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-37fff48e-bf3c-4239-ac0f-90bcd76cd599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59358446c4044832a7794ce504dfc92a', 'request_id': 'req-37fff48e-bf3c-4239-ac0f-90bcd76cd599'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:32.710376 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-37fff48e-bf3c-4239-ac0f-90bcd76cd599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59358446c4044832a7794ce504dfc92a', 'request_id': 'req-37fff48e-bf3c-4239-ac0f-90bcd76cd599'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:32.733277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-37fff48e-bf3c-4239-ac0f-90bcd76cd599 admin admin] The token cache is being invalidate because project 59358446c4044832a7794ce504dfc92a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:32.733626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-37fff48e-bf3c-4239-ac0f-90bcd76cd599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:32.735917 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-37fff48e-bf3c-4239-ac0f-90bcd76cd599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:32.738557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 894/1810] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:32 2022] DELETE /identity/v3/projects/59358446c4044832a7794ce504dfc92a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:58:32.742246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c28604-f7f3-41ec-8713-7ab448d6153b service nova] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:32.784299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c28604-f7f3-41ec-8713-7ab448d6153b service nova] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:32.804288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:32.888331 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975f09d-ec87-476e-bf52-6254f379fa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:32.889677 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975f09d-ec87-476e-bf52-6254f379fa67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:32.891848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975f09d-ec87-476e-bf52-6254f379fa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:32.891848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975f09d-ec87-476e-bf52-6254f379fa67 admin admin] PATH_INFO: `/v3/users/a6b139d00f544c44a08c4752b6ee2f97` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:32.896885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975f09d-ec87-476e-bf52-6254f379fa67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b139d00f544c44a08c4752b6ee2f97)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:32.900093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975f09d-ec87-476e-bf52-6254f379fa67 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:33.104394 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5975f09d-ec87-476e-bf52-6254f379fa67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b139d00f544c44a08c4752b6ee2f97'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:33.105093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5975f09d-ec87-476e-bf52-6254f379fa67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b139d00f544c44a08c4752b6ee2f97'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:33.118575 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5975f09d-ec87-476e-bf52-6254f379fa67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b139d00f544c44a08c4752b6ee2f97'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:33.238726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5975f09d-ec87-476e-bf52-6254f379fa67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b139d00f544c44a08c4752b6ee2f97'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:33.254823 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5975f09d-ec87-476e-bf52-6254f379fa67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b139d00f544c44a08c4752b6ee2f97'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:33.272194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 917/1811] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:58:32 2022] DELETE /identity/v3/users/a6b139d00f544c44a08c4752b6ee2f97 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:35.213251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fff48e-bf3c-4239-ac0f-90bcd76cd599 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:35.215268 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-37fff48e-bf3c-4239-ac0f-90bcd76cd599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:35.263227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fff48e-bf3c-4239-ac0f-90bcd76cd599 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:35.278307 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:35.410008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9fddd-2e1a-463b-b9d0-fa86ed25cff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:35.411055 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9fddd-2e1a-463b-b9d0-fa86ed25cff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:35.411419 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9fddd-2e1a-463b-b9d0-fa86ed25cff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:35.411817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9fddd-2e1a-463b-b9d0-fa86ed25cff8 admin admin] PATH_INFO: `/v3/projects/991c85a25e7040bc9c3feee4d8c39f56` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:35.413347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9fddd-2e1a-463b-b9d0-fa86ed25cff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=991c85a25e7040bc9c3feee4d8c39f56)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:35.415598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9fddd-2e1a-463b-b9d0-fa86ed25cff8 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:35.549226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-84c9fddd-2e1a-463b-b9d0-fa86ed25cff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991c85a25e7040bc9c3feee4d8c39f56', 'request_id': 'req-84c9fddd-2e1a-463b-b9d0-fa86ed25cff8'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:35.676047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-84c9fddd-2e1a-463b-b9d0-fa86ed25cff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991c85a25e7040bc9c3feee4d8c39f56', 'request_id': 'req-84c9fddd-2e1a-463b-b9d0-fa86ed25cff8'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:35.691222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-84c9fddd-2e1a-463b-b9d0-fa86ed25cff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991c85a25e7040bc9c3feee4d8c39f56', 'request_id': 'req-84c9fddd-2e1a-463b-b9d0-fa86ed25cff8'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:35.707777 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-84c9fddd-2e1a-463b-b9d0-fa86ed25cff8 admin admin] The token cache is being invalidate because project 991c85a25e7040bc9c3feee4d8c39f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:35.708168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-84c9fddd-2e1a-463b-b9d0-fa86ed25cff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:35.708840 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-84c9fddd-2e1a-463b-b9d0-fa86ed25cff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:35.710475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 895/1812] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:35 2022] DELETE /identity/v3/projects/991c85a25e7040bc9c3feee4d8c39f56 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:35.715692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4e2c6-5644-4cef-bf92-a27dd9c63606 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:35.716518 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4e2c6-5644-4cef-bf92-a27dd9c63606 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:35.717005 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4e2c6-5644-4cef-bf92-a27dd9c63606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:35.756485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-51e4e2c6-5644-4cef-bf92-a27dd9c63606 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:35.757710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-51e4e2c6-5644-4cef-bf92-a27dd9c63606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:35.823069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 918/1813] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:58:35.831707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462153e-9680-4762-8cdc-5421e6ee9812 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:35.832028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462153e-9680-4762-8cdc-5421e6ee9812 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:35.832309 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462153e-9680-4762-8cdc-5421e6ee9812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:35.851649 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-1462153e-9680-4762-8cdc-5421e6ee9812 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:35.853046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1462153e-9680-4762-8cdc-5421e6ee9812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:35.862274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 896/1814] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:35.866615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4e2c6-5644-4cef-bf92-a27dd9c63606 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:35.877180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4e2c6-5644-4cef-bf92-a27dd9c63606 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:35.882187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498905c-1240-41c6-a57c-70ee7dfe4b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:35.882878 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498905c-1240-41c6-a57c-70ee7dfe4b3c admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:35.883166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498905c-1240-41c6-a57c-70ee7dfe4b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:35.883447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498905c-1240-41c6-a57c-70ee7dfe4b3c admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:35.884174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498905c-1240-41c6-a57c-70ee7dfe4b3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:58:35.884482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498905c-1240-41c6-a57c-70ee7dfe4b3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:35.886080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498905c-1240-41c6-a57c-70ee7dfe4b3c admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:35.901885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 919/1815] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:58:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:58:35.920618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462153e-9680-4762-8cdc-5421e6ee9812 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:35.920618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462153e-9680-4762-8cdc-5421e6ee9812 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:35.920618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c17af-9fca-4a62-abc0-205b839eb0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:35.920618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c17af-9fca-4a62-abc0-205b839eb0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:35.921101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c17af-9fca-4a62-abc0-205b839eb0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:35.921101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c17af-9fca-4a62-abc0-205b839eb0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:35.921101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c17af-9fca-4a62-abc0-205b839eb0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:35.921101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c17af-9fca-4a62-abc0-205b839eb0c6 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:36.034536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 897/1816] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:35 2022] POST /identity/v3/projects => generated 370 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:36.035686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498905c-1240-41c6-a57c-70ee7dfe4b3c admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:36.045803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498905c-1240-41c6-a57c-70ee7dfe4b3c admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:36.054286 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:36.103670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8278a-8f7f-4c95-ad14-729bc3a4dd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:36.104346 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8278a-8f7f-4c95-ad14-729bc3a4dd3c admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:36.104659 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8278a-8f7f-4c95-ad14-729bc3a4dd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:36.104974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8278a-8f7f-4c95-ad14-729bc3a4dd3c admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:36.105668 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8278a-8f7f-4c95-ad14-729bc3a4dd3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:36.107624 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8278a-8f7f-4c95-ad14-729bc3a4dd3c admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:36.207752 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 920/1817] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:36 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:36.211811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c17af-9fca-4a62-abc0-205b839eb0c6 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:36.222583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c17af-9fca-4a62-abc0-205b839eb0c6 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:36.227246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63074b1a-58c0-4366-9641-473a939903eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:36.235403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63074b1a-58c0-4366-9641-473a939903eb admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:36.235403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63074b1a-58c0-4366-9641-473a939903eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:36.235403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63074b1a-58c0-4366-9641-473a939903eb admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:36.235403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63074b1a-58c0-4366-9641-473a939903eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:36.235403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63074b1a-58c0-4366-9641-473a939903eb admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:36.241988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 898/1818] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:36 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:36.246031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8278a-8f7f-4c95-ad14-729bc3a4dd3c admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:36.256920 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8278a-8f7f-4c95-ad14-729bc3a4dd3c admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:36.261519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638eb17-7adf-4ae7-8110-5f18dbc4425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:36.262217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638eb17-7adf-4ae7-8110-5f18dbc4425a admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:36.262611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638eb17-7adf-4ae7-8110-5f18dbc4425a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:36.269641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638eb17-7adf-4ae7-8110-5f18dbc4425a admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:36.269641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638eb17-7adf-4ae7-8110-5f18dbc4425a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:36.269641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638eb17-7adf-4ae7-8110-5f18dbc4425a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:36.275152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 921/1819] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:36 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:36.279243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63074b1a-58c0-4366-9641-473a939903eb admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:36.289406 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63074b1a-58c0-4366-9641-473a939903eb admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:36.294240 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930c748-fd39-4c34-829e-6b2f31748d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:36.295158 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930c748-fd39-4c34-829e-6b2f31748d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:36.295444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930c748-fd39-4c34-829e-6b2f31748d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:36.295725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930c748-fd39-4c34-829e-6b2f31748d31 admin admin] PATH_INFO: `/v3/projects/7a612e7bb9b247e99843185c9d96eeed/users/835a17be57094f5db83095a23f111aa6/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:36.310525 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930c748-fd39-4c34-829e-6b2f31748d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a612e7bb9b247e99843185c9d96eeed, user_id=835a17be57094f5db83095a23f111aa6, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:36.313264 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930c748-fd39-4c34-829e-6b2f31748d31 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:36.384682 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 899/1820] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:36 2022] PUT /identity/v3/projects/7a612e7bb9b247e99843185c9d96eeed/users/835a17be57094f5db83095a23f111aa6/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:36.395147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72e7dc-01ae-41c8-9c85-c0bbf71f3528 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:36.395444 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72e7dc-01ae-41c8-9c85-c0bbf71f3528 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:36.395730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72e7dc-01ae-41c8-9c85-c0bbf71f3528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:36.423402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-5f72e7dc-01ae-41c8-9c85-c0bbf71f3528 None None] MFA Rules not processed for user `835a17be57094f5db83095a23f111aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:36.424617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5f72e7dc-01ae-41c8-9c85-c0bbf71f3528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:36.488019 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 922/1821] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:36.492487 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930c748-fd39-4c34-829e-6b2f31748d31 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:36.536495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:36.557976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930c748-fd39-4c34-829e-6b2f31748d31 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:36.562938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784be02-1b23-4b67-a97a-019e4827c098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:36.563711 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784be02-1b23-4b67-a97a-019e4827c098 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:36.564006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784be02-1b23-4b67-a97a-019e4827c098 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:36.564288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784be02-1b23-4b67-a97a-019e4827c098 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:36.565019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784be02-1b23-4b67-a97a-019e4827c098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:36.567000 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784be02-1b23-4b67-a97a-019e4827c098 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:36.678138 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 900/1822] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:36 2022] POST /identity/v3/projects => generated 370 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:36.682169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72e7dc-01ae-41c8-9c85-c0bbf71f3528 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:36.693366 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72e7dc-01ae-41c8-9c85-c0bbf71f3528 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:36.776187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b09395-556c-481b-89d0-8e8b090d3ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:36.777043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b09395-556c-481b-89d0-8e8b090d3ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:36.777295 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b09395-556c-481b-89d0-8e8b090d3ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:36.777584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b09395-556c-481b-89d0-8e8b090d3ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:36.778535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b09395-556c-481b-89d0-8e8b090d3ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:36.780748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b09395-556c-481b-89d0-8e8b090d3ad2 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:36.921365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 923/1823] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:36 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:36.925223 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784be02-1b23-4b67-a97a-019e4827c098 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:36.935278 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784be02-1b23-4b67-a97a-019e4827c098 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:36.939946 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabe687-d6e5-458f-bbb9-a101108bbe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:36.940605 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabe687-d6e5-458f-bbb9-a101108bbe48 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:36.940890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabe687-d6e5-458f-bbb9-a101108bbe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:36.941172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabe687-d6e5-458f-bbb9-a101108bbe48 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:36.941896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabe687-d6e5-458f-bbb9-a101108bbe48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:36.943568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabe687-d6e5-458f-bbb9-a101108bbe48 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:36.957902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 901/1824] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:36 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:36.959330 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b09395-556c-481b-89d0-8e8b090d3ad2 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:36.972192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b09395-556c-481b-89d0-8e8b090d3ad2 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:36.976833 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c5037-2ab6-45fc-9fd9-be433a326021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:36.977757 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c5037-2ab6-45fc-9fd9-be433a326021 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:36.978037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c5037-2ab6-45fc-9fd9-be433a326021 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:36.978310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c5037-2ab6-45fc-9fd9-be433a326021 admin admin] PATH_INFO: `/v3/projects/089d6c53c098490ca458264f40364f8c/users/07c29455873840259b884dc9554ab97e/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:36.993707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c5037-2ab6-45fc-9fd9-be433a326021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=089d6c53c098490ca458264f40364f8c, user_id=07c29455873840259b884dc9554ab97e, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:36.996501 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c5037-2ab6-45fc-9fd9-be433a326021 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:37.127922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 924/1825] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:36 2022] PUT /identity/v3/projects/089d6c53c098490ca458264f40364f8c/users/07c29455873840259b884dc9554ab97e/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:37.131740 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabe687-d6e5-458f-bbb9-a101108bbe48 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:37.142433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabe687-d6e5-458f-bbb9-a101108bbe48 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:37.198410 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37719b79-9424-4821-91d6-dc1799c3de9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:37.199132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37719b79-9424-4821-91d6-dc1799c3de9e admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:37.199380 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37719b79-9424-4821-91d6-dc1799c3de9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:37.199713 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37719b79-9424-4821-91d6-dc1799c3de9e admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:37.200511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37719b79-9424-4821-91d6-dc1799c3de9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:37.202262 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37719b79-9424-4821-91d6-dc1799c3de9e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:37.213972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 902/1826] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:37 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:37.217784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c5037-2ab6-45fc-9fd9-be433a326021 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:37.228381 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c5037-2ab6-45fc-9fd9-be433a326021 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:37.233292 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf0d26-c8c2-4f39-b74c-a05b31b740e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:37.234249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf0d26-c8c2-4f39-b74c-a05b31b740e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:37.234507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf0d26-c8c2-4f39-b74c-a05b31b740e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:37.235088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf0d26-c8c2-4f39-b74c-a05b31b740e0 admin admin] PATH_INFO: `/v3/projects/089d6c53c098490ca458264f40364f8c/users/07c29455873840259b884dc9554ab97e/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:37.237101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf0d26-c8c2-4f39-b74c-a05b31b740e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=089d6c53c098490ca458264f40364f8c, user_id=07c29455873840259b884dc9554ab97e, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:37.239817 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf0d26-c8c2-4f39-b74c-a05b31b740e0 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:37.247974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:37.253240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 925/1827] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:37 2022] PUT /identity/v3/projects/089d6c53c098490ca458264f40364f8c/users/07c29455873840259b884dc9554ab97e/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:58:37.264192 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2bc41-0cd9-4f73-8b9b-4bdf810f4666 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:37.264699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2bc41-0cd9-4f73-8b9b-4bdf810f4666 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:37.264789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2bc41-0cd9-4f73-8b9b-4bdf810f4666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:37.293142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-81a2bc41-0cd9-4f73-8b9b-4bdf810f4666 None None] MFA Rules not processed for user `07c29455873840259b884dc9554ab97e`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:37.294484 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-81a2bc41-0cd9-4f73-8b9b-4bdf810f4666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:37.364791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 903/1828] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:37.376484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf0d26-c8c2-4f39-b74c-a05b31b740e0 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:37.378415 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-afaf0d26-c8c2-4f39-b74c-a05b31b740e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:37.435321 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf0d26-c8c2-4f39-b74c-a05b31b740e0 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:37.439548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff375b24-8a51-4ee2-a9ad-f993db9a5ab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:37.440191 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff375b24-8a51-4ee2-a9ad-f993db9a5ab9 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:37.440481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff375b24-8a51-4ee2-a9ad-f993db9a5ab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:37.440754 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff375b24-8a51-4ee2-a9ad-f993db9a5ab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:37.449656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff375b24-8a51-4ee2-a9ad-f993db9a5ab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:37.451103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff375b24-8a51-4ee2-a9ad-f993db9a5ab9 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:37.461152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 926/1829] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:37.567498 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2bc41-0cd9-4f73-8b9b-4bdf810f4666 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:37.568887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-81a2bc41-0cd9-4f73-8b9b-4bdf810f4666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:37.581172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2bc41-0cd9-4f73-8b9b-4bdf810f4666 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:37.584797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1245a7-9381-433a-81fc-74b2dc85835b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:37.585447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1245a7-9381-433a-81fc-74b2dc85835b service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:37.585736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1245a7-9381-433a-81fc-74b2dc85835b service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:37.586017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1245a7-9381-433a-81fc-74b2dc85835b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:37.616530 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:37.644501 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1245a7-9381-433a-81fc-74b2dc85835b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:37.646036 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1245a7-9381-433a-81fc-74b2dc85835b service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:37.654952 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 904/1830] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:58:41.044829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff375b24-8a51-4ee2-a9ad-f993db9a5ab9 service cinder] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:41.047095 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ff375b24-8a51-4ee2-a9ad-f993db9a5ab9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:41.122246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff375b24-8a51-4ee2-a9ad-f993db9a5ab9 service cinder] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:41.127475 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246bf6a-8bc0-4d13-a924-60b5d17901ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:41.128351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246bf6a-8bc0-4d13-a924-60b5d17901ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:41.128635 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246bf6a-8bc0-4d13-a924-60b5d17901ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:41.128913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246bf6a-8bc0-4d13-a924-60b5d17901ac admin admin] PATH_INFO: `/v3/users/36fec741cf9241eba3dd92566f945e00` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:41.130093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246bf6a-8bc0-4d13-a924-60b5d17901ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=36fec741cf9241eba3dd92566f945e00)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:41.132064 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246bf6a-8bc0-4d13-a924-60b5d17901ac admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:41.324890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0246bf6a-8bc0-4d13-a924-60b5d17901ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36fec741cf9241eba3dd92566f945e00'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:41.325553 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0246bf6a-8bc0-4d13-a924-60b5d17901ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36fec741cf9241eba3dd92566f945e00'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:41.339850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0246bf6a-8bc0-4d13-a924-60b5d17901ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36fec741cf9241eba3dd92566f945e00'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:41.430093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0246bf6a-8bc0-4d13-a924-60b5d17901ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36fec741cf9241eba3dd92566f945e00'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:41.435828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:41.438250 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0246bf6a-8bc0-4d13-a924-60b5d17901ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36fec741cf9241eba3dd92566f945e00'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:41.445384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 927/1831] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:58:41 2022] DELETE /identity/v3/users/36fec741cf9241eba3dd92566f945e00 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:41.450009 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e81e8d-cf6b-4968-857e-cf47283bcb14 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:41.450635 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e81e8d-cf6b-4968-857e-cf47283bcb14 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:41.450734 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e81e8d-cf6b-4968-857e-cf47283bcb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:41.470285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-85e81e8d-cf6b-4968-857e-cf47283bcb14 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:41.471689 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-85e81e8d-cf6b-4968-857e-cf47283bcb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:41.535434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 905/1832] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:41.545375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246bf6a-8bc0-4d13-a924-60b5d17901ac admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:41.546819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0246bf6a-8bc0-4d13-a924-60b5d17901ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:41.604243 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246bf6a-8bc0-4d13-a924-60b5d17901ac admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:41.607980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1a981-bdfa-4a84-b70a-3766e6208bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:41.608632 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1a981-bdfa-4a84-b70a-3766e6208bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:41.608916 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1a981-bdfa-4a84-b70a-3766e6208bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:41.609192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1a981-bdfa-4a84-b70a-3766e6208bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:41.619505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1a981-bdfa-4a84-b70a-3766e6208bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:41.620925 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1a981-bdfa-4a84-b70a-3766e6208bb3 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:41.634455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 928/1833] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:42.203225 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e81e8d-cf6b-4968-857e-cf47283bcb14 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:42.204675 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-85e81e8d-cf6b-4968-857e-cf47283bcb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:42.222964 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e81e8d-cf6b-4968-857e-cf47283bcb14 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:42.227767 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:42.228683 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:42.228985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:42.229255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602 admin admin] PATH_INFO: `/v3/projects/713002c7471a475c956b7c903bc29103` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:42.230505 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=713002c7471a475c956b7c903bc29103)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:42.232426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:42.352557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713002c7471a475c956b7c903bc29103', 'request_id': 'req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:42.435259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713002c7471a475c956b7c903bc29103', 'request_id': 'req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:42.442355 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713002c7471a475c956b7c903bc29103', 'request_id': 'req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:42.453119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602 admin admin] The token cache is being invalidate because project 713002c7471a475c956b7c903bc29103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:42.454289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:42.454289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:42.456078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 906/1834] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:42 2022] DELETE /identity/v3/projects/713002c7471a475c956b7c903bc29103 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:42.460166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1a981-bdfa-4a84-b70a-3766e6208bb3 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:42.470838 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1a981-bdfa-4a84-b70a-3766e6208bb3 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:42.554977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407edd27-fb2b-4960-9c95-0cabff01f3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:42.556255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407edd27-fb2b-4960-9c95-0cabff01f3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:42.556706 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407edd27-fb2b-4960-9c95-0cabff01f3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:42.557284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407edd27-fb2b-4960-9c95-0cabff01f3ad admin admin] PATH_INFO: `/v3/users/4cdd90cde8324eab996329a7dc93e947` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:42.558853 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407edd27-fb2b-4960-9c95-0cabff01f3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cdd90cde8324eab996329a7dc93e947)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:42.562072 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407edd27-fb2b-4960-9c95-0cabff01f3ad admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:42.623748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:42.623748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:42.637112 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92ba33-4eeb-4c3b-bfd8-8adbc2e1e602 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:42.642953 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c81a18-db8b-424e-b82d-5d416bbc3543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:42.644045 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c81a18-db8b-424e-b82d-5d416bbc3543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:42.644786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c81a18-db8b-424e-b82d-5d416bbc3543 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:42.645163 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c81a18-db8b-424e-b82d-5d416bbc3543 admin admin] PATH_INFO: `/v3/users/eeb05edd89444b4fbecf7af7b4808c8a` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:42.646580 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c81a18-db8b-424e-b82d-5d416bbc3543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb05edd89444b4fbecf7af7b4808c8a)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:42.648749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c81a18-db8b-424e-b82d-5d416bbc3543 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:42.882786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-407edd27-fb2b-4960-9c95-0cabff01f3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cdd90cde8324eab996329a7dc93e947'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:42.883479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-407edd27-fb2b-4960-9c95-0cabff01f3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cdd90cde8324eab996329a7dc93e947'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:42.897404 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-407edd27-fb2b-4960-9c95-0cabff01f3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cdd90cde8324eab996329a7dc93e947'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:42.952322 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f7c81a18-db8b-424e-b82d-5d416bbc3543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb05edd89444b4fbecf7af7b4808c8a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:42.952970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f7c81a18-db8b-424e-b82d-5d416bbc3543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb05edd89444b4fbecf7af7b4808c8a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:42.954076 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f7c81a18-db8b-424e-b82d-5d416bbc3543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb05edd89444b4fbecf7af7b4808c8a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:42.957100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:42.972683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-407edd27-fb2b-4960-9c95-0cabff01f3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cdd90cde8324eab996329a7dc93e947'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:42.984241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-407edd27-fb2b-4960-9c95-0cabff01f3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cdd90cde8324eab996329a7dc93e947'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:42.990788 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 929/1835] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:58:42 2022] DELETE /identity/v3/users/4cdd90cde8324eab996329a7dc93e947 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:43.075672 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f7c81a18-db8b-424e-b82d-5d416bbc3543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb05edd89444b4fbecf7af7b4808c8a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:43.089443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f7c81a18-db8b-424e-b82d-5d416bbc3543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb05edd89444b4fbecf7af7b4808c8a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:43.101924 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 907/1836] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:58:42 2022] DELETE /identity/v3/users/eeb05edd89444b4fbecf7af7b4808c8a => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:43.106442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bee4a5-fa53-47c8-a930-7e7c397d5660 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:43.106736 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bee4a5-fa53-47c8-a930-7e7c397d5660 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:43.107015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bee4a5-fa53-47c8-a930-7e7c397d5660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:43.124537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-38bee4a5-fa53-47c8-a930-7e7c397d5660 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:43.126507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-38bee4a5-fa53-47c8-a930-7e7c397d5660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:43.136540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:43.160804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c81a18-db8b-424e-b82d-5d416bbc3543 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:43.162351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f7c81a18-db8b-424e-b82d-5d416bbc3543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:43.219678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 930/1837] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:43.229323 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bee4a5-fa53-47c8-a930-7e7c397d5660 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:43.233968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-38bee4a5-fa53-47c8-a930-7e7c397d5660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:43.251914 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c81a18-db8b-424e-b82d-5d416bbc3543 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:43.257080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48def3a-b34b-4159-8202-0c30b18cedfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:43.263938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48def3a-b34b-4159-8202-0c30b18cedfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:43.263938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48def3a-b34b-4159-8202-0c30b18cedfa admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:43.263938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48def3a-b34b-4159-8202-0c30b18cedfa admin admin] PATH_INFO: `/v3/users/835a17be57094f5db83095a23f111aa6` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:43.263938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48def3a-b34b-4159-8202-0c30b18cedfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=835a17be57094f5db83095a23f111aa6)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:43.263938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48def3a-b34b-4159-8202-0c30b18cedfa admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:43.305927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bee4a5-fa53-47c8-a930-7e7c397d5660 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:43.309827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42606359-c677-4130-91ae-50c05a10b403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:43.310602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42606359-c677-4130-91ae-50c05a10b403 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:43.310794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42606359-c677-4130-91ae-50c05a10b403 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:43.311073 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42606359-c677-4130-91ae-50c05a10b403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:43.321179 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42606359-c677-4130-91ae-50c05a10b403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:43.322652 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42606359-c677-4130-91ae-50c05a10b403 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:43.333320 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 931/1838] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:58:43.478114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c48def3a-b34b-4159-8202-0c30b18cedfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835a17be57094f5db83095a23f111aa6'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:43.478700 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c48def3a-b34b-4159-8202-0c30b18cedfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835a17be57094f5db83095a23f111aa6'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:43.479395 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c48def3a-b34b-4159-8202-0c30b18cedfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835a17be57094f5db83095a23f111aa6'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:43.506881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42606359-c677-4130-91ae-50c05a10b403 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:43.508502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-42606359-c677-4130-91ae-50c05a10b403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:43.522860 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42606359-c677-4130-91ae-50c05a10b403 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:43.529028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbd216-3be9-419c-928f-a82e8aa02262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:43.530227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbd216-3be9-419c-928f-a82e8aa02262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:43.530616 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbd216-3be9-419c-928f-a82e8aa02262 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:43.530996 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbd216-3be9-419c-928f-a82e8aa02262 admin admin] PATH_INFO: `/v3/projects/829ec561784c4d81ada4b4f32e70c5e6` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:43.532461 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbd216-3be9-419c-928f-a82e8aa02262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=829ec561784c4d81ada4b4f32e70c5e6)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:43.536005 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbd216-3be9-419c-928f-a82e8aa02262 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:43.555906 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c48def3a-b34b-4159-8202-0c30b18cedfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835a17be57094f5db83095a23f111aa6'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:43.572706 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c48def3a-b34b-4159-8202-0c30b18cedfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835a17be57094f5db83095a23f111aa6'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:43.585593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 908/1839] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:58:43 2022] DELETE /identity/v3/users/835a17be57094f5db83095a23f111aa6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:58:43.589938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6f524-46c2-4e51-9a57-db8fedd01a28 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:43.590229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6f524-46c2-4e51-9a57-db8fedd01a28 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:43.590540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6f524-46c2-4e51-9a57-db8fedd01a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:43.608614 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-1fe6f524-46c2-4e51-9a57-db8fedd01a28 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:43.610516 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1fe6f524-46c2-4e51-9a57-db8fedd01a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:43.658466 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:43.679543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-b5fbd216-3be9-419c-928f-a82e8aa02262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829ec561784c4d81ada4b4f32e70c5e6', 'request_id': 'req-b5fbd216-3be9-419c-928f-a82e8aa02262'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:43.679940 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 909/1840] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:58:43.690891 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6f524-46c2-4e51-9a57-db8fedd01a28 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:43.692315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1fe6f524-46c2-4e51-9a57-db8fedd01a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:43.755182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6f524-46c2-4e51-9a57-db8fedd01a28 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:43.807148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-b5fbd216-3be9-419c-928f-a82e8aa02262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829ec561784c4d81ada4b4f32e70c5e6', 'request_id': 'req-b5fbd216-3be9-419c-928f-a82e8aa02262'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:43.815138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-b5fbd216-3be9-419c-928f-a82e8aa02262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829ec561784c4d81ada4b4f32e70c5e6', 'request_id': 'req-b5fbd216-3be9-419c-928f-a82e8aa02262'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:43.824951 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03fa8a-744c-4a0d-8ea1-01627653fc07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:43.825934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03fa8a-744c-4a0d-8ea1-01627653fc07 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:43.826394 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03fa8a-744c-4a0d-8ea1-01627653fc07 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:43.826833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03fa8a-744c-4a0d-8ea1-01627653fc07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:43.834297 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-b5fbd216-3be9-419c-928f-a82e8aa02262 admin admin] The token cache is being invalidate because project 829ec561784c4d81ada4b4f32e70c5e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:43.835052 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-b5fbd216-3be9-419c-928f-a82e8aa02262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:43.835857 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-b5fbd216-3be9-419c-928f-a82e8aa02262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:43.838769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 932/1841] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:43 2022] DELETE /identity/v3/projects/829ec561784c4d81ada4b4f32e70c5e6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:58:43.842150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbd216-3be9-419c-928f-a82e8aa02262 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:43.843791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b5fbd216-3be9-419c-928f-a82e8aa02262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:43.925297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03fa8a-744c-4a0d-8ea1-01627653fc07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:43.926844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03fa8a-744c-4a0d-8ea1-01627653fc07 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:43.937560 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 910/1842] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:58:43.938800 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbd216-3be9-419c-928f-a82e8aa02262 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:43.939876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c7681-cd1b-45dd-b39f-25d7b730dba4 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:43.940174 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c7681-cd1b-45dd-b39f-25d7b730dba4 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:43.940458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c7681-cd1b-45dd-b39f-25d7b730dba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:43.944164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1f67a-5147-42d7-9b1b-4b1a723f9642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:43.945125 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1f67a-5147-42d7-9b1b-4b1a723f9642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:43.946044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1f67a-5147-42d7-9b1b-4b1a723f9642 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:43.946350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1f67a-5147-42d7-9b1b-4b1a723f9642 admin admin] PATH_INFO: `/v3/projects/8338fe05934e45bc9ad554462dbd9b2c` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:43.949127 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1f67a-5147-42d7-9b1b-4b1a723f9642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8338fe05934e45bc9ad554462dbd9b2c)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:43.951116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1f67a-5147-42d7-9b1b-4b1a723f9642 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:43.959057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-d59c7681-cd1b-45dd-b39f-25d7b730dba4 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:43.961576 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d59c7681-cd1b-45dd-b39f-25d7b730dba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:43.974471 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 911/1843] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:43.982272 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b98690-26b7-4830-b24b-7376a00b6fd2 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:43.982596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b98690-26b7-4830-b24b-7376a00b6fd2 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:43.982882 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b98690-26b7-4830-b24b-7376a00b6fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:44.014805 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-69b98690-26b7-4830-b24b-7376a00b6fd2 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:44.017446 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-69b98690-26b7-4830-b24b-7376a00b6fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:44.026650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 912/1844] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:44.031172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b98690-26b7-4830-b24b-7376a00b6fd2 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:44.042082 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b98690-26b7-4830-b24b-7376a00b6fd2 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:44.047432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8d723-4e92-4ce9-9d1a-a3edaea491be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:44.048156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8d723-4e92-4ce9-9d1a-a3edaea491be admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:44.048443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8d723-4e92-4ce9-9d1a-a3edaea491be admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:44.048725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8d723-4e92-4ce9-9d1a-a3edaea491be admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:44.049592 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8d723-4e92-4ce9-9d1a-a3edaea491be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:58:44.049914 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8d723-4e92-4ce9-9d1a-a3edaea491be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:44.051610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8d723-4e92-4ce9-9d1a-a3edaea491be admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:44.067047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 913/1845] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:58:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:58:44.071246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8d723-4e92-4ce9-9d1a-a3edaea491be admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:44.081635 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8d723-4e92-4ce9-9d1a-a3edaea491be admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:44.086565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e1031-ef91-4a45-9451-f41ba27cabdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:44.087228 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e1031-ef91-4a45-9451-f41ba27cabdf admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:44.087519 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e1031-ef91-4a45-9451-f41ba27cabdf admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:44.087803 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e1031-ef91-4a45-9451-f41ba27cabdf admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:44.088509 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e1031-ef91-4a45-9451-f41ba27cabdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:44.090453 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e1031-ef91-4a45-9451-f41ba27cabdf admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:44.109155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-acc1f67a-5147-42d7-9b1b-4b1a723f9642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8338fe05934e45bc9ad554462dbd9b2c', 'request_id': 'req-acc1f67a-5147-42d7-9b1b-4b1a723f9642'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:44.199693 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-acc1f67a-5147-42d7-9b1b-4b1a723f9642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8338fe05934e45bc9ad554462dbd9b2c', 'request_id': 'req-acc1f67a-5147-42d7-9b1b-4b1a723f9642'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:44.203625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 914/1846] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:44 2022] POST /identity/v3/projects => generated 386 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:44.204420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-acc1f67a-5147-42d7-9b1b-4b1a723f9642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8338fe05934e45bc9ad554462dbd9b2c', 'request_id': 'req-acc1f67a-5147-42d7-9b1b-4b1a723f9642'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:44.208597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e1031-ef91-4a45-9451-f41ba27cabdf admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:44.217639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-acc1f67a-5147-42d7-9b1b-4b1a723f9642 admin admin] The token cache is being invalidate because project 8338fe05934e45bc9ad554462dbd9b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:44.218180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-acc1f67a-5147-42d7-9b1b-4b1a723f9642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:44.219857 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:44.220937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-acc1f67a-5147-42d7-9b1b-4b1a723f9642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:44.222653 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 933/1847] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:43 2022] DELETE /identity/v3/projects/8338fe05934e45bc9ad554462dbd9b2c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:44.226823 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1f67a-5147-42d7-9b1b-4b1a723f9642 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:44.228428 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-acc1f67a-5147-42d7-9b1b-4b1a723f9642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:44.289283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e1031-ef91-4a45-9451-f41ba27cabdf admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:44.294153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56ce51-429b-4b79-8d8e-353375760908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:44.294866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56ce51-429b-4b79-8d8e-353375760908 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:44.295156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56ce51-429b-4b79-8d8e-353375760908 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:44.295436 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56ce51-429b-4b79-8d8e-353375760908 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:44.296132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56ce51-429b-4b79-8d8e-353375760908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:44.300377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56ce51-429b-4b79-8d8e-353375760908 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:44.307821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1f67a-5147-42d7-9b1b-4b1a723f9642 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:44.313859 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1bed1-33cc-43fe-9f17-e928bc71bac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:44.315151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1bed1-33cc-43fe-9f17-e928bc71bac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:44.315445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1bed1-33cc-43fe-9f17-e928bc71bac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:44.315725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1bed1-33cc-43fe-9f17-e928bc71bac0 admin admin] PATH_INFO: `/v3/users/58627ff511b64001aa0d5ddede850285` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:44.317028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1bed1-33cc-43fe-9f17-e928bc71bac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58627ff511b64001aa0d5ddede850285)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:44.320200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1bed1-33cc-43fe-9f17-e928bc71bac0 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:44.419844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 915/1848] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:44 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:58:44.424502 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56ce51-429b-4b79-8d8e-353375760908 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:44.426335 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2d56ce51-429b-4b79-8d8e-353375760908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:44.442776 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56ce51-429b-4b79-8d8e-353375760908 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:44.447833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44513942-8619-46d6-8da1-608563aee3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:44.448519 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44513942-8619-46d6-8da1-608563aee3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:44.448808 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44513942-8619-46d6-8da1-608563aee3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:44.449091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44513942-8619-46d6-8da1-608563aee3c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:44.449811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44513942-8619-46d6-8da1-608563aee3c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:44.451551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44513942-8619-46d6-8da1-608563aee3c5 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:44.465249 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 916/1849] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:44 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:58:44.466415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44513942-8619-46d6-8da1-608563aee3c5 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:44.476596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44513942-8619-46d6-8da1-608563aee3c5 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:44.481338 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8cd98-6e5c-4cd6-ad2b-fb41b93bf543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:44.482004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8cd98-6e5c-4cd6-ad2b-fb41b93bf543 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:44.482290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8cd98-6e5c-4cd6-ad2b-fb41b93bf543 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:44.482747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8cd98-6e5c-4cd6-ad2b-fb41b93bf543 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:44.483478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8cd98-6e5c-4cd6-ad2b-fb41b93bf543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:44.485772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8cd98-6e5c-4cd6-ad2b-fb41b93bf543 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:44.496721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 917/1850] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:44 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:58:44.501425 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8cd98-6e5c-4cd6-ad2b-fb41b93bf543 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:44.511399 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8cd98-6e5c-4cd6-ad2b-fb41b93bf543 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:44.516150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3d338-7343-4d7a-b546-2752b8f2bec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:44.517014 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3d338-7343-4d7a-b546-2752b8f2bec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:44.517303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3d338-7343-4d7a-b546-2752b8f2bec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:44.517583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3d338-7343-4d7a-b546-2752b8f2bec5 admin admin] PATH_INFO: `/v3/projects/b7a78ffcba1b49248f21f25f497caff7/users/524cc9fc501448f793458553b443c4a5/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:44.532953 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3d338-7343-4d7a-b546-2752b8f2bec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a78ffcba1b49248f21f25f497caff7, user_id=524cc9fc501448f793458553b443c4a5, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:44.535668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3d338-7343-4d7a-b546-2752b8f2bec5 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:44.554481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9ee1bed1-33cc-43fe-9f17-e928bc71bac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58627ff511b64001aa0d5ddede850285'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:44.555502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9ee1bed1-33cc-43fe-9f17-e928bc71bac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58627ff511b64001aa0d5ddede850285'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:44.567953 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9ee1bed1-33cc-43fe-9f17-e928bc71bac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58627ff511b64001aa0d5ddede850285'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:44.624383 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 918/1851] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:44 2022] PUT /identity/v3/projects/b7a78ffcba1b49248f21f25f497caff7/users/524cc9fc501448f793458553b443c4a5/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:58:44.625277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3d338-7343-4d7a-b546-2752b8f2bec5 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:44.627286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7ef3d338-7343-4d7a-b546-2752b8f2bec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:44.652956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9ee1bed1-33cc-43fe-9f17-e928bc71bac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58627ff511b64001aa0d5ddede850285'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:44.661093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9ee1bed1-33cc-43fe-9f17-e928bc71bac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58627ff511b64001aa0d5ddede850285'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:44.667257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 934/1852] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:58:44 2022] DELETE /identity/v3/users/58627ff511b64001aa0d5ddede850285 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:44.668556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef976289-4556-4612-af97-507c6d7cfd6d None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:44.668846 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef976289-4556-4612-af97-507c6d7cfd6d None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:44.669121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef976289-4556-4612-af97-507c6d7cfd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:44.698512 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-ef976289-4556-4612-af97-507c6d7cfd6d None None] MFA Rules not processed for user `524cc9fc501448f793458553b443c4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:44.698866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3d338-7343-4d7a-b546-2752b8f2bec5 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:44.700285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ef976289-4556-4612-af97-507c6d7cfd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:44.765984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec58b12-d28f-434d-9d8d-77296aba7e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:44.766842 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec58b12-d28f-434d-9d8d-77296aba7e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:44.767266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec58b12-d28f-434d-9d8d-77296aba7e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:44.767557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec58b12-d28f-434d-9d8d-77296aba7e4b admin admin] PATH_INFO: `/v3/projects/7a612e7bb9b247e99843185c9d96eeed` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:44.768782 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec58b12-d28f-434d-9d8d-77296aba7e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a612e7bb9b247e99843185c9d96eeed)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:44.770936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec58b12-d28f-434d-9d8d-77296aba7e4b admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:44.771880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 935/1853] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:44.776405 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef976289-4556-4612-af97-507c6d7cfd6d None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:44.777778 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ef976289-4556-4612-af97-507c6d7cfd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:44.792149 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef976289-4556-4612-af97-507c6d7cfd6d None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:44.797983 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124d50a-d8bd-4432-bb1e-ad6057e0ad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:44.798708 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124d50a-d8bd-4432-bb1e-ad6057e0ad19 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:44.798909 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124d50a-d8bd-4432-bb1e-ad6057e0ad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:44.799193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124d50a-d8bd-4432-bb1e-ad6057e0ad19 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:44.799913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124d50a-d8bd-4432-bb1e-ad6057e0ad19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:44.801903 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124d50a-d8bd-4432-bb1e-ad6057e0ad19 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:44.946899 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0ec58b12-d28f-434d-9d8d-77296aba7e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a612e7bb9b247e99843185c9d96eeed', 'request_id': 'req-0ec58b12-d28f-434d-9d8d-77296aba7e4b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:44.984181 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 936/1854] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:44 2022] POST /identity/v3/projects => generated 386 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:58:44.988268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124d50a-d8bd-4432-bb1e-ad6057e0ad19 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:45.030209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0ec58b12-d28f-434d-9d8d-77296aba7e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a612e7bb9b247e99843185c9d96eeed', 'request_id': 'req-0ec58b12-d28f-434d-9d8d-77296aba7e4b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:45.038621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0ec58b12-d28f-434d-9d8d-77296aba7e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a612e7bb9b247e99843185c9d96eeed', 'request_id': 'req-0ec58b12-d28f-434d-9d8d-77296aba7e4b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:45.056355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124d50a-d8bd-4432-bb1e-ad6057e0ad19 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:45.073785 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0ec58b12-d28f-434d-9d8d-77296aba7e4b admin admin] The token cache is being invalidate because project 7a612e7bb9b247e99843185c9d96eeed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:45.074260 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0ec58b12-d28f-434d-9d8d-77296aba7e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:45.079473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0ec58b12-d28f-434d-9d8d-77296aba7e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:45.083088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 919/1855] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:44 2022] DELETE /identity/v3/projects/7a612e7bb9b247e99843185c9d96eeed => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:45.083995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec58b12-d28f-434d-9d8d-77296aba7e4b admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:45.084258 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134faad0-5a27-469b-ae9f-002b849c50c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:45.084956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134faad0-5a27-469b-ae9f-002b849c50c1 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:45.085243 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134faad0-5a27-469b-ae9f-002b849c50c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:45.085524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134faad0-5a27-469b-ae9f-002b849c50c1 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:45.086221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134faad0-5a27-469b-ae9f-002b849c50c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:45.087432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0ec58b12-d28f-434d-9d8d-77296aba7e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:45.088579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134faad0-5a27-469b-ae9f-002b849c50c1 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:45.164501 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec58b12-d28f-434d-9d8d-77296aba7e4b admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:45.169236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cd46e-9e57-45bb-9201-821abdb718ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:45.170126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cd46e-9e57-45bb-9201-821abdb718ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:45.170440 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cd46e-9e57-45bb-9201-821abdb718ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:45.170722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cd46e-9e57-45bb-9201-821abdb718ec admin admin] PATH_INFO: `/v3/users/07c29455873840259b884dc9554ab97e` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:45.171955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cd46e-9e57-45bb-9201-821abdb718ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c29455873840259b884dc9554ab97e)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:45.174923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cd46e-9e57-45bb-9201-821abdb718ec admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:45.215420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 937/1856] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:44 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:45.218381 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134faad0-5a27-469b-ae9f-002b849c50c1 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:45.220202 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-134faad0-5a27-469b-ae9f-002b849c50c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:45.236344 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134faad0-5a27-469b-ae9f-002b849c50c1 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:45.239112 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:45.260800 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66c3c5-38e5-4c9a-bfa0-69f9a3791266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:45.261842 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c3c5-38e5-4c9a-bfa0-69f9a3791266 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:45.262136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c3c5-38e5-4c9a-bfa0-69f9a3791266 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:45.262614 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c3c5-38e5-4c9a-bfa0-69f9a3791266 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:45.263689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66c3c5-38e5-4c9a-bfa0-69f9a3791266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:45.265330 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66c3c5-38e5-4c9a-bfa0-69f9a3791266 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:45.277711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 938/1857] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:45 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:58:45.278497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66c3c5-38e5-4c9a-bfa0-69f9a3791266 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:45.280529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-2d66c3c5-38e5-4c9a-bfa0-69f9a3791266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:45.293977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66c3c5-38e5-4c9a-bfa0-69f9a3791266 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:45.299628 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dd8f5-2907-433e-9b79-4683aeaf1b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:45.300498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dd8f5-2907-433e-9b79-4683aeaf1b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:45.300786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dd8f5-2907-433e-9b79-4683aeaf1b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:45.301069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dd8f5-2907-433e-9b79-4683aeaf1b74 admin admin] PATH_INFO: `/v3/projects/439e76036bb64e539a12f40608c576e6` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:45.302260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dd8f5-2907-433e-9b79-4683aeaf1b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=439e76036bb64e539a12f40608c576e6)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:45.304247 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dd8f5-2907-433e-9b79-4683aeaf1b74 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:45.397424 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-bb3cd46e-9e57-45bb-9201-821abdb718ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c29455873840259b884dc9554ab97e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:45.398079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-bb3cd46e-9e57-45bb-9201-821abdb718ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c29455873840259b884dc9554ab97e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:45.398704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-bb3cd46e-9e57-45bb-9201-821abdb718ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c29455873840259b884dc9554ab97e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:45.436785 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-284dd8f5-2907-433e-9b79-4683aeaf1b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '439e76036bb64e539a12f40608c576e6', 'request_id': 'req-284dd8f5-2907-433e-9b79-4683aeaf1b74'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:45.504267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-bb3cd46e-9e57-45bb-9201-821abdb718ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c29455873840259b884dc9554ab97e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:45.518815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-bb3cd46e-9e57-45bb-9201-821abdb718ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c29455873840259b884dc9554ab97e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:45.538867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 920/1858] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:58:45 2022] DELETE /identity/v3/users/07c29455873840259b884dc9554ab97e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:45.539625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cd46e-9e57-45bb-9201-821abdb718ec admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:45.540948 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-bb3cd46e-9e57-45bb-9201-821abdb718ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:45.555744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-284dd8f5-2907-433e-9b79-4683aeaf1b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '439e76036bb64e539a12f40608c576e6', 'request_id': 'req-284dd8f5-2907-433e-9b79-4683aeaf1b74'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:45.565927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-284dd8f5-2907-433e-9b79-4683aeaf1b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '439e76036bb64e539a12f40608c576e6', 'request_id': 'req-284dd8f5-2907-433e-9b79-4683aeaf1b74'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:45.579525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-284dd8f5-2907-433e-9b79-4683aeaf1b74 admin admin] The token cache is being invalidate because project 439e76036bb64e539a12f40608c576e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:45.579966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-284dd8f5-2907-433e-9b79-4683aeaf1b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:45.581617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-284dd8f5-2907-433e-9b79-4683aeaf1b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:45.583525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 939/1859] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:45 2022] DELETE /identity/v3/projects/439e76036bb64e539a12f40608c576e6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:45.588249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dd8f5-2907-433e-9b79-4683aeaf1b74 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:45.590650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-284dd8f5-2907-433e-9b79-4683aeaf1b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:45.623365 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cd46e-9e57-45bb-9201-821abdb718ec admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:45.628942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf2459-811e-47aa-a64d-1bacb9e7ba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:45.630043 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf2459-811e-47aa-a64d-1bacb9e7ba67 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:45.630043 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf2459-811e-47aa-a64d-1bacb9e7ba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:45.630241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf2459-811e-47aa-a64d-1bacb9e7ba67 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:45.631048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf2459-811e-47aa-a64d-1bacb9e7ba67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:45.632884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf2459-811e-47aa-a64d-1bacb9e7ba67 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:45.645393 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 921/1860] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:45 2022] GET /identity/v3/roles => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:45.649966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf2459-811e-47aa-a64d-1bacb9e7ba67 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:45.651812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-72bf2459-811e-47aa-a64d-1bacb9e7ba67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:45.681253 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf2459-811e-47aa-a64d-1bacb9e7ba67 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:45.682740 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dd8f5-2907-433e-9b79-4683aeaf1b74 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:45.684743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4ef30-5e86-46ea-ba0f-9e19af5a9739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:45.685720 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4ef30-5e86-46ea-ba0f-9e19af5a9739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:45.685989 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7414fa9-15b3-4a1d-a6fa-16eb876d3dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:45.686099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4ef30-5e86-46ea-ba0f-9e19af5a9739 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:45.686273 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4ef30-5e86-46ea-ba0f-9e19af5a9739 admin admin] PATH_INFO: `/v3/users/16729ddc9bb94c31ae22c992faba650e` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:45.686960 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7414fa9-15b3-4a1d-a6fa-16eb876d3dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:45.687251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7414fa9-15b3-4a1d-a6fa-16eb876d3dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:45.687509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4ef30-5e86-46ea-ba0f-9e19af5a9739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16729ddc9bb94c31ae22c992faba650e)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:45.687607 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7414fa9-15b3-4a1d-a6fa-16eb876d3dcd admin admin] PATH_INFO: `/v3/projects/7c1e33558c274c4bb2cb86a575306a06/users/4d290b0437bb49a3ae89e52ff55be7d3/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:45.690115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4ef30-5e86-46ea-ba0f-9e19af5a9739 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:45.703034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7414fa9-15b3-4a1d-a6fa-16eb876d3dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1e33558c274c4bb2cb86a575306a06, user_id=4d290b0437bb49a3ae89e52ff55be7d3, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:45.706657 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7414fa9-15b3-4a1d-a6fa-16eb876d3dcd admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:45.848631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 922/1861] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:45 2022] PUT /identity/v3/projects/7c1e33558c274c4bb2cb86a575306a06/users/4d290b0437bb49a3ae89e52ff55be7d3/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:58:45.860920 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:45.862380 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248982fb-0f5e-4346-8d15-f29feea49e01 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:45.862699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248982fb-0f5e-4346-8d15-f29feea49e01 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:45.862978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248982fb-0f5e-4346-8d15-f29feea49e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:45.891388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-248982fb-0f5e-4346-8d15-f29feea49e01 None None] MFA Rules not processed for user `4d290b0437bb49a3ae89e52ff55be7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:45.892632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-248982fb-0f5e-4346-8d15-f29feea49e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:45.960139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 923/1862] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:58:45.964510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248982fb-0f5e-4346-8d15-f29feea49e01 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:45.993476 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-1af4ef30-5e86-46ea-ba0f-9e19af5a9739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16729ddc9bb94c31ae22c992faba650e'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:45.994212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-1af4ef30-5e86-46ea-ba0f-9e19af5a9739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16729ddc9bb94c31ae22c992faba650e'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:46.008870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-1af4ef30-5e86-46ea-ba0f-9e19af5a9739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16729ddc9bb94c31ae22c992faba650e'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:46.033237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248982fb-0f5e-4346-8d15-f29feea49e01 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:46.037864 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7d466-fbec-4fa1-b870-887644fec813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:46.038569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7d466-fbec-4fa1-b870-887644fec813 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:46.038855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7d466-fbec-4fa1-b870-887644fec813 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:46.039177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7d466-fbec-4fa1-b870-887644fec813 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:46.040219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7d466-fbec-4fa1-b870-887644fec813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:46.042064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7d466-fbec-4fa1-b870-887644fec813 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:46.086881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-1af4ef30-5e86-46ea-ba0f-9e19af5a9739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16729ddc9bb94c31ae22c992faba650e'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:46.094998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-1af4ef30-5e86-46ea-ba0f-9e19af5a9739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16729ddc9bb94c31ae22c992faba650e'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:46.101341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 940/1863] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:58:45 2022] DELETE /identity/v3/users/16729ddc9bb94c31ae22c992faba650e => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:46.102353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4ef30-5e86-46ea-ba0f-9e19af5a9739 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:46.103334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1af4ef30-5e86-46ea-ba0f-9e19af5a9739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:46.110657 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:46.155019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 924/1864] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:45 2022] POST /identity/v3/projects => generated 386 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:58:46.158837 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7d466-fbec-4fa1-b870-887644fec813 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:46.160595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1fa7d466-fbec-4fa1-b870-887644fec813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:46.176574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4ef30-5e86-46ea-ba0f-9e19af5a9739 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:46.233415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7d466-fbec-4fa1-b870-887644fec813 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:46.241859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113083b-62bd-4299-bdc7-04250070dbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:46.243033 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113083b-62bd-4299-bdc7-04250070dbbb admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:46.243191 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cf8f9-ae15-4a9d-9165-da16bd0f7c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:46.243534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113083b-62bd-4299-bdc7-04250070dbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:46.244273 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113083b-62bd-4299-bdc7-04250070dbbb admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:46.244459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cf8f9-ae15-4a9d-9165-da16bd0f7c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:46.244459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cf8f9-ae15-4a9d-9165-da16bd0f7c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:46.244849 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cf8f9-ae15-4a9d-9165-da16bd0f7c1b admin admin] PATH_INFO: `/v3/projects/089d6c53c098490ca458264f40364f8c` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:46.245430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113083b-62bd-4299-bdc7-04250070dbbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:46.246633 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cf8f9-ae15-4a9d-9165-da16bd0f7c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=089d6c53c098490ca458264f40364f8c)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:46.248713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cf8f9-ae15-4a9d-9165-da16bd0f7c1b admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:46.249363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113083b-62bd-4299-bdc7-04250070dbbb admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:46.331384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 925/1865] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:46 2022] POST /identity/v3/users => generated 300 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:46.332581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113083b-62bd-4299-bdc7-04250070dbbb admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:46.342681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113083b-62bd-4299-bdc7-04250070dbbb admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:46.347933 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1646576-8814-4d9a-b185-5db5226816ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:46.348742 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1646576-8814-4d9a-b185-5db5226816ac admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:46.349326 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1646576-8814-4d9a-b185-5db5226816ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:46.349750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1646576-8814-4d9a-b185-5db5226816ac admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:46.351758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1646576-8814-4d9a-b185-5db5226816ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:46.353532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1646576-8814-4d9a-b185-5db5226816ac admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:46.366050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 926/1866] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:46 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:46.369924 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1646576-8814-4d9a-b185-5db5226816ac admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:46.381697 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1646576-8814-4d9a-b185-5db5226816ac admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:46.382994 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f07cf8f9-ae15-4a9d-9165-da16bd0f7c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '089d6c53c098490ca458264f40364f8c', 'request_id': 'req-f07cf8f9-ae15-4a9d-9165-da16bd0f7c1b'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:46.445552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddfa5a-c855-4ab7-9745-93de1654c8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:46.446512 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddfa5a-c855-4ab7-9745-93de1654c8bd admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:46.446798 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddfa5a-c855-4ab7-9745-93de1654c8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:46.447078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddfa5a-c855-4ab7-9745-93de1654c8bd admin admin] PATH_INFO: `/v3/projects/f95b8cd6d7b8494cb731ba67420daaf9/users/775ff6c6a47c4ca2b5bad6ea0b9535c8/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:46.462446 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddfa5a-c855-4ab7-9745-93de1654c8bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95b8cd6d7b8494cb731ba67420daaf9, user_id=775ff6c6a47c4ca2b5bad6ea0b9535c8, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:46.464352 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f07cf8f9-ae15-4a9d-9165-da16bd0f7c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '089d6c53c098490ca458264f40364f8c', 'request_id': 'req-f07cf8f9-ae15-4a9d-9165-da16bd0f7c1b'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:46.465224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddfa5a-c855-4ab7-9745-93de1654c8bd admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:46.474021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f07cf8f9-ae15-4a9d-9165-da16bd0f7c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '089d6c53c098490ca458264f40364f8c', 'request_id': 'req-f07cf8f9-ae15-4a9d-9165-da16bd0f7c1b'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:46.485109 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f07cf8f9-ae15-4a9d-9165-da16bd0f7c1b admin admin] The token cache is being invalidate because project 089d6c53c098490ca458264f40364f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:46.485458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f07cf8f9-ae15-4a9d-9165-da16bd0f7c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:46.486154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f07cf8f9-ae15-4a9d-9165-da16bd0f7c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:46.487974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 941/1867] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:46 2022] DELETE /identity/v3/projects/089d6c53c098490ca458264f40364f8c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:46.492552 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1e83a-69e7-4d3c-83f3-f8d655885793 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:46.492847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1e83a-69e7-4d3c-83f3-f8d655885793 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:46.493132 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1e83a-69e7-4d3c-83f3-f8d655885793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:46.527002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-b5f1e83a-69e7-4d3c-83f3-f8d655885793 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:46.527002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b5f1e83a-69e7-4d3c-83f3-f8d655885793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:46.535646 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 942/1868] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:46.544016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271fa4-16cf-49d4-a953-5895e78de95e None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:46.544233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271fa4-16cf-49d4-a953-5895e78de95e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:46.544536 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271fa4-16cf-49d4-a953-5895e78de95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:46.559822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 927/1869] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:46 2022] PUT /identity/v3/projects/f95b8cd6d7b8494cb731ba67420daaf9/users/775ff6c6a47c4ca2b5bad6ea0b9535c8/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:46.560872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddfa5a-c855-4ab7-9745-93de1654c8bd admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:46.563361 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-14ddfa5a-c855-4ab7-9745-93de1654c8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:46.570693 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-9d271fa4-16cf-49d4-a953-5895e78de95e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:46.572216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-9d271fa4-16cf-49d4-a953-5895e78de95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:46.640304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:46.642582 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 943/1870] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:46.645720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddfa5a-c855-4ab7-9745-93de1654c8bd admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:46.646807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271fa4-16cf-49d4-a953-5895e78de95e None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:46.650743 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f063f6-01dd-40f4-b68d-4e949d4e75c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:46.651428 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f063f6-01dd-40f4-b68d-4e949d4e75c9 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:46.651716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f063f6-01dd-40f4-b68d-4e949d4e75c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:46.652682 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f063f6-01dd-40f4-b68d-4e949d4e75c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:46.653821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f063f6-01dd-40f4-b68d-4e949d4e75c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:46.655860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f063f6-01dd-40f4-b68d-4e949d4e75c9 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:46.658094 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271fa4-16cf-49d4-a953-5895e78de95e None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:46.663958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1af64-15df-48da-ade4-c65940b57ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:46.664631 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1af64-15df-48da-ade4-c65940b57ecd admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:46.664932 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1af64-15df-48da-ade4-c65940b57ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:46.665214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1af64-15df-48da-ade4-c65940b57ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:46.665943 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1af64-15df-48da-ade4-c65940b57ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:58:46.666260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1af64-15df-48da-ade4-c65940b57ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:46.667903 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1af64-15df-48da-ade4-c65940b57ecd admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:46.668434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 928/1871] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:46 2022] GET /identity/v3/roles => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:58:46.673846 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:46.678418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f063f6-01dd-40f4-b68d-4e949d4e75c9 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:46.686500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 944/1872] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:58:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:58:46.688539 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1af64-15df-48da-ade4-c65940b57ecd admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:46.688667 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f063f6-01dd-40f4-b68d-4e949d4e75c9 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:46.693813 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5effd-d51f-483e-8269-bca6eff24fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:46.694746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5effd-d51f-483e-8269-bca6eff24fff admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:46.695032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5effd-d51f-483e-8269-bca6eff24fff admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:46.695316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5effd-d51f-483e-8269-bca6eff24fff admin admin] PATH_INFO: `/v3/projects/f95b8cd6d7b8494cb731ba67420daaf9/users/775ff6c6a47c4ca2b5bad6ea0b9535c8/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:46.697516 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5effd-d51f-483e-8269-bca6eff24fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95b8cd6d7b8494cb731ba67420daaf9, user_id=775ff6c6a47c4ca2b5bad6ea0b9535c8, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:46.698823 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1af64-15df-48da-ade4-c65940b57ecd admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:46.700663 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5effd-d51f-483e-8269-bca6eff24fff admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:46.704541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973135af-ffac-4b66-b2bd-53e7a899cd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:46.704900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973135af-ffac-4b66-b2bd-53e7a899cd67 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:46.705288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973135af-ffac-4b66-b2bd-53e7a899cd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:46.705572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973135af-ffac-4b66-b2bd-53e7a899cd67 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:46.706563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973135af-ffac-4b66-b2bd-53e7a899cd67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:46.708471 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973135af-ffac-4b66-b2bd-53e7a899cd67 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:46.713272 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 929/1873] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:46 2022] PUT /identity/v3/projects/f95b8cd6d7b8494cb731ba67420daaf9/users/775ff6c6a47c4ca2b5bad6ea0b9535c8/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:58:46.724098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006173b5-804f-4e23-b137-3d1e98cfc42c None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:46.724324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006173b5-804f-4e23-b137-3d1e98cfc42c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:46.724875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006173b5-804f-4e23-b137-3d1e98cfc42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:46.754286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-006173b5-804f-4e23-b137-3d1e98cfc42c None None] MFA Rules not processed for user `775ff6c6a47c4ca2b5bad6ea0b9535c8`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:46.755533 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-006173b5-804f-4e23-b137-3d1e98cfc42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:46.830011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 945/1874] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:46 2022] POST /identity/v3/projects => generated 368 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:58:46.832112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973135af-ffac-4b66-b2bd-53e7a899cd67 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:46.835381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 930/1875] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:58:46.841339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006173b5-804f-4e23-b137-3d1e98cfc42c None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:46.844887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-973135af-ffac-4b66-b2bd-53e7a899cd67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:46.918727 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006173b5-804f-4e23-b137-3d1e98cfc42c None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:46.954492 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973135af-ffac-4b66-b2bd-53e7a899cd67 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:46.962104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47916743-6cba-4965-bb22-158cc4624543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:46.963110 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47916743-6cba-4965-bb22-158cc4624543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:46.963401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47916743-6cba-4965-bb22-158cc4624543 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:46.963682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47916743-6cba-4965-bb22-158cc4624543 admin admin] PATH_INFO: `/v3/projects/5a9356b847ba426ea5dcd9dad62dc7d3` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:46.964988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47916743-6cba-4965-bb22-158cc4624543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9356b847ba426ea5dcd9dad62dc7d3)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:46.968053 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47916743-6cba-4965-bb22-158cc4624543 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:46.990562 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855b7c4-8bd0-4a78-a6cf-d3a3d839b178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:46.991362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855b7c4-8bd0-4a78-a6cf-d3a3d839b178 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:46.991705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855b7c4-8bd0-4a78-a6cf-d3a3d839b178 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:46.992037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855b7c4-8bd0-4a78-a6cf-d3a3d839b178 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:46.992987 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855b7c4-8bd0-4a78-a6cf-d3a3d839b178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:46.995831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855b7c4-8bd0-4a78-a6cf-d3a3d839b178 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:47.122376 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 931/1876] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:46 2022] POST /identity/v3/users => generated 285 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:47.124023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855b7c4-8bd0-4a78-a6cf-d3a3d839b178 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:47.127327 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5855b7c4-8bd0-4a78-a6cf-d3a3d839b178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:47.145163 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-47916743-6cba-4965-bb22-158cc4624543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9356b847ba426ea5dcd9dad62dc7d3', 'request_id': 'req-47916743-6cba-4965-bb22-158cc4624543'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:47.199296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855b7c4-8bd0-4a78-a6cf-d3a3d839b178 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:47.251798 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7fa8c-cec5-4aba-b128-088acf24e25a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:47.252515 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7fa8c-cec5-4aba-b128-088acf24e25a service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:47.252808 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7fa8c-cec5-4aba-b128-088acf24e25a service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:47.253088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7fa8c-cec5-4aba-b128-088acf24e25a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:47.253736 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-47916743-6cba-4965-bb22-158cc4624543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9356b847ba426ea5dcd9dad62dc7d3', 'request_id': 'req-47916743-6cba-4965-bb22-158cc4624543'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:47.255046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-6ac7fa8c-cec5-4aba-b128-088acf24e25a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:47.261565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-47916743-6cba-4965-bb22-158cc4624543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9356b847ba426ea5dcd9dad62dc7d3', 'request_id': 'req-47916743-6cba-4965-bb22-158cc4624543'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:47.274359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-47916743-6cba-4965-bb22-158cc4624543 admin admin] The token cache is being invalidate because project 5a9356b847ba426ea5dcd9dad62dc7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:47.275002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-47916743-6cba-4965-bb22-158cc4624543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:47.276013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-47916743-6cba-4965-bb22-158cc4624543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:47.277888 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 946/1877] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:58:46 2022] DELETE /identity/v3/projects/5a9356b847ba426ea5dcd9dad62dc7d3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:47.284418 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47916743-6cba-4965-bb22-158cc4624543 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:47.286941 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-47916743-6cba-4965-bb22-158cc4624543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:47.360232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7fa8c-cec5-4aba-b128-088acf24e25a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:47.362461 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7fa8c-cec5-4aba-b128-088acf24e25a service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:47.376593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 932/1878] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:47.378249 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612f544-beb6-40e8-ac2f-28406b3862ce None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:47.378761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612f544-beb6-40e8-ac2f-28406b3862ce None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:47.379264 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612f544-beb6-40e8-ac2f-28406b3862ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:47.402859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-d612f544-beb6-40e8-ac2f-28406b3862ce None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:47.404165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d612f544-beb6-40e8-ac2f-28406b3862ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:47.413924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47916743-6cba-4965-bb22-158cc4624543 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:47.415057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 933/1879] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:47.424758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321333bf-249e-43d9-92cd-385997f30f58 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:47.425140 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321333bf-249e-43d9-92cd-385997f30f58 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:47.425548 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321333bf-249e-43d9-92cd-385997f30f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:47.431582 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0026fc-4763-4673-add8-855778219415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:47.432274 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0026fc-4763-4673-add8-855778219415 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:47.432557 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0026fc-4763-4673-add8-855778219415 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:47.432832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0026fc-4763-4673-add8-855778219415 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:47.435099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0026fc-4763-4673-add8-855778219415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:47.436856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0026fc-4763-4673-add8-855778219415 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:47.459010 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-321333bf-249e-43d9-92cd-385997f30f58 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:47.460821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-321333bf-249e-43d9-92cd-385997f30f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:47.474512 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 934/1880] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:47.475765 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321333bf-249e-43d9-92cd-385997f30f58 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:47.487513 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 947/1881] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:47 2022] GET /identity/v3/roles => generated 1427 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:47.490170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0026fc-4763-4673-add8-855778219415 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:47.492392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321333bf-249e-43d9-92cd-385997f30f58 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:47.506396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5f4eb-8ea4-4990-a369-493c3952840b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:47.508494 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5f4eb-8ea4-4990-a369-493c3952840b admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:47.508790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5f4eb-8ea4-4990-a369-493c3952840b admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:47.509075 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5f4eb-8ea4-4990-a369-493c3952840b admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:47.512464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0026fc-4763-4673-add8-855778219415 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:47.513695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5f4eb-8ea4-4990-a369-493c3952840b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:58:47.514097 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5f4eb-8ea4-4990-a369-493c3952840b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:47.517973 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5f4eb-8ea4-4990-a369-493c3952840b admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:47.527899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26028893-a4ab-4f4e-a938-4d8371de02b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:47.528589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26028893-a4ab-4f4e-a938-4d8371de02b8 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:47.528876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26028893-a4ab-4f4e-a938-4d8371de02b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:47.529158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26028893-a4ab-4f4e-a938-4d8371de02b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:47.529889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26028893-a4ab-4f4e-a938-4d8371de02b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:47.536131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26028893-a4ab-4f4e-a938-4d8371de02b8 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:47.543432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 935/1882] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:58:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:58:47.553406 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5f4eb-8ea4-4990-a369-493c3952840b admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:47.555521 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 948/1883] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:47 2022] GET /identity/v3/roles => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:47.559309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26028893-a4ab-4f4e-a938-4d8371de02b8 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:47.565121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5f4eb-8ea4-4990-a369-493c3952840b admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:47.571194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9188cb8-dbb5-49cc-9f99-21a732bf0178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:47.572252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9188cb8-dbb5-49cc-9f99-21a732bf0178 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:47.572646 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9188cb8-dbb5-49cc-9f99-21a732bf0178 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:47.573028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9188cb8-dbb5-49cc-9f99-21a732bf0178 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:47.573831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9188cb8-dbb5-49cc-9f99-21a732bf0178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:47.573944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26028893-a4ab-4f4e-a938-4d8371de02b8 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:47.576028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9188cb8-dbb5-49cc-9f99-21a732bf0178 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:47.585731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea9c79-780e-4d82-98d5-abb2280b4f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:47.586930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea9c79-780e-4d82-98d5-abb2280b4f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:47.587216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea9c79-780e-4d82-98d5-abb2280b4f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:47.587495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea9c79-780e-4d82-98d5-abb2280b4f13 admin admin] PATH_INFO: `/v3/projects/1eeb9408e8c2461eb46fe012826081ee/users/530e8ca3957244b18aa83fb011bb23fa/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:47.620117 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea9c79-780e-4d82-98d5-abb2280b4f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eeb9408e8c2461eb46fe012826081ee, user_id=530e8ca3957244b18aa83fb011bb23fa, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:47.623082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea9c79-780e-4d82-98d5-abb2280b4f13 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:47.709058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 936/1884] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:47 2022] POST /identity/v3/projects => generated 384 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:47.710357 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9188cb8-dbb5-49cc-9f99-21a732bf0178 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:47.752496 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 949/1885] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:47 2022] PUT /identity/v3/projects/1eeb9408e8c2461eb46fe012826081ee/users/530e8ca3957244b18aa83fb011bb23fa/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:47.767122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87388ba4-5f2c-4ecf-b150-ffbb2844e972 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:47.767571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87388ba4-5f2c-4ecf-b150-ffbb2844e972 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:47.768131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87388ba4-5f2c-4ecf-b150-ffbb2844e972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:47.808822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-87388ba4-5f2c-4ecf-b150-ffbb2844e972 None None] MFA Rules not processed for user `530e8ca3957244b18aa83fb011bb23fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:47.810244 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-87388ba4-5f2c-4ecf-b150-ffbb2844e972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:47.818774 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9188cb8-dbb5-49cc-9f99-21a732bf0178 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:47.899918 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 950/1886] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:58:47.904388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87388ba4-5f2c-4ecf-b150-ffbb2844e972 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:47.958706 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f87af9-5d3b-478e-9c0b-26c4e6eb437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:47.959419 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f87af9-5d3b-478e-9c0b-26c4e6eb437f admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:47.959710 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f87af9-5d3b-478e-9c0b-26c4e6eb437f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:47.960138 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f87af9-5d3b-478e-9c0b-26c4e6eb437f admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:47.961016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f87af9-5d3b-478e-9c0b-26c4e6eb437f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:47.964782 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f87af9-5d3b-478e-9c0b-26c4e6eb437f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:47.990804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:48.027412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87388ba4-5f2c-4ecf-b150-ffbb2844e972 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:48.033675 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda360f-406c-409f-9823-34f9e91437d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:48.034816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda360f-406c-409f-9823-34f9e91437d4 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:48.035283 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda360f-406c-409f-9823-34f9e91437d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:48.035736 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda360f-406c-409f-9823-34f9e91437d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:48.036886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda360f-406c-409f-9823-34f9e91437d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:48.039313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda360f-406c-409f-9823-34f9e91437d4 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:48.099100 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:48.107486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 937/1887] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:47 2022] POST /identity/v3/users => generated 293 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:48.113480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f87af9-5d3b-478e-9c0b-26c4e6eb437f admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:48.130733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f87af9-5d3b-478e-9c0b-26c4e6eb437f admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:48.145268 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6656655-693c-46d1-816e-51609af4140a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:48.148114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6656655-693c-46d1-816e-51609af4140a admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:48.149978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6656655-693c-46d1-816e-51609af4140a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:48.150518 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6656655-693c-46d1-816e-51609af4140a admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:48.154347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6656655-693c-46d1-816e-51609af4140a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:48.159086 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6656655-693c-46d1-816e-51609af4140a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:48.177617 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 938/1888] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:48 2022] GET /identity/v3/roles => generated 1427 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:48.181484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 951/1889] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:47 2022] POST /identity/v3/projects => generated 368 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:58:48.182776 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6656655-693c-46d1-816e-51609af4140a admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:48.183028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda360f-406c-409f-9823-34f9e91437d4 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:48.212155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6656655-693c-46d1-816e-51609af4140a admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:48.330591 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4c71a-5bfb-4a02-a5c2-b937d99810d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:48.330591 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4c71a-5bfb-4a02-a5c2-b937d99810d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:48.331255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4c71a-5bfb-4a02-a5c2-b937d99810d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:48.331415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4c71a-5bfb-4a02-a5c2-b937d99810d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:48.332312 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4c71a-5bfb-4a02-a5c2-b937d99810d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:48.336634 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4c71a-5bfb-4a02-a5c2-b937d99810d5 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:48.343038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda360f-406c-409f-9823-34f9e91437d4 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:48.358246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab18a2-31b0-4423-bc57-65d64db70ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:48.358990 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab18a2-31b0-4423-bc57-65d64db70ecf admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:48.359280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab18a2-31b0-4423-bc57-65d64db70ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:48.361699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab18a2-31b0-4423-bc57-65d64db70ecf admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:48.362488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab18a2-31b0-4423-bc57-65d64db70ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:48.365516 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab18a2-31b0-4423-bc57-65d64db70ecf admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:48.373860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 939/1890] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:48 2022] GET /identity/v3/roles => generated 1427 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:48.374861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4c71a-5bfb-4a02-a5c2-b937d99810d5 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:48.391371 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4c71a-5bfb-4a02-a5c2-b937d99810d5 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:48.397221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de94e51-8bd9-4c13-a7d8-fd3ecf0e601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:48.398139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94e51-8bd9-4c13-a7d8-fd3ecf0e601d admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:48.398465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94e51-8bd9-4c13-a7d8-fd3ecf0e601d admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:48.398746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94e51-8bd9-4c13-a7d8-fd3ecf0e601d admin admin] PATH_INFO: `/v3/projects/357a2ce7ca30472eaad33132f44bd770/users/841903d3842f4ad5a18c3c057f71b48f/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:48.420946 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de94e51-8bd9-4c13-a7d8-fd3ecf0e601d admin admin] RBAC: Authorizing `identity:create_grant(project_id=357a2ce7ca30472eaad33132f44bd770, user_id=841903d3842f4ad5a18c3c057f71b48f, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:48.423869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de94e51-8bd9-4c13-a7d8-fd3ecf0e601d admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:48.486024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 952/1891] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:48 2022] POST /identity/v3/users => generated 291 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:58:48.490147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab18a2-31b0-4423-bc57-65d64db70ecf admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:48.506654 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab18a2-31b0-4423-bc57-65d64db70ecf admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:48.512670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0f4a6-3bd3-405d-b3b5-1f3fa134283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:48.512871 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0f4a6-3bd3-405d-b3b5-1f3fa134283d admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:48.513149 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0f4a6-3bd3-405d-b3b5-1f3fa134283d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:48.513426 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0f4a6-3bd3-405d-b3b5-1f3fa134283d admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:48.526414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 940/1892] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:48 2022] PUT /identity/v3/projects/357a2ce7ca30472eaad33132f44bd770/users/841903d3842f4ad5a18c3c057f71b48f/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:48.527417 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0f4a6-3bd3-405d-b3b5-1f3fa134283d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:48.536825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0f4a6-3bd3-405d-b3b5-1f3fa134283d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:48.538970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2b301-11ef-49a3-90f5-23333f1e494e None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:48.539707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2b301-11ef-49a3-90f5-23333f1e494e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:48.539707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2b301-11ef-49a3-90f5-23333f1e494e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:48.558826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 953/1893] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:48 2022] GET /identity/v3/roles => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:48.559899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0f4a6-3bd3-405d-b3b5-1f3fa134283d admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:48.574449 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0f4a6-3bd3-405d-b3b5-1f3fa134283d admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:48.602266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-23e2b301-11ef-49a3-90f5-23333f1e494e None None] MFA Rules not processed for user `841903d3842f4ad5a18c3c057f71b48f`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:48.603516 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-23e2b301-11ef-49a3-90f5-23333f1e494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:48.681183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8ce20-8d25-4798-aa7b-dcfd877c9fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:48.687758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8ce20-8d25-4798-aa7b-dcfd877c9fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:48.687758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8ce20-8d25-4798-aa7b-dcfd877c9fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:48.687758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8ce20-8d25-4798-aa7b-dcfd877c9fd8 admin admin] PATH_INFO: `/v3/projects/f0602e19e3a8495b8608ae86f9da33a0/users/a9f598364b40479d9c394e8deb66c181/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:48.701196 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 941/1894] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:48.703109 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4438477-8df8-46ef-9db3-56a9cf66e54c None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:48.703998 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4438477-8df8-46ef-9db3-56a9cf66e54c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:48.706950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4438477-8df8-46ef-9db3-56a9cf66e54c None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:48.706950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 942/1895] 10.222.0.112 () {54 vars in 926 bytes} [Thu May 26 16:58:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:58:48.710181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4438477-8df8-46ef-9db3-56a9cf66e54c None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:48.715216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8ce20-8d25-4798-aa7b-dcfd877c9fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0602e19e3a8495b8608ae86f9da33a0, user_id=a9f598364b40479d9c394e8deb66c181, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:48.718423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8ce20-8d25-4798-aa7b-dcfd877c9fd8 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:48.728555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4438477-8df8-46ef-9db3-56a9cf66e54c None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:48.734169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0168aa-675a-4c9d-8b3c-2b266bb4dd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:48.736069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0168aa-675a-4c9d-8b3c-2b266bb4dd55 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:48.736449 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0168aa-675a-4c9d-8b3c-2b266bb4dd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:48.737232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0168aa-675a-4c9d-8b3c-2b266bb4dd55 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:48.738001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0168aa-675a-4c9d-8b3c-2b266bb4dd55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:48.740344 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0168aa-675a-4c9d-8b3c-2b266bb4dd55 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:48.805270 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 954/1896] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:48 2022] PUT /identity/v3/projects/f0602e19e3a8495b8608ae86f9da33a0/users/a9f598364b40479d9c394e8deb66c181/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:48.810518 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f31cf5-b637-4ab5-bb15-738741b489ec None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:48.810813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f31cf5-b637-4ab5-bb15-738741b489ec None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:48.811092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f31cf5-b637-4ab5-bb15-738741b489ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:48.866039 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-a3f31cf5-b637-4ab5-bb15-738741b489ec None None] MFA Rules not processed for user `5f2ec4c76f8f4d858bce53f30cc198fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:48.867516 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a3f31cf5-b637-4ab5-bb15-738741b489ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:48.885154 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 943/1897] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:58:48 2022] POST /identity/v3/projects => generated 386 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:58:48.885154 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0168aa-675a-4c9d-8b3c-2b266bb4dd55 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:48.956816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:48.974960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 955/1898] 10.222.0.112 () {58 vars in 1023 bytes} [Thu May 26 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:48.975984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f31cf5-b637-4ab5-bb15-738741b489ec None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:49.019588 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0168aa-675a-4c9d-8b3c-2b266bb4dd55 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:49.028232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c28035-60dd-4d59-9e3f-082c09e03431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:49.029199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c28035-60dd-4d59-9e3f-082c09e03431 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:49.029678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c28035-60dd-4d59-9e3f-082c09e03431 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:49.030102 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c28035-60dd-4d59-9e3f-082c09e03431 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:49.031246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c28035-60dd-4d59-9e3f-082c09e03431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:49.039274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c28035-60dd-4d59-9e3f-082c09e03431 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:49.064825 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 944/1899] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:48 2022] GET /identity/v3/roles => generated 1427 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:49.070399 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c28035-60dd-4d59-9e3f-082c09e03431 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:49.076605 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-60c28035-60dd-4d59-9e3f-082c09e03431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:49.101324 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f31cf5-b637-4ab5-bb15-738741b489ec None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:49.107714 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55518169-84cc-48c5-a1af-d667d087bad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:49.108695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55518169-84cc-48c5-a1af-d667d087bad0 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:49.108811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55518169-84cc-48c5-a1af-d667d087bad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:49.109021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55518169-84cc-48c5-a1af-d667d087bad0 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:49.110498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55518169-84cc-48c5-a1af-d667d087bad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:49.113461 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55518169-84cc-48c5-a1af-d667d087bad0 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:49.212401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c28035-60dd-4d59-9e3f-082c09e03431 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:49.221004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ce28-81f0-4bc2-a1ea-e7ba7151114c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:49.221963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ce28-81f0-4bc2-a1ea-e7ba7151114c service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:49.221963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ce28-81f0-4bc2-a1ea-e7ba7151114c service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:49.222245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ce28-81f0-4bc2-a1ea-e7ba7151114c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:49.236529 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35ce28-81f0-4bc2-a1ea-e7ba7151114c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:49.238148 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35ce28-81f0-4bc2-a1ea-e7ba7151114c service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:49.253881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 956/1900] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:58:48 2022] POST /identity/v3/users => generated 300 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:49.254987 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55518169-84cc-48c5-a1af-d667d087bad0 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:49.260608 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 945/1901] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:49.261608 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ce28-81f0-4bc2-a1ea-e7ba7151114c service nova] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:49.265120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55518169-84cc-48c5-a1af-d667d087bad0 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:49.271118 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b488644-768e-43b6-9472-1ed429ab724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:49.272115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b488644-768e-43b6-9472-1ed429ab724b admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:49.272494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b488644-768e-43b6-9472-1ed429ab724b admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:49.272841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b488644-768e-43b6-9472-1ed429ab724b admin admin] PATH_INFO: `/v3/projects/f0602e19e3a8495b8608ae86f9da33a0/users/a9f598364b40479d9c394e8deb66c181/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:49.275166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b488644-768e-43b6-9472-1ed429ab724b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0602e19e3a8495b8608ae86f9da33a0, user_id=a9f598364b40479d9c394e8deb66c181, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:49.277984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b488644-768e-43b6-9472-1ed429ab724b admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:49.278867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ce28-81f0-4bc2-a1ea-e7ba7151114c service nova] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:49.284511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc05501-a4fa-486c-a1de-9b0584eaba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:49.285295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc05501-a4fa-486c-a1de-9b0584eaba97 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:49.285585 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc05501-a4fa-486c-a1de-9b0584eaba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:49.285869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc05501-a4fa-486c-a1de-9b0584eaba97 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:49.286686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc05501-a4fa-486c-a1de-9b0584eaba97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:49.288513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc05501-a4fa-486c-a1de-9b0584eaba97 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:49.289500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 957/1902] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:49 2022] PUT /identity/v3/projects/f0602e19e3a8495b8608ae86f9da33a0/users/a9f598364b40479d9c394e8deb66c181/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:49.300508 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849cd3-8a72-43b7-aa12-535ebd08fc15 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:49.300802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849cd3-8a72-43b7-aa12-535ebd08fc15 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:49.301083 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849cd3-8a72-43b7-aa12-535ebd08fc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:49.309783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 946/1903] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:49 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:49.314602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc05501-a4fa-486c-a1de-9b0584eaba97 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:49.331013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc05501-a4fa-486c-a1de-9b0584eaba97 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:49.357550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-3d849cd3-8a72-43b7-aa12-535ebd08fc15 None None] MFA Rules not processed for user `a9f598364b40479d9c394e8deb66c181`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:49.360389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-3d849cd3-8a72-43b7-aa12-535ebd08fc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:49.421160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d651b1-0399-4183-9249-7417ac9f2547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:49.422695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d651b1-0399-4183-9249-7417ac9f2547 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:49.423069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d651b1-0399-4183-9249-7417ac9f2547 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:49.423338 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d651b1-0399-4183-9249-7417ac9f2547 admin admin] PATH_INFO: `/v3/projects/0671ed6bd8054a44b74e4e41824ad235/users/60efc1eb42be44309a80db3a5f6548a3/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:49.447970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:49.450154 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d651b1-0399-4183-9249-7417ac9f2547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0671ed6bd8054a44b74e4e41824ad235, user_id=60efc1eb42be44309a80db3a5f6548a3, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:49.456959 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d651b1-0399-4183-9249-7417ac9f2547 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:49.498184 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 958/1904] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:58:49.545632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 947/1905] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:49 2022] PUT /identity/v3/projects/0671ed6bd8054a44b74e4e41824ad235/users/60efc1eb42be44309a80db3a5f6548a3/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:58:49.550369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849cd3-8a72-43b7-aa12-535ebd08fc15 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:49.571669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d651b1-0399-4183-9249-7417ac9f2547 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:49.573654 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-00d651b1-0399-4183-9249-7417ac9f2547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:49.578210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849cd3-8a72-43b7-aa12-535ebd08fc15 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:49.637895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d651b1-0399-4183-9249-7417ac9f2547 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:49.643165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d070208-5c63-46ab-89f3-269b823849af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:49.644130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d070208-5c63-46ab-89f3-269b823849af service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:49.644254 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d070208-5c63-46ab-89f3-269b823849af service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:49.647000 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d070208-5c63-46ab-89f3-269b823849af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:49.650274 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcf216-c3a8-49fd-8fbd-8d34d0e453e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:49.651223 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcf216-c3a8-49fd-8fbd-8d34d0e453e7 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:49.651352 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcf216-c3a8-49fd-8fbd-8d34d0e453e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:49.651697 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcf216-c3a8-49fd-8fbd-8d34d0e453e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:49.652446 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcf216-c3a8-49fd-8fbd-8d34d0e453e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:49.654121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcf216-c3a8-49fd-8fbd-8d34d0e453e7 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:49.667601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 959/1906] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:58:49 2022] GET /identity/v3/roles => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:49.677578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcf216-c3a8-49fd-8fbd-8d34d0e453e7 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:49.687984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcf216-c3a8-49fd-8fbd-8d34d0e453e7 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:49.693403 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3049e-f734-43f7-9623-b53e4f900bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:49.694303 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3049e-f734-43f7-9623-b53e4f900bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:49.694627 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3049e-f734-43f7-9623-b53e4f900bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:49.695043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3049e-f734-43f7-9623-b53e4f900bf6 admin admin] PATH_INFO: `/v3/projects/0671ed6bd8054a44b74e4e41824ad235/users/60efc1eb42be44309a80db3a5f6548a3/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:49.696909 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3049e-f734-43f7-9623-b53e4f900bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0671ed6bd8054a44b74e4e41824ad235, user_id=60efc1eb42be44309a80db3a5f6548a3, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:49.699672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3049e-f734-43f7-9623-b53e4f900bf6 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:49.712012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 960/1907] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:58:49 2022] PUT /identity/v3/projects/0671ed6bd8054a44b74e4e41824ad235/users/60efc1eb42be44309a80db3a5f6548a3/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:58:49.718250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d070208-5c63-46ab-89f3-269b823849af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:49.720311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d070208-5c63-46ab-89f3-269b823849af service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:49.723152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891e742-e408-4d95-acd6-edd2376239f2 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:49.723446 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891e742-e408-4d95-acd6-edd2376239f2 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:49.723729 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891e742-e408-4d95-acd6-edd2376239f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:49.731699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 948/1908] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:58:49.754500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-6891e742-e408-4d95-acd6-edd2376239f2 None None] MFA Rules not processed for user `60efc1eb42be44309a80db3a5f6548a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:49.755711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6891e742-e408-4d95-acd6-edd2376239f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:49.784369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:49.821632 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 961/1909] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:58:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:58:49.940551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d070208-5c63-46ab-89f3-269b823849af service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:49.949788 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d070208-5c63-46ab-89f3-269b823849af service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:50.019423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7b909-1c7d-45bb-a56e-15496fbd8539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:50.020084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7b909-1c7d-45bb-a56e-15496fbd8539 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:50.020375 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7b909-1c7d-45bb-a56e-15496fbd8539 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:50.020649 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7b909-1c7d-45bb-a56e-15496fbd8539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:50.111777 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7b909-1c7d-45bb-a56e-15496fbd8539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:50.113235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7b909-1c7d-45bb-a56e-15496fbd8539 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:50.124013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 949/1910] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:50.244294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb3cac-a18b-4c1c-99a8-d8dc994cf2a3 None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:50.244698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb3cac-a18b-4c1c-99a8-d8dc994cf2a3 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:50.245107 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb3cac-a18b-4c1c-99a8-d8dc994cf2a3 None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:50.247808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 962/1911] 10.222.0.112 () {54 vars in 926 bytes} [Thu May 26 16:58:50 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:58:50.260506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce780e-2e87-4da4-8ef3-9e7348feda6b None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:50.260874 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce780e-2e87-4da4-8ef3-9e7348feda6b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:50.261236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce780e-2e87-4da4-8ef3-9e7348feda6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:50.288514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-9cce780e-2e87-4da4-8ef3-9e7348feda6b None None] MFA Rules not processed for user `5f2ec4c76f8f4d858bce53f30cc198fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:50.290121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9cce780e-2e87-4da4-8ef3-9e7348feda6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:50.370991 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 950/1912] 10.222.0.112 () {58 vars in 1023 bytes} [Thu May 26 16:58:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:50.385876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb3cac-a18b-4c1c-99a8-d8dc994cf2a3 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:50.387791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8dcb3cac-a18b-4c1c-99a8-d8dc994cf2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:50.410503 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb3cac-a18b-4c1c-99a8-d8dc994cf2a3 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:50.424051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5489aa-cd8e-4d3a-9eb9-81d0eb19d765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:50.424289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5489aa-cd8e-4d3a-9eb9-81d0eb19d765 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:50.424601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5489aa-cd8e-4d3a-9eb9-81d0eb19d765 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:50.425038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5489aa-cd8e-4d3a-9eb9-81d0eb19d765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:50.435457 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5489aa-cd8e-4d3a-9eb9-81d0eb19d765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:50.438595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5489aa-cd8e-4d3a-9eb9-81d0eb19d765 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:50.453031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 963/1913] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:50.490504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce780e-2e87-4da4-8ef3-9e7348feda6b None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:50.492091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9cce780e-2e87-4da4-8ef3-9e7348feda6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:50.512315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce780e-2e87-4da4-8ef3-9e7348feda6b None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:50.525404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297ee49-5a0a-4293-add7-0882c5cd11ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:50.527023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297ee49-5a0a-4293-add7-0882c5cd11ff service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:50.528217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297ee49-5a0a-4293-add7-0882c5cd11ff service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:50.528511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297ee49-5a0a-4293-add7-0882c5cd11ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:50.623415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297ee49-5a0a-4293-add7-0882c5cd11ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:50.626190 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297ee49-5a0a-4293-add7-0882c5cd11ff service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:50.637648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 951/1914] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:50.716933 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:50.933066 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:51.652266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5489aa-cd8e-4d3a-9eb9-81d0eb19d765 service nova] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:51.661623 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5489aa-cd8e-4d3a-9eb9-81d0eb19d765 service nova] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:51.665216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcbcb8-b52b-4882-88c0-b238bceb3ee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:51.665845 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcbcb8-b52b-4882-88c0-b238bceb3ee3 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:51.667490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcbcb8-b52b-4882-88c0-b238bceb3ee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:51.667490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcbcb8-b52b-4882-88c0-b238bceb3ee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:51.668187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-98fcbcb8-b52b-4882-88c0-b238bceb3ee3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:51.729410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcbcb8-b52b-4882-88c0-b238bceb3ee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:51.730873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcbcb8-b52b-4882-88c0-b238bceb3ee3 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:51.740916 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 964/1915] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:51.972846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:52.476170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:52.881743 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:53.178413 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:53.321389 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:53.544635 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:56.777202 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297ee49-5a0a-4293-add7-0882c5cd11ff service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:56.786017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297ee49-5a0a-4293-add7-0882c5cd11ff service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:56.789726 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59378ff5-9215-499f-aac2-c18a20ad090b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:56.790404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59378ff5-9215-499f-aac2-c18a20ad090b service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:56.790698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59378ff5-9215-499f-aac2-c18a20ad090b service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:56.800112 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59378ff5-9215-499f-aac2-c18a20ad090b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:56.800112 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-59378ff5-9215-499f-aac2-c18a20ad090b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:56.803440 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:56.858121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59378ff5-9215-499f-aac2-c18a20ad090b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:56.860138 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59378ff5-9215-499f-aac2-c18a20ad090b service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:56.869963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 952/1916] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:58:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:03.554950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcbcb8-b52b-4882-88c0-b238bceb3ee3 service cinder] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:03.564166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcbcb8-b52b-4882-88c0-b238bceb3ee3 service cinder] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:03.567973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fc0d6-b9ec-4248-86f5-e26731654990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:03.568656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fc0d6-b9ec-4248-86f5-e26731654990 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:03.568946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fc0d6-b9ec-4248-86f5-e26731654990 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:03.569235 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fc0d6-b9ec-4248-86f5-e26731654990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:03.583281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fc0d6-b9ec-4248-86f5-e26731654990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:03.583281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fc0d6-b9ec-4248-86f5-e26731654990 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:03.592058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 965/1917] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:04.177763 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59378ff5-9215-499f-aac2-c18a20ad090b service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:04.179427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-59378ff5-9215-499f-aac2-c18a20ad090b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:04.255598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59378ff5-9215-499f-aac2-c18a20ad090b service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:04.260379 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7b9f5-d9e2-4c01-ace7-49d24657d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:04.261265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b9f5-d9e2-4c01-ace7-49d24657d612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:04.261676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b9f5-d9e2-4c01-ace7-49d24657d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:04.261964 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b9f5-d9e2-4c01-ace7-49d24657d612 admin admin] PATH_INFO: `/v3/users/072af0302c3544c883857d398e44944f` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:04.263226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7b9f5-d9e2-4c01-ace7-49d24657d612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=072af0302c3544c883857d398e44944f)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:04.265132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7b9f5-d9e2-4c01-ace7-49d24657d612 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:04.498896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-33f7b9f5-d9e2-4c01-ace7-49d24657d612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072af0302c3544c883857d398e44944f'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:04.498896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-33f7b9f5-d9e2-4c01-ace7-49d24657d612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072af0302c3544c883857d398e44944f'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:04.498896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-33f7b9f5-d9e2-4c01-ace7-49d24657d612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072af0302c3544c883857d398e44944f'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:04.578807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-33f7b9f5-d9e2-4c01-ace7-49d24657d612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072af0302c3544c883857d398e44944f'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:04.592985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-33f7b9f5-d9e2-4c01-ace7-49d24657d612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072af0302c3544c883857d398e44944f'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:04.606573 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 953/1918] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:04 2022] DELETE /identity/v3/users/072af0302c3544c883857d398e44944f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:04.611444 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f927f1c-89bd-4e29-a4ef-2145d851abe9 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:04.611921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f927f1c-89bd-4e29-a4ef-2145d851abe9 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:04.612161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f927f1c-89bd-4e29-a4ef-2145d851abe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:04.630726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-7f927f1c-89bd-4e29-a4ef-2145d851abe9 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:04.632324 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7f927f1c-89bd-4e29-a4ef-2145d851abe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:04.703298 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:04.712507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 966/1919] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:04.722530 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7b9f5-d9e2-4c01-ace7-49d24657d612 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:04.724116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-33f7b9f5-d9e2-4c01-ace7-49d24657d612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:04.748601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f927f1c-89bd-4e29-a4ef-2145d851abe9 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:04.750930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7f927f1c-89bd-4e29-a4ef-2145d851abe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:04.760537 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:04.766756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f927f1c-89bd-4e29-a4ef-2145d851abe9 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:04.772818 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227a03-62b8-4e9b-89ec-85b987296359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:04.774282 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227a03-62b8-4e9b-89ec-85b987296359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:04.774601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227a03-62b8-4e9b-89ec-85b987296359 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:04.775051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227a03-62b8-4e9b-89ec-85b987296359 admin admin] PATH_INFO: `/v3/users/524cc9fc501448f793458553b443c4a5` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:04.776330 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da227a03-62b8-4e9b-89ec-85b987296359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=524cc9fc501448f793458553b443c4a5)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:04.778764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da227a03-62b8-4e9b-89ec-85b987296359 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:04.806692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7b9f5-d9e2-4c01-ace7-49d24657d612 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:04.827476 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998de0a3-288b-4e2b-aef3-36710c2570df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:04.832080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998de0a3-288b-4e2b-aef3-36710c2570df service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:04.832080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998de0a3-288b-4e2b-aef3-36710c2570df service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:04.832080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998de0a3-288b-4e2b-aef3-36710c2570df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:04.840169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998de0a3-288b-4e2b-aef3-36710c2570df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:04.841686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998de0a3-288b-4e2b-aef3-36710c2570df service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:04.852820 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 954/1920] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:04.972724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998de0a3-288b-4e2b-aef3-36710c2570df service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:04.974096 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-998de0a3-288b-4e2b-aef3-36710c2570df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:04.987406 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998de0a3-288b-4e2b-aef3-36710c2570df service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:04.992116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68918ed1-2cb8-4db5-9b52-1a957226609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:04.992996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68918ed1-2cb8-4db5-9b52-1a957226609a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:04.993311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68918ed1-2cb8-4db5-9b52-1a957226609a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:04.993618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68918ed1-2cb8-4db5-9b52-1a957226609a admin admin] PATH_INFO: `/v3/users/530e8ca3957244b18aa83fb011bb23fa` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:04.995404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68918ed1-2cb8-4db5-9b52-1a957226609a admin admin] RBAC: Authorizing `identity:delete_user(user_id=530e8ca3957244b18aa83fb011bb23fa)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:04.996911 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68918ed1-2cb8-4db5-9b52-1a957226609a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:05.074531 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-da227a03-62b8-4e9b-89ec-85b987296359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524cc9fc501448f793458553b443c4a5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:05.075203 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-da227a03-62b8-4e9b-89ec-85b987296359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524cc9fc501448f793458553b443c4a5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:05.086909 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-da227a03-62b8-4e9b-89ec-85b987296359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524cc9fc501448f793458553b443c4a5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:05.178723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-da227a03-62b8-4e9b-89ec-85b987296359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524cc9fc501448f793458553b443c4a5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:05.186172 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-da227a03-62b8-4e9b-89ec-85b987296359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524cc9fc501448f793458553b443c4a5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:05.192940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 967/1921] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:04 2022] DELETE /identity/v3/users/524cc9fc501448f793458553b443c4a5 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:05.201132 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046f93-3a83-4957-8406-87c3b1a49999 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:05.201551 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046f93-3a83-4957-8406-87c3b1a49999 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:05.202307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046f93-3a83-4957-8406-87c3b1a49999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:05.221294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-62046f93-3a83-4957-8406-87c3b1a49999 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:05.225016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-62046f93-3a83-4957-8406-87c3b1a49999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:05.282652 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-68918ed1-2cb8-4db5-9b52-1a957226609a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530e8ca3957244b18aa83fb011bb23fa'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:05.284335 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-68918ed1-2cb8-4db5-9b52-1a957226609a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530e8ca3957244b18aa83fb011bb23fa'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:05.285116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-68918ed1-2cb8-4db5-9b52-1a957226609a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530e8ca3957244b18aa83fb011bb23fa'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:05.318749 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 968/1922] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:05.334528 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62046f93-3a83-4957-8406-87c3b1a49999 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:05.335963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-62046f93-3a83-4957-8406-87c3b1a49999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:05.384518 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-68918ed1-2cb8-4db5-9b52-1a957226609a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530e8ca3957244b18aa83fb011bb23fa'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:05.408505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62046f93-3a83-4957-8406-87c3b1a49999 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:05.412263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d5693-8cd2-47eb-a25c-e7b4cc9c75ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:05.412921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d5693-8cd2-47eb-a25c-e7b4cc9c75ab service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:05.413208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d5693-8cd2-47eb-a25c-e7b4cc9c75ab service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:05.413489 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d5693-8cd2-47eb-a25c-e7b4cc9c75ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:05.419584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-68918ed1-2cb8-4db5-9b52-1a957226609a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530e8ca3957244b18aa83fb011bb23fa'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:05.424031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d5693-8cd2-47eb-a25c-e7b4cc9c75ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:05.425837 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d5693-8cd2-47eb-a25c-e7b4cc9c75ab service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:05.437455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 969/1923] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:05.443939 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 955/1924] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:04 2022] DELETE /identity/v3/users/530e8ca3957244b18aa83fb011bb23fa => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:05.448342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b6837-510d-4b50-aeef-78cd86004311 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:05.448987 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b6837-510d-4b50-aeef-78cd86004311 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:05.449654 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b6837-510d-4b50-aeef-78cd86004311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:05.479928 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-7b8b6837-510d-4b50-aeef-78cd86004311 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:05.479928 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7b8b6837-510d-4b50-aeef-78cd86004311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:05.489665 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:05.534059 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68918ed1-2cb8-4db5-9b52-1a957226609a admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:05.535657 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-68918ed1-2cb8-4db5-9b52-1a957226609a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:05.612624 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 970/1925] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:05.628067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b6837-510d-4b50-aeef-78cd86004311 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:05.629744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7b8b6837-510d-4b50-aeef-78cd86004311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:05.668503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68918ed1-2cb8-4db5-9b52-1a957226609a admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:05.672425 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d700e-5d27-4304-9868-a4e46f06293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:05.673490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d700e-5d27-4304-9868-a4e46f06293a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:05.673881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d700e-5d27-4304-9868-a4e46f06293a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:05.674582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d700e-5d27-4304-9868-a4e46f06293a admin admin] PATH_INFO: `/v3/projects/192071af082d49bf87c4abe82fce2c30` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:05.676147 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d700e-5d27-4304-9868-a4e46f06293a admin admin] RBAC: Authorizing `identity:delete_project(project_id=192071af082d49bf87c4abe82fce2c30)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:05.678435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d700e-5d27-4304-9868-a4e46f06293a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:05.709886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b6837-510d-4b50-aeef-78cd86004311 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:05.713619 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585c07d-917f-424c-9f9d-e4a1aa398328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:05.714529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585c07d-917f-424c-9f9d-e4a1aa398328 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:05.714702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585c07d-917f-424c-9f9d-e4a1aa398328 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:05.714987 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585c07d-917f-424c-9f9d-e4a1aa398328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:05.724663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585c07d-917f-424c-9f9d-e4a1aa398328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:05.726291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585c07d-917f-424c-9f9d-e4a1aa398328 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:05.736689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 971/1926] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:05.853017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:05.872302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-719d700e-5d27-4304-9868-a4e46f06293a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '192071af082d49bf87c4abe82fce2c30', 'request_id': 'req-719d700e-5d27-4304-9868-a4e46f06293a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:05.955907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-719d700e-5d27-4304-9868-a4e46f06293a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '192071af082d49bf87c4abe82fce2c30', 'request_id': 'req-719d700e-5d27-4304-9868-a4e46f06293a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:05.964363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-719d700e-5d27-4304-9868-a4e46f06293a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '192071af082d49bf87c4abe82fce2c30', 'request_id': 'req-719d700e-5d27-4304-9868-a4e46f06293a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:05.990459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-719d700e-5d27-4304-9868-a4e46f06293a admin admin] The token cache is being invalidate because project 192071af082d49bf87c4abe82fce2c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:05.990459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-719d700e-5d27-4304-9868-a4e46f06293a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:05.990459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-719d700e-5d27-4304-9868-a4e46f06293a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:05.992330 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 956/1927] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:05 2022] DELETE /identity/v3/projects/192071af082d49bf87c4abe82fce2c30 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:05.997692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585c07d-917f-424c-9f9d-e4a1aa398328 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:06.013658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585c07d-917f-424c-9f9d-e4a1aa398328 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:06.113876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d700e-5d27-4304-9868-a4e46f06293a admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:06.115567 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-719d700e-5d27-4304-9868-a4e46f06293a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:06.156277 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca357441-6627-43db-b117-0de5ce9eb341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:06.157380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca357441-6627-43db-b117-0de5ce9eb341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:06.157676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca357441-6627-43db-b117-0de5ce9eb341 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:06.157958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca357441-6627-43db-b117-0de5ce9eb341 admin admin] PATH_INFO: `/v3/users/6497c50fdddf423a8334f0bc6973432d` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:06.159447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca357441-6627-43db-b117-0de5ce9eb341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6497c50fdddf423a8334f0bc6973432d)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:06.161746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca357441-6627-43db-b117-0de5ce9eb341 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:06.294952 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d700e-5d27-4304-9868-a4e46f06293a admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:06.306163 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1d1ac-3107-483b-9dc1-16ca021e1c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:06.307632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1d1ac-3107-483b-9dc1-16ca021e1c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:06.308106 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1d1ac-3107-483b-9dc1-16ca021e1c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:06.308822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1d1ac-3107-483b-9dc1-16ca021e1c13 admin admin] PATH_INFO: `/v3/projects/b7a78ffcba1b49248f21f25f497caff7` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:06.310241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1d1ac-3107-483b-9dc1-16ca021e1c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a78ffcba1b49248f21f25f497caff7)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:06.312898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1d1ac-3107-483b-9dc1-16ca021e1c13 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:06.362858 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ca357441-6627-43db-b117-0de5ce9eb341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6497c50fdddf423a8334f0bc6973432d'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.364633 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ca357441-6627-43db-b117-0de5ce9eb341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6497c50fdddf423a8334f0bc6973432d'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.397688 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:06.401614 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ca357441-6627-43db-b117-0de5ce9eb341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6497c50fdddf423a8334f0bc6973432d'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.453985 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ca357441-6627-43db-b117-0de5ce9eb341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6497c50fdddf423a8334f0bc6973432d'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.455741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-77f1d1ac-3107-483b-9dc1-16ca021e1c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a78ffcba1b49248f21f25f497caff7', 'request_id': 'req-77f1d1ac-3107-483b-9dc1-16ca021e1c13'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.464222 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ca357441-6627-43db-b117-0de5ce9eb341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6497c50fdddf423a8334f0bc6973432d'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.470852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 972/1928] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:05 2022] DELETE /identity/v3/users/6497c50fdddf423a8334f0bc6973432d => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:06.489882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca357441-6627-43db-b117-0de5ce9eb341 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:06.491462 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ca357441-6627-43db-b117-0de5ce9eb341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:06.531475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-77f1d1ac-3107-483b-9dc1-16ca021e1c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a78ffcba1b49248f21f25f497caff7', 'request_id': 'req-77f1d1ac-3107-483b-9dc1-16ca021e1c13'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.539429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-77f1d1ac-3107-483b-9dc1-16ca021e1c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a78ffcba1b49248f21f25f497caff7', 'request_id': 'req-77f1d1ac-3107-483b-9dc1-16ca021e1c13'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.552427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-77f1d1ac-3107-483b-9dc1-16ca021e1c13 admin admin] The token cache is being invalidate because project b7a78ffcba1b49248f21f25f497caff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:06.552908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-77f1d1ac-3107-483b-9dc1-16ca021e1c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.553876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-77f1d1ac-3107-483b-9dc1-16ca021e1c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.555574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 957/1929] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:06 2022] DELETE /identity/v3/projects/b7a78ffcba1b49248f21f25f497caff7 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:06.559612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1d1ac-3107-483b-9dc1-16ca021e1c13 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:06.561996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-77f1d1ac-3107-483b-9dc1-16ca021e1c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:06.572908 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca357441-6627-43db-b117-0de5ce9eb341 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:06.577736 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:06.579320 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:06.579684 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:06.580026 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5 admin admin] PATH_INFO: `/v3/projects/1eeb9408e8c2461eb46fe012826081ee` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:06.581689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eeb9408e8c2461eb46fe012826081ee)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:06.583916 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:06.633008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1d1ac-3107-483b-9dc1-16ca021e1c13 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:06.638119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c723b-c165-47b1-81bf-b4a58c7cdabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:06.639203 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c723b-c165-47b1-81bf-b4a58c7cdabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:06.644763 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c723b-c165-47b1-81bf-b4a58c7cdabb admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:06.644763 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c723b-c165-47b1-81bf-b4a58c7cdabb admin admin] PATH_INFO: `/v3/users/4d290b0437bb49a3ae89e52ff55be7d3` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:06.644763 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c723b-c165-47b1-81bf-b4a58c7cdabb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d290b0437bb49a3ae89e52ff55be7d3)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:06.644763 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c723b-c165-47b1-81bf-b4a58c7cdabb admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:06.751224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eeb9408e8c2461eb46fe012826081ee', 'request_id': 'req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.956654 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eeb9408e8c2461eb46fe012826081ee', 'request_id': 'req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.966013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eeb9408e8c2461eb46fe012826081ee', 'request_id': 'req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.981586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5 admin admin] The token cache is being invalidate because project 1eeb9408e8c2461eb46fe012826081ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:06.982005 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.983656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.985794 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 973/1930] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:06 2022] DELETE /identity/v3/projects/1eeb9408e8c2461eb46fe012826081ee => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:06.987500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2b9c723b-c165-47b1-81bf-b4a58c7cdabb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d290b0437bb49a3ae89e52ff55be7d3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.988814 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2b9c723b-c165-47b1-81bf-b4a58c7cdabb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d290b0437bb49a3ae89e52ff55be7d3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.989732 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:06.991331 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2b9c723b-c165-47b1-81bf-b4a58c7cdabb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d290b0437bb49a3ae89e52ff55be7d3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:06.991955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:07.066008 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61d292-8eeb-4e8d-98cd-9f47a99514b5 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:07.070654 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0519acc-58aa-4bd9-8802-4e9299de4f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:07.071539 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0519acc-58aa-4bd9-8802-4e9299de4f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:07.071826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0519acc-58aa-4bd9-8802-4e9299de4f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:07.072115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0519acc-58aa-4bd9-8802-4e9299de4f97 admin admin] PATH_INFO: `/v3/users/a9f598364b40479d9c394e8deb66c181` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:07.073303 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0519acc-58aa-4bd9-8802-4e9299de4f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f598364b40479d9c394e8deb66c181)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:07.075437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0519acc-58aa-4bd9-8802-4e9299de4f97 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:07.104428 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2b9c723b-c165-47b1-81bf-b4a58c7cdabb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d290b0437bb49a3ae89e52ff55be7d3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:07.129090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2b9c723b-c165-47b1-81bf-b4a58c7cdabb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d290b0437bb49a3ae89e52ff55be7d3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:07.154194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 958/1931] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:06 2022] DELETE /identity/v3/users/4d290b0437bb49a3ae89e52ff55be7d3 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:07.154194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c723b-c165-47b1-81bf-b4a58c7cdabb admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:07.158905 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2b9c723b-c165-47b1-81bf-b4a58c7cdabb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:07.211493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:07.257637 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c723b-c165-47b1-81bf-b4a58c7cdabb admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:07.263620 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a2d9b-8d06-43c1-a46e-0b679669b58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:07.264584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a2d9b-8d06-43c1-a46e-0b679669b58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:07.264871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a2d9b-8d06-43c1-a46e-0b679669b58b admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:07.265160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a2d9b-8d06-43c1-a46e-0b679669b58b admin admin] PATH_INFO: `/v3/projects/0b3d658cc1ee46b1b4d297fb3eab2878` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:07.267711 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a2d9b-8d06-43c1-a46e-0b679669b58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3d658cc1ee46b1b4d297fb3eab2878)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:07.269793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a2d9b-8d06-43c1-a46e-0b679669b58b admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:07.330275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f0519acc-58aa-4bd9-8802-4e9299de4f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f598364b40479d9c394e8deb66c181'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:07.333094 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f0519acc-58aa-4bd9-8802-4e9299de4f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f598364b40479d9c394e8deb66c181'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:07.373144 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f0519acc-58aa-4bd9-8802-4e9299de4f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f598364b40479d9c394e8deb66c181'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:07.383125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-328a2d9b-8d06-43c1-a46e-0b679669b58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3d658cc1ee46b1b4d297fb3eab2878', 'request_id': 'req-328a2d9b-8d06-43c1-a46e-0b679669b58b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:07.471479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f0519acc-58aa-4bd9-8802-4e9299de4f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f598364b40479d9c394e8deb66c181'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:07.492272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f0519acc-58aa-4bd9-8802-4e9299de4f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f598364b40479d9c394e8deb66c181'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:07.503424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 974/1932] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:06 2022] DELETE /identity/v3/users/a9f598364b40479d9c394e8deb66c181 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:07.521844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:07.533845 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-328a2d9b-8d06-43c1-a46e-0b679669b58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3d658cc1ee46b1b4d297fb3eab2878', 'request_id': 'req-328a2d9b-8d06-43c1-a46e-0b679669b58b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:07.542206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-328a2d9b-8d06-43c1-a46e-0b679669b58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3d658cc1ee46b1b4d297fb3eab2878', 'request_id': 'req-328a2d9b-8d06-43c1-a46e-0b679669b58b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:07.554410 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-328a2d9b-8d06-43c1-a46e-0b679669b58b admin admin] The token cache is being invalidate because project 0b3d658cc1ee46b1b4d297fb3eab2878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:07.554884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-328a2d9b-8d06-43c1-a46e-0b679669b58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:07.556039 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-328a2d9b-8d06-43c1-a46e-0b679669b58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:07.557639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 959/1933] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:07 2022] DELETE /identity/v3/projects/0b3d658cc1ee46b1b4d297fb3eab2878 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:07.564727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001e161-5e65-4d59-a2e6-efa3e7b68562 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:07.565148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001e161-5e65-4d59-a2e6-efa3e7b68562 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:07.565824 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001e161-5e65-4d59-a2e6-efa3e7b68562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:07.596190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-5001e161-5e65-4d59-a2e6-efa3e7b68562 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:07.598356 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5001e161-5e65-4d59-a2e6-efa3e7b68562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:07.668881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 975/1934] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:07.681785 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8a445-0323-46a1-bd54-af5e145f5019 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:07.682079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8a445-0323-46a1-bd54-af5e145f5019 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:07.682395 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8a445-0323-46a1-bd54-af5e145f5019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:07.701847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-fff8a445-0323-46a1-bd54-af5e145f5019 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:07.703319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-fff8a445-0323-46a1-bd54-af5e145f5019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:07.713217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 960/1935] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:07.717110 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001e161-5e65-4d59-a2e6-efa3e7b68562 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:07.726967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001e161-5e65-4d59-a2e6-efa3e7b68562 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:07.731855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca66c1f-6768-47ed-a32f-1f67b508fc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:07.732523 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca66c1f-6768-47ed-a32f-1f67b508fc15 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:07.732809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca66c1f-6768-47ed-a32f-1f67b508fc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:07.733138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca66c1f-6768-47ed-a32f-1f67b508fc15 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:07.733797 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca66c1f-6768-47ed-a32f-1f67b508fc15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:59:07.734107 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca66c1f-6768-47ed-a32f-1f67b508fc15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:07.736571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca66c1f-6768-47ed-a32f-1f67b508fc15 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:07.760209 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 976/1936] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:59:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:59:07.763177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8a445-0323-46a1-bd54-af5e145f5019 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:07.774250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8a445-0323-46a1-bd54-af5e145f5019 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:07.779871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fb087-c689-4b2c-9a14-fb93c41eed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:07.781065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fb087-c689-4b2c-9a14-fb93c41eed32 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:07.781065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fb087-c689-4b2c-9a14-fb93c41eed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:07.783885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fb087-c689-4b2c-9a14-fb93c41eed32 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:07.783885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fb087-c689-4b2c-9a14-fb93c41eed32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:07.785217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fb087-c689-4b2c-9a14-fb93c41eed32 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:07.975148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca66c1f-6768-47ed-a32f-1f67b508fc15 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:07.976735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 961/1937] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:07 2022] POST /identity/v3/projects => generated 386 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:07.977490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1ca66c1f-6768-47ed-a32f-1f67b508fc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:07.980765 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fb087-c689-4b2c-9a14-fb93c41eed32 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:07.993547 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca66c1f-6768-47ed-a32f-1f67b508fc15 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:08.069604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fb087-c689-4b2c-9a14-fb93c41eed32 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:08.074839 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17fead-868e-4c92-9ee1-c13cd94cb465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:08.075821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17fead-868e-4c92-9ee1-c13cd94cb465 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:08.075821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17fead-868e-4c92-9ee1-c13cd94cb465 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:08.076162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17fead-868e-4c92-9ee1-c13cd94cb465 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:08.076839 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17fead-868e-4c92-9ee1-c13cd94cb465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:08.078905 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17fead-868e-4c92-9ee1-c13cd94cb465 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:08.095123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e252faf-67d8-464a-9b9f-5565ecf265f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:08.096397 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e252faf-67d8-464a-9b9f-5565ecf265f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:08.096775 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e252faf-67d8-464a-9b9f-5565ecf265f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:08.097116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e252faf-67d8-464a-9b9f-5565ecf265f6 admin admin] PATH_INFO: `/v3/projects/7c1e33558c274c4bb2cb86a575306a06` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:08.098515 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e252faf-67d8-464a-9b9f-5565ecf265f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1e33558c274c4bb2cb86a575306a06)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:08.100560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e252faf-67d8-464a-9b9f-5565ecf265f6 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:08.186114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 962/1938] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:07 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:59:08.187289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17fead-868e-4c92-9ee1-c13cd94cb465 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:08.191362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-bc17fead-868e-4c92-9ee1-c13cd94cb465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:08.199536 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8e252faf-67d8-464a-9b9f-5565ecf265f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1e33558c274c4bb2cb86a575306a06', 'request_id': 'req-8e252faf-67d8-464a-9b9f-5565ecf265f6'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:08.211882 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17fead-868e-4c92-9ee1-c13cd94cb465 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:08.275500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8e252faf-67d8-464a-9b9f-5565ecf265f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1e33558c274c4bb2cb86a575306a06', 'request_id': 'req-8e252faf-67d8-464a-9b9f-5565ecf265f6'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:08.277857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1290a-398b-4e4d-af9c-83c65f55efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:08.278994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1290a-398b-4e4d-af9c-83c65f55efd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:08.279160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1290a-398b-4e4d-af9c-83c65f55efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:08.279457 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1290a-398b-4e4d-af9c-83c65f55efd4 admin admin] PATH_INFO: `/v3/projects/f0602e19e3a8495b8608ae86f9da33a0` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:08.280727 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1290a-398b-4e4d-af9c-83c65f55efd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0602e19e3a8495b8608ae86f9da33a0)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:08.283537 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1290a-398b-4e4d-af9c-83c65f55efd4 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:08.284063 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8e252faf-67d8-464a-9b9f-5565ecf265f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1e33558c274c4bb2cb86a575306a06', 'request_id': 'req-8e252faf-67d8-464a-9b9f-5565ecf265f6'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:08.295005 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8e252faf-67d8-464a-9b9f-5565ecf265f6 admin admin] The token cache is being invalidate because project 7c1e33558c274c4bb2cb86a575306a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:08.295289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8e252faf-67d8-464a-9b9f-5565ecf265f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:08.296037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8e252faf-67d8-464a-9b9f-5565ecf265f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:08.298529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 977/1939] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:07 2022] DELETE /identity/v3/projects/7c1e33558c274c4bb2cb86a575306a06 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:08.301804 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e252faf-67d8-464a-9b9f-5565ecf265f6 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:08.303240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8e252faf-67d8-464a-9b9f-5565ecf265f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:08.315614 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e252faf-67d8-464a-9b9f-5565ecf265f6 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:08.320472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618fa6-5e2b-445b-97ad-85fbc86267ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:08.321147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618fa6-5e2b-445b-97ad-85fbc86267ba admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:08.321429 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618fa6-5e2b-445b-97ad-85fbc86267ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:08.321720 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618fa6-5e2b-445b-97ad-85fbc86267ba admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:08.322499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18618fa6-5e2b-445b-97ad-85fbc86267ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:08.324083 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18618fa6-5e2b-445b-97ad-85fbc86267ba admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:08.335031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 978/1940] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:08 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:08.335981 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618fa6-5e2b-445b-97ad-85fbc86267ba admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:08.337592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-18618fa6-5e2b-445b-97ad-85fbc86267ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:08.350440 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618fa6-5e2b-445b-97ad-85fbc86267ba admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:08.355070 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66df1ff-a94c-4d44-9611-f70c2f598f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:08.355922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66df1ff-a94c-4d44-9611-f70c2f598f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:08.356208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66df1ff-a94c-4d44-9611-f70c2f598f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:08.356486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66df1ff-a94c-4d44-9611-f70c2f598f6f admin admin] PATH_INFO: `/v3/users/775ff6c6a47c4ca2b5bad6ea0b9535c8` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:08.357681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66df1ff-a94c-4d44-9611-f70c2f598f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=775ff6c6a47c4ca2b5bad6ea0b9535c8)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:08.359699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66df1ff-a94c-4d44-9611-f70c2f598f6f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:08.501898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1ef1290a-398b-4e4d-af9c-83c65f55efd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0602e19e3a8495b8608ae86f9da33a0', 'request_id': 'req-1ef1290a-398b-4e4d-af9c-83c65f55efd4'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:08.614947 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1ef1290a-398b-4e4d-af9c-83c65f55efd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0602e19e3a8495b8608ae86f9da33a0', 'request_id': 'req-1ef1290a-398b-4e4d-af9c-83c65f55efd4'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:08.621006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1ef1290a-398b-4e4d-af9c-83c65f55efd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0602e19e3a8495b8608ae86f9da33a0', 'request_id': 'req-1ef1290a-398b-4e4d-af9c-83c65f55efd4'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:08.636662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-c66df1ff-a94c-4d44-9611-f70c2f598f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775ff6c6a47c4ca2b5bad6ea0b9535c8'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:08.637654 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-c66df1ff-a94c-4d44-9611-f70c2f598f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775ff6c6a47c4ca2b5bad6ea0b9535c8'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:08.647842 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1ef1290a-398b-4e4d-af9c-83c65f55efd4 admin admin] The token cache is being invalidate because project f0602e19e3a8495b8608ae86f9da33a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:08.648479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1ef1290a-398b-4e4d-af9c-83c65f55efd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:08.651071 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1ef1290a-398b-4e4d-af9c-83c65f55efd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:08.653803 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 963/1941] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:08 2022] DELETE /identity/v3/projects/f0602e19e3a8495b8608ae86f9da33a0 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:08.654891 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1290a-398b-4e4d-af9c-83c65f55efd4 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:08.658468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-c66df1ff-a94c-4d44-9611-f70c2f598f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775ff6c6a47c4ca2b5bad6ea0b9535c8'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:08.662876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1ef1290a-398b-4e4d-af9c-83c65f55efd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:08.752759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1290a-398b-4e4d-af9c-83c65f55efd4 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:08.763828 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75857b-9cd2-44c2-9ca8-0dd9ec7bd0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:08.764640 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75857b-9cd2-44c2-9ca8-0dd9ec7bd0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:08.765218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75857b-9cd2-44c2-9ca8-0dd9ec7bd0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:08.765914 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75857b-9cd2-44c2-9ca8-0dd9ec7bd0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:08.767137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75857b-9cd2-44c2-9ca8-0dd9ec7bd0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:08.780625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75857b-9cd2-44c2-9ca8-0dd9ec7bd0e6 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:08.784914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-c66df1ff-a94c-4d44-9611-f70c2f598f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775ff6c6a47c4ca2b5bad6ea0b9535c8'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:08.799622 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-c66df1ff-a94c-4d44-9611-f70c2f598f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775ff6c6a47c4ca2b5bad6ea0b9535c8'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:08.804156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 964/1942] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:08 2022] GET /identity/v3/roles => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:08.804156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c247018-d9c2-4353-aa2b-af890d78f901 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:08.804156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c247018-d9c2-4353-aa2b-af890d78f901 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:08.804156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c247018-d9c2-4353-aa2b-af890d78f901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:08.809081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 979/1943] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:08 2022] DELETE /identity/v3/users/775ff6c6a47c4ca2b5bad6ea0b9535c8 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:08.809961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66df1ff-a94c-4d44-9611-f70c2f598f6f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:08.813152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c66df1ff-a94c-4d44-9611-f70c2f598f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:08.838203 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-5c247018-d9c2-4353-aa2b-af890d78f901 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:08.841119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5c247018-d9c2-4353-aa2b-af890d78f901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:08.870491 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:08.911615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66df1ff-a94c-4d44-9611-f70c2f598f6f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:08.918249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fb6da-31a8-443f-91d3-72844edba945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:08.920843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fb6da-31a8-443f-91d3-72844edba945 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:08.921130 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fb6da-31a8-443f-91d3-72844edba945 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:08.921411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fb6da-31a8-443f-91d3-72844edba945 admin admin] PATH_INFO: `/v3/projects/1732d33d274f4644a99547982f97925b/users/a0ad49279c8d4512a16a025e7e36dc30/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:08.922457 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 965/1944] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:08.931221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c067ca-7752-46be-9cd6-8e3920f72dba None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:08.931595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c067ca-7752-46be-9cd6-8e3920f72dba None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:08.931992 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c067ca-7752-46be-9cd6-8e3920f72dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:08.942058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fb6da-31a8-443f-91d3-72844edba945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1732d33d274f4644a99547982f97925b, user_id=a0ad49279c8d4512a16a025e7e36dc30, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:08.944861 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fb6da-31a8-443f-91d3-72844edba945 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:08.952676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-f5c067ca-7752-46be-9cd6-8e3920f72dba None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:08.954701 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f5c067ca-7752-46be-9cd6-8e3920f72dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:08.967564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 966/1945] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:08.968324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c067ca-7752-46be-9cd6-8e3920f72dba None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:08.973045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:08.983339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c067ca-7752-46be-9cd6-8e3920f72dba None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:08.988466 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efda7d7-2d4c-47f0-bb6d-5ce11e0f1d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:08.989228 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efda7d7-2d4c-47f0-bb6d-5ce11e0f1d16 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:08.989524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efda7d7-2d4c-47f0-bb6d-5ce11e0f1d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:08.989810 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efda7d7-2d4c-47f0-bb6d-5ce11e0f1d16 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:08.990584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efda7d7-2d4c-47f0-bb6d-5ce11e0f1d16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:59:08.990902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efda7d7-2d4c-47f0-bb6d-5ce11e0f1d16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:08.994431 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efda7d7-2d4c-47f0-bb6d-5ce11e0f1d16 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:09.006812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 967/1946] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:59:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:59:09.011074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efda7d7-2d4c-47f0-bb6d-5ce11e0f1d16 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:09.025172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efda7d7-2d4c-47f0-bb6d-5ce11e0f1d16 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:09.042057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 980/1947] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:08 2022] PUT /identity/v3/projects/1732d33d274f4644a99547982f97925b/users/a0ad49279c8d4512a16a025e7e36dc30/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:09.043821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb237326-970e-40e3-ad3c-726a19f5b826 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:09.044118 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb237326-970e-40e3-ad3c-726a19f5b826 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:09.044410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb237326-970e-40e3-ad3c-726a19f5b826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:09.076602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-fb237326-970e-40e3-ad3c-726a19f5b826 None None] MFA Rules not processed for user `a0ad49279c8d4512a16a025e7e36dc30`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:09.079226 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-fb237326-970e-40e3-ad3c-726a19f5b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:09.117027 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505ef32-7671-451c-9a71-9110b17e7382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:09.118098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505ef32-7671-451c-9a71-9110b17e7382 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:09.118409 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505ef32-7671-451c-9a71-9110b17e7382 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:09.118690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505ef32-7671-451c-9a71-9110b17e7382 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:09.119593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505ef32-7671-451c-9a71-9110b17e7382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:09.122686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505ef32-7671-451c-9a71-9110b17e7382 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:09.178375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 981/1948] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:09.181151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb237326-970e-40e3-ad3c-726a19f5b826 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:09.193599 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb237326-970e-40e3-ad3c-726a19f5b826 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:09.203590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990e574-0b11-4406-80f5-0e425e0ee138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:09.204161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990e574-0b11-4406-80f5-0e425e0ee138 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:09.204450 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990e574-0b11-4406-80f5-0e425e0ee138 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:09.204785 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990e574-0b11-4406-80f5-0e425e0ee138 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:09.205615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990e574-0b11-4406-80f5-0e425e0ee138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:09.208370 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990e574-0b11-4406-80f5-0e425e0ee138 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:09.217886 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 968/1949] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:09 2022] POST /identity/v3/projects => generated 378 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:09.222977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505ef32-7671-451c-9a71-9110b17e7382 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:09.291725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505ef32-7671-451c-9a71-9110b17e7382 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:09.296301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8f2dd-960e-4231-9d56-34156fada9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:09.297312 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8f2dd-960e-4231-9d56-34156fada9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:09.298807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8f2dd-960e-4231-9d56-34156fada9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:09.299804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8f2dd-960e-4231-9d56-34156fada9d2 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:09.301632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8f2dd-960e-4231-9d56-34156fada9d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:09.304369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8f2dd-960e-4231-9d56-34156fada9d2 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:09.325886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 982/1950] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:09 2022] POST /identity/v3/projects => generated 388 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:09.325886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990e574-0b11-4406-80f5-0e425e0ee138 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:09.386818 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990e574-0b11-4406-80f5-0e425e0ee138 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:09.392763 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0555f9-6464-4c07-bcb9-87b8aebd400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:09.393509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0555f9-6464-4c07-bcb9-87b8aebd400f admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:09.393723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0555f9-6464-4c07-bcb9-87b8aebd400f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:09.394002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0555f9-6464-4c07-bcb9-87b8aebd400f admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:09.397481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0555f9-6464-4c07-bcb9-87b8aebd400f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:09.397481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0555f9-6464-4c07-bcb9-87b8aebd400f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:09.442781 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 969/1951] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:09 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:59:09.446770 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8f2dd-960e-4231-9d56-34156fada9d2 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:09.448361 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f9d8f2dd-960e-4231-9d56-34156fada9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:09.461315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8f2dd-960e-4231-9d56-34156fada9d2 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:09.468015 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515127c-75cf-4654-81c5-c7e1942cc12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:09.468772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515127c-75cf-4654-81c5-c7e1942cc12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:09.469177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515127c-75cf-4654-81c5-c7e1942cc12e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:09.469451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515127c-75cf-4654-81c5-c7e1942cc12e admin admin] PATH_INFO: `/v3/projects/f95b8cd6d7b8494cb731ba67420daaf9` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:09.470713 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515127c-75cf-4654-81c5-c7e1942cc12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95b8cd6d7b8494cb731ba67420daaf9)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:09.479978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515127c-75cf-4654-81c5-c7e1942cc12e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:09.480311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 983/1952] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:09 2022] POST /identity/v3/users => generated 301 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:09.480721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0555f9-6464-4c07-bcb9-87b8aebd400f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:09.491818 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0555f9-6464-4c07-bcb9-87b8aebd400f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:09.496722 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e70a22-5be4-4564-9c9f-7f430d113943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:09.497576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70a22-5be4-4564-9c9f-7f430d113943 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:09.498544 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70a22-5be4-4564-9c9f-7f430d113943 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:09.498890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70a22-5be4-4564-9c9f-7f430d113943 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:09.499721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e70a22-5be4-4564-9c9f-7f430d113943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:09.504436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e70a22-5be4-4564-9c9f-7f430d113943 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:09.514412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 984/1953] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:09 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:09.514412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e70a22-5be4-4564-9c9f-7f430d113943 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:09.525495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e70a22-5be4-4564-9c9f-7f430d113943 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:09.530295 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4bd4f-3c65-4e11-bf5c-9384c9ba3d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:09.530999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4bd4f-3c65-4e11-bf5c-9384c9ba3d84 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:09.531306 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4bd4f-3c65-4e11-bf5c-9384c9ba3d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:09.532148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4bd4f-3c65-4e11-bf5c-9384c9ba3d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:09.532952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4bd4f-3c65-4e11-bf5c-9384c9ba3d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:09.534500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4bd4f-3c65-4e11-bf5c-9384c9ba3d84 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:09.545155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 985/1954] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:09 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:09.545974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4bd4f-3c65-4e11-bf5c-9384c9ba3d84 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:09.556578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4bd4f-3c65-4e11-bf5c-9384c9ba3d84 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:09.561319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dfbc7-655c-40f0-8772-345fe8f035c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:09.561980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dfbc7-655c-40f0-8772-345fe8f035c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:09.562264 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dfbc7-655c-40f0-8772-345fe8f035c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:09.563306 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dfbc7-655c-40f0-8772-345fe8f035c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:09.564451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dfbc7-655c-40f0-8772-345fe8f035c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:09.566081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dfbc7-655c-40f0-8772-345fe8f035c8 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:09.579010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 986/1955] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:09 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:09.579010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dfbc7-655c-40f0-8772-345fe8f035c8 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:09.588112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dfbc7-655c-40f0-8772-345fe8f035c8 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:09.593340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b754e-d177-42db-841e-32f39abf0f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:09.594251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b754e-d177-42db-841e-32f39abf0f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:09.594664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b754e-d177-42db-841e-32f39abf0f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:09.594945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b754e-d177-42db-841e-32f39abf0f21 admin admin] PATH_INFO: `/v3/projects/e29e55468a484a32ac2136b16b48b5c7/users/b4b6a4f03db24ac8abcf7eec0ed9b894/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:09.612006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b754e-d177-42db-841e-32f39abf0f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29e55468a484a32ac2136b16b48b5c7, user_id=b4b6a4f03db24ac8abcf7eec0ed9b894, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:09.614721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b754e-d177-42db-841e-32f39abf0f21 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:09.712280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 987/1956] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:09 2022] PUT /identity/v3/projects/e29e55468a484a32ac2136b16b48b5c7/users/b4b6a4f03db24ac8abcf7eec0ed9b894/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:09.716459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b754e-d177-42db-841e-32f39abf0f21 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:09.721474 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-8515127c-75cf-4654-81c5-c7e1942cc12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95b8cd6d7b8494cb731ba67420daaf9', 'request_id': 'req-8515127c-75cf-4654-81c5-c7e1942cc12e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:09.788947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b754e-d177-42db-841e-32f39abf0f21 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:09.831653 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-8515127c-75cf-4654-81c5-c7e1942cc12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95b8cd6d7b8494cb731ba67420daaf9', 'request_id': 'req-8515127c-75cf-4654-81c5-c7e1942cc12e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:09.850982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-8515127c-75cf-4654-81c5-c7e1942cc12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95b8cd6d7b8494cb731ba67420daaf9', 'request_id': 'req-8515127c-75cf-4654-81c5-c7e1942cc12e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:09.884861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-8515127c-75cf-4654-81c5-c7e1942cc12e admin admin] The token cache is being invalidate because project f95b8cd6d7b8494cb731ba67420daaf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:09.885170 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-8515127c-75cf-4654-81c5-c7e1942cc12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:09.886636 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-8515127c-75cf-4654-81c5-c7e1942cc12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:09.888849 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 970/1957] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:09 2022] DELETE /identity/v3/projects/f95b8cd6d7b8494cb731ba67420daaf9 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:09.889989 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515127c-75cf-4654-81c5-c7e1942cc12e admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:09.896348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8515127c-75cf-4654-81c5-c7e1942cc12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:09.900658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea4e21-7b10-408a-9b7f-e837021f61e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:09.902092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea4e21-7b10-408a-9b7f-e837021f61e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:09.902410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea4e21-7b10-408a-9b7f-e837021f61e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:09.902692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea4e21-7b10-408a-9b7f-e837021f61e0 admin admin] PATH_INFO: `/v3/projects/3aecbb3e9bdc4df3bb9be6dbf4890f72/users/776d6f76451e463e95deb3a17177e36c/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:09.923036 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515127c-75cf-4654-81c5-c7e1942cc12e admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:09.929271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9a772-9075-4efd-ac7b-e1582d08416e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:09.930179 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9a772-9075-4efd-ac7b-e1582d08416e admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:09.930376 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9a772-9075-4efd-ac7b-e1582d08416e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:09.930751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9a772-9075-4efd-ac7b-e1582d08416e admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:09.931599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9a772-9075-4efd-ac7b-e1582d08416e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:09.933352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9a772-9075-4efd-ac7b-e1582d08416e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:09.939684 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea4e21-7b10-408a-9b7f-e837021f61e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aecbb3e9bdc4df3bb9be6dbf4890f72, user_id=776d6f76451e463e95deb3a17177e36c, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:09.948945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea4e21-7b10-408a-9b7f-e837021f61e0 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:09.950705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 971/1958] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:09 2022] GET /identity/v3/roles => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:09.951922 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69c720-38a6-4bd7-a4b1-b66c7ca28a20 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:09.952217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69c720-38a6-4bd7-a4b1-b66c7ca28a20 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:09.952500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69c720-38a6-4bd7-a4b1-b66c7ca28a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:09.958488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:09.989269 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-0c69c720-38a6-4bd7-a4b1-b66c7ca28a20 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:09.991423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0c69c720-38a6-4bd7-a4b1-b66c7ca28a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:10.011567 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 972/1959] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:10.012998 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69c720-38a6-4bd7-a4b1-b66c7ca28a20 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:10.042078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69c720-38a6-4bd7-a4b1-b66c7ca28a20 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:10.050045 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6d4b7-ad20-4f51-970f-e3b8839b6dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:10.050045 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6d4b7-ad20-4f51-970f-e3b8839b6dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:10.051089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6d4b7-ad20-4f51-970f-e3b8839b6dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:10.051089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6d4b7-ad20-4f51-970f-e3b8839b6dc3 admin admin] PATH_INFO: `/v3/projects/e29e55468a484a32ac2136b16b48b5c7/users/b4b6a4f03db24ac8abcf7eec0ed9b894/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:10.053661 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6d4b7-ad20-4f51-970f-e3b8839b6dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29e55468a484a32ac2136b16b48b5c7, user_id=b4b6a4f03db24ac8abcf7eec0ed9b894, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:10.057439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 988/1960] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:09 2022] PUT /identity/v3/projects/3aecbb3e9bdc4df3bb9be6dbf4890f72/users/776d6f76451e463e95deb3a17177e36c/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:10.058103 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6d4b7-ad20-4f51-970f-e3b8839b6dc3 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:10.069232 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76470e3-a525-4867-a7cb-28a4c4b13d71 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:10.069534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76470e3-a525-4867-a7cb-28a4c4b13d71 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:10.069813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76470e3-a525-4867-a7cb-28a4c4b13d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:10.072328 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 973/1961] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:10 2022] PUT /identity/v3/projects/e29e55468a484a32ac2136b16b48b5c7/users/b4b6a4f03db24ac8abcf7eec0ed9b894/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:10.077427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd39365-d169-4d27-8a9d-ca346ceac735 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:10.077427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd39365-d169-4d27-8a9d-ca346ceac735 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:10.077427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd39365-d169-4d27-8a9d-ca346ceac735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:10.098975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-a76470e3-a525-4867-a7cb-28a4c4b13d71 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:10.100187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a76470e3-a525-4867-a7cb-28a4c4b13d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:10.132181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-5dd39365-d169-4d27-8a9d-ca346ceac735 None None] MFA Rules not processed for user `776d6f76451e463e95deb3a17177e36c`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:10.133309 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5dd39365-d169-4d27-8a9d-ca346ceac735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:10.198866 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 989/1962] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:10.202263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5618db-9a5c-49c4-a1f6-27222e82d0cc None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:10.202263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5618db-9a5c-49c4-a1f6-27222e82d0cc None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:10.202263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5618db-9a5c-49c4-a1f6-27222e82d0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:10.215583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:10.243248 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-db5618db-9a5c-49c4-a1f6-27222e82d0cc None None] MFA Rules not processed for user `b4b6a4f03db24ac8abcf7eec0ed9b894`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:10.245476 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-db5618db-9a5c-49c4-a1f6-27222e82d0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:10.298191 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 974/1963] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:10.299763 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd39365-d169-4d27-8a9d-ca346ceac735 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:10.316012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd39365-d169-4d27-8a9d-ca346ceac735 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:10.324471 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d2278-1a6e-4796-a96f-873f7bbc5776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:10.326659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d2278-1a6e-4796-a96f-873f7bbc5776 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:10.327112 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d2278-1a6e-4796-a96f-873f7bbc5776 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:10.327660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d2278-1a6e-4796-a96f-873f7bbc5776 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:10.328830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d2278-1a6e-4796-a96f-873f7bbc5776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:59:10.329583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d2278-1a6e-4796-a96f-873f7bbc5776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:10.332705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d2278-1a6e-4796-a96f-873f7bbc5776 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:10.346370 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 990/1964] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:10.347498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5618db-9a5c-49c4-a1f6-27222e82d0cc None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:10.349504 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-db5618db-9a5c-49c4-a1f6-27222e82d0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:10.362534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 975/1965] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:59:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:59:10.364807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d2278-1a6e-4796-a96f-873f7bbc5776 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:10.367870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-187d2278-1a6e-4796-a96f-873f7bbc5776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:10.369430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5618db-9a5c-49c4-a1f6-27222e82d0cc None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:10.374068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18e980-53a2-4143-8773-45b764f41bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:10.374793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18e980-53a2-4143-8773-45b764f41bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:10.375164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18e980-53a2-4143-8773-45b764f41bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:10.375455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18e980-53a2-4143-8773-45b764f41bb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:10.376144 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18e980-53a2-4143-8773-45b764f41bb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:10.378161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18e980-53a2-4143-8773-45b764f41bb6 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:10.460940 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d2278-1a6e-4796-a96f-873f7bbc5776 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:10.465255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345c512-eee1-44a3-82f3-aff94792335b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:10.466909 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345c512-eee1-44a3-82f3-aff94792335b service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:10.467111 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345c512-eee1-44a3-82f3-aff94792335b service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:10.467352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345c512-eee1-44a3-82f3-aff94792335b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:10.478179 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 991/1966] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:10 2022] POST /identity/v3/projects => generated 378 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:10.479047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18e980-53a2-4143-8773-45b764f41bb6 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:10.483875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345c512-eee1-44a3-82f3-aff94792335b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:10.486144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345c512-eee1-44a3-82f3-aff94792335b service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:10.497486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 976/1967] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:10.498422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345c512-eee1-44a3-82f3-aff94792335b service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:10.512318 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345c512-eee1-44a3-82f3-aff94792335b service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:10.594763 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364c365-0dea-4927-ab93-d5931b94c1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:10.596958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18e980-53a2-4143-8773-45b764f41bb6 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:10.598643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364c365-0dea-4927-ab93-d5931b94c1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:10.598941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364c365-0dea-4927-ab93-d5931b94c1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:10.599636 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364c365-0dea-4927-ab93-d5931b94c1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:10.600534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364c365-0dea-4927-ab93-d5931b94c1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:10.604353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364c365-0dea-4927-ab93-d5931b94c1a0 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:10.612280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6b6f-44bb-4fc5-8970-afed6c685dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:10.613289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6b6f-44bb-4fc5-8970-afed6c685dbd admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:10.615043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6b6f-44bb-4fc5-8970-afed6c685dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:10.615043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6b6f-44bb-4fc5-8970-afed6c685dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:10.615043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a6b6f-44bb-4fc5-8970-afed6c685dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:10.618986 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a6b6f-44bb-4fc5-8970-afed6c685dbd admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:10.702358 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 977/1968] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:10 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:10.704146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364c365-0dea-4927-ab93-d5931b94c1a0 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:10.715920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364c365-0dea-4927-ab93-d5931b94c1a0 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:10.721858 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cdcee-b075-4ff0-9dd3-514048e3faa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:10.722890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cdcee-b075-4ff0-9dd3-514048e3faa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:10.723187 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cdcee-b075-4ff0-9dd3-514048e3faa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:10.723472 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cdcee-b075-4ff0-9dd3-514048e3faa7 admin admin] PATH_INFO: `/v3/users/a0ad49279c8d4512a16a025e7e36dc30` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:10.724727 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6cdcee-b075-4ff0-9dd3-514048e3faa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ad49279c8d4512a16a025e7e36dc30)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:10.726702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6cdcee-b075-4ff0-9dd3-514048e3faa7 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:10.750372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 992/1969] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:10 2022] POST /identity/v3/projects => generated 372 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:10.751315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6b6f-44bb-4fc5-8970-afed6c685dbd admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:10.816178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6b6f-44bb-4fc5-8970-afed6c685dbd admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:10.821124 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53c7ed-c35d-43a6-bae7-9bac0389aeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:10.821795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53c7ed-c35d-43a6-bae7-9bac0389aeae admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:10.822081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53c7ed-c35d-43a6-bae7-9bac0389aeae admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:10.822444 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53c7ed-c35d-43a6-bae7-9bac0389aeae admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:10.823159 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53c7ed-c35d-43a6-bae7-9bac0389aeae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:10.824750 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53c7ed-c35d-43a6-bae7-9bac0389aeae admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:10.835921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 993/1970] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:10 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:10.836998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53c7ed-c35d-43a6-bae7-9bac0389aeae admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:10.846905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53c7ed-c35d-43a6-bae7-9bac0389aeae admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:10.851647 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ba42a-ddea-4aa2-ae80-ea3934bf823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:10.852313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ba42a-ddea-4aa2-ae80-ea3934bf823f admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:10.852600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ba42a-ddea-4aa2-ae80-ea3934bf823f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:10.852882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ba42a-ddea-4aa2-ae80-ea3934bf823f admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:10.853578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ba42a-ddea-4aa2-ae80-ea3934bf823f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:10.855613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ba42a-ddea-4aa2-ae80-ea3934bf823f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:10.957458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 994/1971] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:10 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:10.958620 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ba42a-ddea-4aa2-ae80-ea3934bf823f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:10.970700 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ba42a-ddea-4aa2-ae80-ea3934bf823f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:10.975532 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87312df1-e8f8-47ca-b5b4-1dbe1f71d63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:10.976197 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87312df1-e8f8-47ca-b5b4-1dbe1f71d63e admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:10.976490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87312df1-e8f8-47ca-b5b4-1dbe1f71d63e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:10.976801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87312df1-e8f8-47ca-b5b4-1dbe1f71d63e admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:10.980402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87312df1-e8f8-47ca-b5b4-1dbe1f71d63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:10.981850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87312df1-e8f8-47ca-b5b4-1dbe1f71d63e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:10.994109 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9a6cdcee-b075-4ff0-9dd3-514048e3faa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ad49279c8d4512a16a025e7e36dc30'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:10.994989 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9a6cdcee-b075-4ff0-9dd3-514048e3faa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ad49279c8d4512a16a025e7e36dc30'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:10.995757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9a6cdcee-b075-4ff0-9dd3-514048e3faa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ad49279c8d4512a16a025e7e36dc30'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:10.999055 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 995/1972] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:10 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:10.999055 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87312df1-e8f8-47ca-b5b4-1dbe1f71d63e admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:10.999055 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-87312df1-e8f8-47ca-b5b4-1dbe1f71d63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:11.004567 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:11.012944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87312df1-e8f8-47ca-b5b4-1dbe1f71d63e admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:11.018294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09953eeb-ef26-4b5e-be92-2cbc2ef8b0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:11.019000 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09953eeb-ef26-4b5e-be92-2cbc2ef8b0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:11.019286 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09953eeb-ef26-4b5e-be92-2cbc2ef8b0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:11.019567 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09953eeb-ef26-4b5e-be92-2cbc2ef8b0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:11.020295 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09953eeb-ef26-4b5e-be92-2cbc2ef8b0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:11.021885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09953eeb-ef26-4b5e-be92-2cbc2ef8b0e8 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:11.032474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 996/1973] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:10 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:11.033357 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09953eeb-ef26-4b5e-be92-2cbc2ef8b0e8 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:11.035889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-09953eeb-ef26-4b5e-be92-2cbc2ef8b0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:11.048266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09953eeb-ef26-4b5e-be92-2cbc2ef8b0e8 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:11.053048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776e018-6247-4411-8276-d08e6d39eb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:11.054040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776e018-6247-4411-8276-d08e6d39eb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:11.054432 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776e018-6247-4411-8276-d08e6d39eb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:11.054718 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776e018-6247-4411-8276-d08e6d39eb8b admin admin] PATH_INFO: `/v3/projects/2000cba8a1d24fd7a6dcad4ee9fc0541/users/b6f9763094dd48b4a5755ad0623dbccf/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:11.071586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776e018-6247-4411-8276-d08e6d39eb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2000cba8a1d24fd7a6dcad4ee9fc0541, user_id=b6f9763094dd48b4a5755ad0623dbccf, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:11.074266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776e018-6247-4411-8276-d08e6d39eb8b admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:11.092574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9a6cdcee-b075-4ff0-9dd3-514048e3faa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ad49279c8d4512a16a025e7e36dc30'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:11.092854 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:11.112499 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9a6cdcee-b075-4ff0-9dd3-514048e3faa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ad49279c8d4512a16a025e7e36dc30'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:11.118993 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 978/1974] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:10 2022] DELETE /identity/v3/users/a0ad49279c8d4512a16a025e7e36dc30 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:11.122050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cdcee-b075-4ff0-9dd3-514048e3faa7 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:11.183592 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cdcee-b075-4ff0-9dd3-514048e3faa7 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:11.190443 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 997/1975] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:11 2022] PUT /identity/v3/projects/2000cba8a1d24fd7a6dcad4ee9fc0541/users/b6f9763094dd48b4a5755ad0623dbccf/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:11.191771 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e4793-77b2-4e23-8a5c-11e69555fb43 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:11.192060 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e4793-77b2-4e23-8a5c-11e69555fb43 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:11.192338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e4793-77b2-4e23-8a5c-11e69555fb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:11.214859 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e80e4793-77b2-4e23-8a5c-11e69555fb43 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:11.216086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e80e4793-77b2-4e23-8a5c-11e69555fb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:11.242880 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775369e6-5306-4a0f-9307-b0fa942b718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:11.243803 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775369e6-5306-4a0f-9307-b0fa942b718b admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:11.244091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775369e6-5306-4a0f-9307-b0fa942b718b admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:11.244368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775369e6-5306-4a0f-9307-b0fa942b718b admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:11.245088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775369e6-5306-4a0f-9307-b0fa942b718b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:11.246806 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775369e6-5306-4a0f-9307-b0fa942b718b admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:11.257073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 979/1976] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:11 2022] GET /identity/v3/roles => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:11.258399 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad214a5f-c1cd-40fa-9ad8-aff02d33209a None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:11.258689 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad214a5f-c1cd-40fa-9ad8-aff02d33209a None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:11.258969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad214a5f-c1cd-40fa-9ad8-aff02d33209a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:11.283450 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 998/1977] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:11.291107 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e4793-77b2-4e23-8a5c-11e69555fb43 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:11.291404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-ad214a5f-c1cd-40fa-9ad8-aff02d33209a None None] MFA Rules not processed for user `b6f9763094dd48b4a5755ad0623dbccf`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:11.292284 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-ad214a5f-c1cd-40fa-9ad8-aff02d33209a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:11.298706 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e4793-77b2-4e23-8a5c-11e69555fb43 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:11.303632 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af017981-6989-4bac-a3ef-a54ca6346a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:11.304436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af017981-6989-4bac-a3ef-a54ca6346a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:11.304720 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af017981-6989-4bac-a3ef-a54ca6346a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:11.304995 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af017981-6989-4bac-a3ef-a54ca6346a22 admin admin] PATH_INFO: `/v3/projects/eb5a2ad6b216427d8c44af04ada64a6e/users/8f289555872e4e30a73ed9b67584c89c/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:11.321698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af017981-6989-4bac-a3ef-a54ca6346a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb5a2ad6b216427d8c44af04ada64a6e, user_id=8f289555872e4e30a73ed9b67584c89c, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:11.324464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af017981-6989-4bac-a3ef-a54ca6346a22 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:11.350897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:11.363030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 980/1978] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:11.363781 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad214a5f-c1cd-40fa-9ad8-aff02d33209a None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:11.365050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-ad214a5f-c1cd-40fa-9ad8-aff02d33209a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:11.378641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad214a5f-c1cd-40fa-9ad8-aff02d33209a None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:11.383236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d260e-a7bd-4198-ba1b-3936bee79658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:11.384110 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d260e-a7bd-4198-ba1b-3936bee79658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:11.384393 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d260e-a7bd-4198-ba1b-3936bee79658 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:11.384669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d260e-a7bd-4198-ba1b-3936bee79658 admin admin] PATH_INFO: `/v3/users/841903d3842f4ad5a18c3c057f71b48f` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:11.385884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d260e-a7bd-4198-ba1b-3936bee79658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=841903d3842f4ad5a18c3c057f71b48f)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:11.387836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d260e-a7bd-4198-ba1b-3936bee79658 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:11.424506 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 999/1979] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:11 2022] PUT /identity/v3/projects/eb5a2ad6b216427d8c44af04ada64a6e/users/8f289555872e4e30a73ed9b67584c89c/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:11.425547 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af017981-6989-4bac-a3ef-a54ca6346a22 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:11.427384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-af017981-6989-4bac-a3ef-a54ca6346a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:11.458094 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:11.494070 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af017981-6989-4bac-a3ef-a54ca6346a22 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:11.497841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0bdb9-16e4-4e88-ae78-c79278fac2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:11.498542 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0bdb9-16e4-4e88-ae78-c79278fac2bb service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:11.498821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0bdb9-16e4-4e88-ae78-c79278fac2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:11.499120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0bdb9-16e4-4e88-ae78-c79278fac2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:11.574001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0bdb9-16e4-4e88-ae78-c79278fac2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:11.575727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0bdb9-16e4-4e88-ae78-c79278fac2bb service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:11.586931 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1000/1980] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:11.587902 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0bdb9-16e4-4e88-ae78-c79278fac2bb service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:11.598256 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0bdb9-16e4-4e88-ae78-c79278fac2bb service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:11.610800 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e66e0b-b555-4126-8b8a-beb703e708d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:11.611596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e66e0b-b555-4126-8b8a-beb703e708d3 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:11.611909 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e66e0b-b555-4126-8b8a-beb703e708d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:11.612314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e66e0b-b555-4126-8b8a-beb703e708d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:11.613011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e66e0b-b555-4126-8b8a-beb703e708d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:11.621154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e66e0b-b555-4126-8b8a-beb703e708d3 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:11.632079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-579d260e-a7bd-4198-ba1b-3936bee79658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841903d3842f4ad5a18c3c057f71b48f'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:11.634467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-579d260e-a7bd-4198-ba1b-3936bee79658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841903d3842f4ad5a18c3c057f71b48f'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:11.637303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-579d260e-a7bd-4198-ba1b-3936bee79658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841903d3842f4ad5a18c3c057f71b48f'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:11.780232 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1001/1981] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:11 2022] POST /identity/v3/projects => generated 374 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:11.782066 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c9f10-28ec-40a3-9326-f4feb3f59fac None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:11.782390 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c9f10-28ec-40a3-9326-f4feb3f59fac None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:11.782725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c9f10-28ec-40a3-9326-f4feb3f59fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:11.809773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-440c9f10-28ec-40a3-9326-f4feb3f59fac None None] MFA Rules not processed for user `8f289555872e4e30a73ed9b67584c89c`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:11.811011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-440c9f10-28ec-40a3-9326-f4feb3f59fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:11.814364 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-579d260e-a7bd-4198-ba1b-3936bee79658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841903d3842f4ad5a18c3c057f71b48f'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:11.832463 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-579d260e-a7bd-4198-ba1b-3936bee79658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841903d3842f4ad5a18c3c057f71b48f'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:11.854210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 981/1982] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:11 2022] DELETE /identity/v3/users/841903d3842f4ad5a18c3c057f71b48f => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:11.855443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d260e-a7bd-4198-ba1b-3936bee79658 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:11.857140 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-579d260e-a7bd-4198-ba1b-3936bee79658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:11.914905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1002/1983] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:11.917005 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955d8f-b0d2-4f5a-8b42-f0c2c0de01da None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:11.917450 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955d8f-b0d2-4f5a-8b42-f0c2c0de01da None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:11.917934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955d8f-b0d2-4f5a-8b42-f0c2c0de01da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:11.944905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-1a955d8f-b0d2-4f5a-8b42-f0c2c0de01da None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:11.946141 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1a955d8f-b0d2-4f5a-8b42-f0c2c0de01da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:11.958188 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:11.964331 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d260e-a7bd-4198-ba1b-3936bee79658 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:11.969534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e470a6f-c3d6-4081-9804-ee4dd6ee5fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:11.970264 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e470a6f-c3d6-4081-9804-ee4dd6ee5fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:11.970589 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e470a6f-c3d6-4081-9804-ee4dd6ee5fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:11.970868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e470a6f-c3d6-4081-9804-ee4dd6ee5fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:11.971804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e470a6f-c3d6-4081-9804-ee4dd6ee5fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:11.973580 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e470a6f-c3d6-4081-9804-ee4dd6ee5fd6 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:12.018645 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1003/1984] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:12.019519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955d8f-b0d2-4f5a-8b42-f0c2c0de01da None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:12.021526 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1a955d8f-b0d2-4f5a-8b42-f0c2c0de01da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:12.042160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:12.078026 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955d8f-b0d2-4f5a-8b42-f0c2c0de01da None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:12.083914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f7d92-88f7-402a-9397-3c98c191939e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf32c811ead4fd0b69c83890a56509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:12.083914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f7d92-88f7-402a-9397-3c98c191939e service glance] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:12.083914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f7d92-88f7-402a-9397-3c98c191939e service glance] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:12.083914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f7d92-88f7-402a-9397-3c98c191939e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:12.125668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 982/1985] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:11 2022] POST /identity/v3/users => generated 294 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:12.125668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e470a6f-c3d6-4081-9804-ee4dd6ee5fd6 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:12.125668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7e470a6f-c3d6-4081-9804-ee4dd6ee5fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:12.141196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f7d92-88f7-402a-9397-3c98c191939e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:12.142673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f7d92-88f7-402a-9397-3c98c191939e service glance] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:12.153711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1004/1986] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:12.155930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f7d92-88f7-402a-9397-3c98c191939e service glance] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:12.171358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f7d92-88f7-402a-9397-3c98c191939e service glance] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:12.175531 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242b793-7ac1-48ae-b3b0-f2ca9ba5ff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:12.176251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242b793-7ac1-48ae-b3b0-f2ca9ba5ff44 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:12.176544 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242b793-7ac1-48ae-b3b0-f2ca9ba5ff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:12.176826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242b793-7ac1-48ae-b3b0-f2ca9ba5ff44 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:12.177561 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242b793-7ac1-48ae-b3b0-f2ca9ba5ff44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:12.179376 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242b793-7ac1-48ae-b3b0-f2ca9ba5ff44 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:12.189185 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e470a6f-c3d6-4081-9804-ee4dd6ee5fd6 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:12.193900 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4d634-c718-4f6d-98b9-1e0bb57263d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:12.194607 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4d634-c718-4f6d-98b9-1e0bb57263d6 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:12.194899 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4d634-c718-4f6d-98b9-1e0bb57263d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:12.195198 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4d634-c718-4f6d-98b9-1e0bb57263d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:12.198852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1005/1987] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:12 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:12.200248 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242b793-7ac1-48ae-b3b0-f2ca9ba5ff44 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:12.207405 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4d634-c718-4f6d-98b9-1e0bb57263d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:12.213302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4d634-c718-4f6d-98b9-1e0bb57263d6 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:12.215716 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a242b793-7ac1-48ae-b3b0-f2ca9ba5ff44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:12.245637 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 983/1988] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:12.246690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4d634-c718-4f6d-98b9-1e0bb57263d6 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:12.250814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242b793-7ac1-48ae-b3b0-f2ca9ba5ff44 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:12.278472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1bacc-d28d-4c75-afc6-233fd68a4602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:12.278996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4d634-c718-4f6d-98b9-1e0bb57263d6 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:12.279098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1bacc-d28d-4c75-afc6-233fd68a4602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:12.279354 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1bacc-d28d-4c75-afc6-233fd68a4602 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:12.279773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1bacc-d28d-4c75-afc6-233fd68a4602 admin admin] PATH_INFO: `/v3/projects/1732d33d274f4644a99547982f97925b` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:12.284298 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1bacc-d28d-4c75-afc6-233fd68a4602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1732d33d274f4644a99547982f97925b)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:12.286275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1bacc-d28d-4c75-afc6-233fd68a4602 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:12.291996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391a4b7-8faf-479d-b194-4a767ca14a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:12.298779 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391a4b7-8faf-479d-b194-4a767ca14a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:12.298779 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391a4b7-8faf-479d-b194-4a767ca14a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:12.298779 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391a4b7-8faf-479d-b194-4a767ca14a5a admin admin] PATH_INFO: `/v3/projects/c52ef1f904a642b6af98cc1275cf1d4f/users/8296636be8bb4ef19ce57a50ebd0c1d9/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:12.318038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391a4b7-8faf-479d-b194-4a767ca14a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52ef1f904a642b6af98cc1275cf1d4f, user_id=8296636be8bb4ef19ce57a50ebd0c1d9, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:12.321818 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391a4b7-8faf-479d-b194-4a767ca14a5a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:12.413975 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 984/1989] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:12 2022] PUT /identity/v3/projects/c52ef1f904a642b6af98cc1275cf1d4f/users/8296636be8bb4ef19ce57a50ebd0c1d9/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:12.417855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391a4b7-8faf-479d-b194-4a767ca14a5a admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:12.465789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-7fa1bacc-d28d-4c75-afc6-233fd68a4602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1732d33d274f4644a99547982f97925b', 'request_id': 'req-7fa1bacc-d28d-4c75-afc6-233fd68a4602'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:12.507436 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391a4b7-8faf-479d-b194-4a767ca14a5a admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:12.574522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:12.575371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-7fa1bacc-d28d-4c75-afc6-233fd68a4602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1732d33d274f4644a99547982f97925b', 'request_id': 'req-7fa1bacc-d28d-4c75-afc6-233fd68a4602'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:12.587986 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-7fa1bacc-d28d-4c75-afc6-233fd68a4602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1732d33d274f4644a99547982f97925b', 'request_id': 'req-7fa1bacc-d28d-4c75-afc6-233fd68a4602'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:12.613737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-7fa1bacc-d28d-4c75-afc6-233fd68a4602 admin admin] The token cache is being invalidate because project 1732d33d274f4644a99547982f97925b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:12.614412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-7fa1bacc-d28d-4c75-afc6-233fd68a4602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:12.615289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-7fa1bacc-d28d-4c75-afc6-233fd68a4602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:12.618276 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d60640-a4b0-499a-972f-f1e972ea6dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:12.619294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d60640-a4b0-499a-972f-f1e972ea6dbb admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:12.619776 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d60640-a4b0-499a-972f-f1e972ea6dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:12.620202 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d60640-a4b0-499a-972f-f1e972ea6dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:12.623434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1006/1990] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:12 2022] DELETE /identity/v3/projects/1732d33d274f4644a99547982f97925b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:12.625630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1bacc-d28d-4c75-afc6-233fd68a4602 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:12.626167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d60640-a4b0-499a-972f-f1e972ea6dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:12.628210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d60640-a4b0-499a-972f-f1e972ea6dbb admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:12.630579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7fa1bacc-d28d-4c75-afc6-233fd68a4602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:12.660034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 985/1991] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:12 2022] GET /identity/v3/roles => generated 1427 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:12.663500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d60640-a4b0-499a-972f-f1e972ea6dbb admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:12.665483 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-c7d60640-a4b0-499a-972f-f1e972ea6dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:12.674812 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1bacc-d28d-4c75-afc6-233fd68a4602 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:12.682289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b290b9-8dcf-4ad7-af02-247be9aedcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:12.683231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d60640-a4b0-499a-972f-f1e972ea6dbb admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:12.683514 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b290b9-8dcf-4ad7-af02-247be9aedcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:12.683999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b290b9-8dcf-4ad7-af02-247be9aedcda admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:12.684448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b290b9-8dcf-4ad7-af02-247be9aedcda admin admin] PATH_INFO: `/v3/users/b4b6a4f03db24ac8abcf7eec0ed9b894` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:12.685942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b290b9-8dcf-4ad7-af02-247be9aedcda admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b6a4f03db24ac8abcf7eec0ed9b894)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:12.689004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b290b9-8dcf-4ad7-af02-247be9aedcda admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:12.692778 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe0b80-072e-41d3-90b8-1266adf809a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:12.693699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe0b80-072e-41d3-90b8-1266adf809a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:12.694078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe0b80-072e-41d3-90b8-1266adf809a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:12.694448 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe0b80-072e-41d3-90b8-1266adf809a5 admin admin] PATH_INFO: `/v3/projects/c52ef1f904a642b6af98cc1275cf1d4f/users/8296636be8bb4ef19ce57a50ebd0c1d9/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:12.697353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe0b80-072e-41d3-90b8-1266adf809a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52ef1f904a642b6af98cc1275cf1d4f, user_id=8296636be8bb4ef19ce57a50ebd0c1d9, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:12.699571 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe0b80-072e-41d3-90b8-1266adf809a5 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:12.712765 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 986/1992] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:12 2022] PUT /identity/v3/projects/c52ef1f904a642b6af98cc1275cf1d4f/users/8296636be8bb4ef19ce57a50ebd0c1d9/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:12.724304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776a5e0-7731-4d09-9c8f-fd6b72f81220 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:12.724599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776a5e0-7731-4d09-9c8f-fd6b72f81220 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:12.724940 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776a5e0-7731-4d09-9c8f-fd6b72f81220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:12.756520 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-8776a5e0-7731-4d09-9c8f-fd6b72f81220 None None] MFA Rules not processed for user `8296636be8bb4ef19ce57a50ebd0c1d9`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:12.757751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8776a5e0-7731-4d09-9c8f-fd6b72f81220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:12.832962 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 987/1993] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:12.995300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776a5e0-7731-4d09-9c8f-fd6b72f81220 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:12.995300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8776a5e0-7731-4d09-9c8f-fd6b72f81220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:13.074116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776a5e0-7731-4d09-9c8f-fd6b72f81220 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:13.076128 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-85b290b9-8dcf-4ad7-af02-247be9aedcda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b6a4f03db24ac8abcf7eec0ed9b894'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:13.077568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-85b290b9-8dcf-4ad7-af02-247be9aedcda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b6a4f03db24ac8abcf7eec0ed9b894'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:13.083792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0a916-0bed-4298-9529-4738b69bedd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:13.085290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0a916-0bed-4298-9529-4738b69bedd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:13.085748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0a916-0bed-4298-9529-4738b69bedd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:13.086047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0a916-0bed-4298-9529-4738b69bedd9 admin admin] PATH_INFO: `/v3/projects/357a2ce7ca30472eaad33132f44bd770` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:13.087323 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0a916-0bed-4298-9529-4738b69bedd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=357a2ce7ca30472eaad33132f44bd770)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:13.089335 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0a916-0bed-4298-9529-4738b69bedd9 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:13.094701 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-85b290b9-8dcf-4ad7-af02-247be9aedcda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b6a4f03db24ac8abcf7eec0ed9b894'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:13.237239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-85b290b9-8dcf-4ad7-af02-247be9aedcda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b6a4f03db24ac8abcf7eec0ed9b894'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:13.237492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:13.247959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-85b290b9-8dcf-4ad7-af02-247be9aedcda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b6a4f03db24ac8abcf7eec0ed9b894'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:13.255561 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1007/1994] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:12 2022] DELETE /identity/v3/users/b4b6a4f03db24ac8abcf7eec0ed9b894 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:13.260279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-23f0a916-0bed-4298-9529-4738b69bedd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357a2ce7ca30472eaad33132f44bd770', 'request_id': 'req-23f0a916-0bed-4298-9529-4738b69bedd9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:13.424193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-23f0a916-0bed-4298-9529-4738b69bedd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357a2ce7ca30472eaad33132f44bd770', 'request_id': 'req-23f0a916-0bed-4298-9529-4738b69bedd9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:13.447029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-23f0a916-0bed-4298-9529-4738b69bedd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357a2ce7ca30472eaad33132f44bd770', 'request_id': 'req-23f0a916-0bed-4298-9529-4738b69bedd9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:13.447832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b290b9-8dcf-4ad7-af02-247be9aedcda admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:13.450018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-85b290b9-8dcf-4ad7-af02-247be9aedcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:13.470195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-23f0a916-0bed-4298-9529-4738b69bedd9 admin admin] The token cache is being invalidate because project 357a2ce7ca30472eaad33132f44bd770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:13.470522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-23f0a916-0bed-4298-9529-4738b69bedd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:13.471900 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-23f0a916-0bed-4298-9529-4738b69bedd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:13.477330 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 988/1995] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:12 2022] DELETE /identity/v3/projects/357a2ce7ca30472eaad33132f44bd770 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:13.482982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0a916-0bed-4298-9529-4738b69bedd9 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:13.486945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-23f0a916-0bed-4298-9529-4738b69bedd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:13.547529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b290b9-8dcf-4ad7-af02-247be9aedcda admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:13.551494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83613804-1c80-4a99-9b7a-a852eec9fab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:13.553185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83613804-1c80-4a99-9b7a-a852eec9fab5 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:13.553480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83613804-1c80-4a99-9b7a-a852eec9fab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:13.553774 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83613804-1c80-4a99-9b7a-a852eec9fab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:13.556873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-83613804-1c80-4a99-9b7a-a852eec9fab5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:13.602389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:13.642662 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0a916-0bed-4298-9529-4738b69bedd9 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:13.686946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83613804-1c80-4a99-9b7a-a852eec9fab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:13.688597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83613804-1c80-4a99-9b7a-a852eec9fab5 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:13.713802 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1008/1996] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:13.782733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0becb-1122-404f-9547-117c8e9fb52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:13.783606 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0becb-1122-404f-9547-117c8e9fb52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:13.783892 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0becb-1122-404f-9547-117c8e9fb52b admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:13.784174 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0becb-1122-404f-9547-117c8e9fb52b admin admin] PATH_INFO: `/v3/users/60efc1eb42be44309a80db3a5f6548a3` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:13.785487 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0becb-1122-404f-9547-117c8e9fb52b admin admin] RBAC: Authorizing `identity:delete_user(user_id=60efc1eb42be44309a80db3a5f6548a3)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:13.787483 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0becb-1122-404f-9547-117c8e9fb52b admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:13.992827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83613804-1c80-4a99-9b7a-a852eec9fab5 service cinder] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:13.994351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-83613804-1c80-4a99-9b7a-a852eec9fab5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:14.011681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97c0becb-1122-404f-9547-117c8e9fb52b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60efc1eb42be44309a80db3a5f6548a3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:14.013070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97c0becb-1122-404f-9547-117c8e9fb52b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60efc1eb42be44309a80db3a5f6548a3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:14.020427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97c0becb-1122-404f-9547-117c8e9fb52b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60efc1eb42be44309a80db3a5f6548a3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:14.020712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83613804-1c80-4a99-9b7a-a852eec9fab5 service cinder] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:14.028590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb775170-c773-4bb7-bc51-22e9716bd9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:14.029612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb775170-c773-4bb7-bc51-22e9716bd9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:14.030224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb775170-c773-4bb7-bc51-22e9716bd9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:14.030634 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb775170-c773-4bb7-bc51-22e9716bd9aa admin admin] PATH_INFO: `/v3/projects/e29e55468a484a32ac2136b16b48b5c7` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:14.032585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb775170-c773-4bb7-bc51-22e9716bd9aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29e55468a484a32ac2136b16b48b5c7)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:14.034744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb775170-c773-4bb7-bc51-22e9716bd9aa admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:14.121439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97c0becb-1122-404f-9547-117c8e9fb52b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60efc1eb42be44309a80db3a5f6548a3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:14.144171 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97c0becb-1122-404f-9547-117c8e9fb52b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60efc1eb42be44309a80db3a5f6548a3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:14.170571 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 989/1997] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:13 2022] DELETE /identity/v3/users/60efc1eb42be44309a80db3a5f6548a3 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:14.184048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-eb775170-c773-4bb7-bc51-22e9716bd9aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29e55468a484a32ac2136b16b48b5c7', 'request_id': 'req-eb775170-c773-4bb7-bc51-22e9716bd9aa'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:14.334004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-eb775170-c773-4bb7-bc51-22e9716bd9aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29e55468a484a32ac2136b16b48b5c7', 'request_id': 'req-eb775170-c773-4bb7-bc51-22e9716bd9aa'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:14.341491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-eb775170-c773-4bb7-bc51-22e9716bd9aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29e55468a484a32ac2136b16b48b5c7', 'request_id': 'req-eb775170-c773-4bb7-bc51-22e9716bd9aa'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:14.355591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-eb775170-c773-4bb7-bc51-22e9716bd9aa admin admin] The token cache is being invalidate because project e29e55468a484a32ac2136b16b48b5c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:14.356032 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-eb775170-c773-4bb7-bc51-22e9716bd9aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:14.356784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-eb775170-c773-4bb7-bc51-22e9716bd9aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:14.358977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1009/1998] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:13 2022] DELETE /identity/v3/projects/e29e55468a484a32ac2136b16b48b5c7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:14.364019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fdc28-17f9-41d3-8639-7df0443eb954 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:14.364313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fdc28-17f9-41d3-8639-7df0443eb954 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:14.364599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fdc28-17f9-41d3-8639-7df0443eb954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:14.398390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-b53fdc28-17f9-41d3-8639-7df0443eb954 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:14.400086 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b53fdc28-17f9-41d3-8639-7df0443eb954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:14.506754 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 990/1999] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:14.513845 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8907c-1d76-4acb-ad5b-02346612d534 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:14.514407 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8907c-1d76-4acb-ad5b-02346612d534 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:14.514873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8907c-1d76-4acb-ad5b-02346612d534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:14.569893 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-4cc8907c-1d76-4acb-ad5b-02346612d534 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:14.569893 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-4cc8907c-1d76-4acb-ad5b-02346612d534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:14.585556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1010/2000] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:14.589639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fdc28-17f9-41d3-8639-7df0443eb954 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:14.601189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fdc28-17f9-41d3-8639-7df0443eb954 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:14.609236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec69eda-28b1-4218-a319-494561847118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:14.610395 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69eda-28b1-4218-a319-494561847118 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:14.610768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69eda-28b1-4218-a319-494561847118 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:14.611127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69eda-28b1-4218-a319-494561847118 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:14.611932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec69eda-28b1-4218-a319-494561847118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:59:14.612244 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec69eda-28b1-4218-a319-494561847118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:14.613911 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec69eda-28b1-4218-a319-494561847118 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:14.630768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 991/2001] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:59:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:59:14.633555 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8907c-1d76-4acb-ad5b-02346612d534 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:14.645041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8907c-1d76-4acb-ad5b-02346612d534 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:14.650016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8edadb-c82e-42a6-94d6-876b9534ed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:14.650721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8edadb-c82e-42a6-94d6-876b9534ed04 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:14.651006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8edadb-c82e-42a6-94d6-876b9534ed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:14.651282 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8edadb-c82e-42a6-94d6-876b9534ed04 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:14.651983 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8edadb-c82e-42a6-94d6-876b9534ed04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:14.654003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8edadb-c82e-42a6-94d6-876b9534ed04 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:14.784072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec69eda-28b1-4218-a319-494561847118 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:14.790593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-dec69eda-28b1-4218-a319-494561847118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:14.816198 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec69eda-28b1-4218-a319-494561847118 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:14.821730 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:14.822667 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:14.822958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:14.823239 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94 admin admin] PATH_INFO: `/v3/projects/0671ed6bd8054a44b74e4e41824ad235` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:14.824566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0671ed6bd8054a44b74e4e41824ad235)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:14.827318 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:14.840348 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1011/2002] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:14 2022] POST /identity/v3/projects => generated 380 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:59:14.845731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8edadb-c82e-42a6-94d6-876b9534ed04 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:14.959674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8edadb-c82e-42a6-94d6-876b9534ed04 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:14.965000 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc390e9-7200-4ee8-af72-e1e783ecf66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:14.965680 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc390e9-7200-4ee8-af72-e1e783ecf66a admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:14.966014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc390e9-7200-4ee8-af72-e1e783ecf66a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:14.966302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc390e9-7200-4ee8-af72-e1e783ecf66a admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:14.967029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc390e9-7200-4ee8-af72-e1e783ecf66a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:14.969278 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc390e9-7200-4ee8-af72-e1e783ecf66a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:15.049775 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0671ed6bd8054a44b74e4e41824ad235', 'request_id': 'req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:15.076595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1012/2003] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:14 2022] POST /identity/v3/users => generated 291 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:15.082411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc390e9-7200-4ee8-af72-e1e783ecf66a admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:15.094250 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc390e9-7200-4ee8-af72-e1e783ecf66a admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:15.167561 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bde77-1140-46db-b809-a4282463ec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:15.168236 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bde77-1140-46db-b809-a4282463ec1c admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:15.168525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bde77-1140-46db-b809-a4282463ec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:15.168809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bde77-1140-46db-b809-a4282463ec1c admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:15.169578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bde77-1140-46db-b809-a4282463ec1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:15.171205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bde77-1140-46db-b809-a4282463ec1c admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:15.185292 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1013/2004] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:15 2022] GET /identity/v3/roles => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:59:15.185932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0671ed6bd8054a44b74e4e41824ad235', 'request_id': 'req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:15.188305 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bde77-1140-46db-b809-a4282463ec1c admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:15.193213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0671ed6bd8054a44b74e4e41824ad235', 'request_id': 'req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:15.204225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bde77-1140-46db-b809-a4282463ec1c admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:15.211652 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33ed6d-52f9-4af8-a718-3d4fe9b2de73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:15.212342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33ed6d-52f9-4af8-a718-3d4fe9b2de73 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:15.212628 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33ed6d-52f9-4af8-a718-3d4fe9b2de73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:15.212910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33ed6d-52f9-4af8-a718-3d4fe9b2de73 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:15.213654 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33ed6d-52f9-4af8-a718-3d4fe9b2de73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:15.215380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33ed6d-52f9-4af8-a718-3d4fe9b2de73 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:15.221161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94 admin admin] The token cache is being invalidate because project 0671ed6bd8054a44b74e4e41824ad235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:15.221462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:15.222150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:15.223890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 992/2005] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:14 2022] DELETE /identity/v3/projects/0671ed6bd8054a44b74e4e41824ad235 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:15.226887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1014/2006] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:15 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:15.231354 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:15.232090 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f66a9-a94a-43bf-a704-28b91e972ebe None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:15.232387 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f66a9-a94a-43bf-a704-28b91e972ebe None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:15.232665 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f66a9-a94a-43bf-a704-28b91e972ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:15.238041 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:15.253960 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328b190-6c2d-4c7c-a04a-e6af39d1fd94 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:15.254864 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-cd6f66a9-a94a-43bf-a704-28b91e972ebe None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:15.256092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-cd6f66a9-a94a-43bf-a704-28b91e972ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:15.259373 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94902872-6be5-47d9-b602-893281796e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:15.259895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:15.260341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94902872-6be5-47d9-b602-893281796e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:15.261718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94902872-6be5-47d9-b602-893281796e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:15.261718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94902872-6be5-47d9-b602-893281796e0b admin admin] PATH_INFO: `/v3/projects/277561a2a8fd4feca618d10c537960f5/users/3e88f4aafae845cfa379a58f37780f30/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:15.268319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1015/2007] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:15.276459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c24404-81c1-4879-b001-a53037f219bd None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:15.276742 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94902872-6be5-47d9-b602-893281796e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=277561a2a8fd4feca618d10c537960f5, user_id=3e88f4aafae845cfa379a58f37780f30, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:15.276851 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c24404-81c1-4879-b001-a53037f219bd None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:15.277019 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c24404-81c1-4879-b001-a53037f219bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:15.279876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94902872-6be5-47d9-b602-893281796e0b admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:15.297568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-70c24404-81c1-4879-b001-a53037f219bd None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:15.298933 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-70c24404-81c1-4879-b001-a53037f219bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:15.307081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1016/2008] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:15.311438 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c24404-81c1-4879-b001-a53037f219bd None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:15.321596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c24404-81c1-4879-b001-a53037f219bd None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:15.327593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df5096-9870-44e0-a258-18b2a4c22419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:15.328413 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df5096-9870-44e0-a258-18b2a4c22419 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:15.330650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df5096-9870-44e0-a258-18b2a4c22419 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:15.330650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df5096-9870-44e0-a258-18b2a4c22419 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:15.330650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df5096-9870-44e0-a258-18b2a4c22419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:59:15.330650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df5096-9870-44e0-a258-18b2a4c22419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:15.332119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df5096-9870-44e0-a258-18b2a4c22419 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:15.348134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1017/2009] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:59:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:59:15.349521 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df5096-9870-44e0-a258-18b2a4c22419 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:15.356146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:15.360455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df5096-9870-44e0-a258-18b2a4c22419 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:15.365370 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979673d-6e14-4198-b499-263dd34a0e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:15.366035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979673d-6e14-4198-b499-263dd34a0e46 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:15.366315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979673d-6e14-4198-b499-263dd34a0e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:15.366622 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979673d-6e14-4198-b499-263dd34a0e46 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:15.367315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979673d-6e14-4198-b499-263dd34a0e46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:15.369211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979673d-6e14-4198-b499-263dd34a0e46 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:15.413894 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 993/2010] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:15 2022] PUT /identity/v3/projects/277561a2a8fd4feca618d10c537960f5/users/3e88f4aafae845cfa379a58f37780f30/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:15.425699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e4388-2ca8-44a1-9aec-2ebe4b6c696f None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:15.426117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e4388-2ca8-44a1-9aec-2ebe4b6c696f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:15.426459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e4388-2ca8-44a1-9aec-2ebe4b6c696f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:15.454720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-ca6e4388-2ca8-44a1-9aec-2ebe4b6c696f None None] MFA Rules not processed for user `3e88f4aafae845cfa379a58f37780f30`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:15.456068 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-ca6e4388-2ca8-44a1-9aec-2ebe4b6c696f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:15.500909 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1018/2011] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:15 2022] POST /identity/v3/projects => generated 376 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:15.505213 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979673d-6e14-4198-b499-263dd34a0e46 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:15.531775 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 994/2012] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:15.540298 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e4388-2ca8-44a1-9aec-2ebe4b6c696f None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:15.572277 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979673d-6e14-4198-b499-263dd34a0e46 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:15.579561 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a4df8-e912-4d0d-8334-691344e77d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:15.580488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4df8-e912-4d0d-8334-691344e77d43 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:15.580924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4df8-e912-4d0d-8334-691344e77d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:15.581214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4df8-e912-4d0d-8334-691344e77d43 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:15.582213 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a4df8-e912-4d0d-8334-691344e77d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:15.584416 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a4df8-e912-4d0d-8334-691344e77d43 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:15.611172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e4388-2ca8-44a1-9aec-2ebe4b6c696f None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:15.616474 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f944bf-d3dd-47fb-9a01-4272c6d014d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:15.617414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f944bf-d3dd-47fb-9a01-4272c6d014d3 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:15.617771 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f944bf-d3dd-47fb-9a01-4272c6d014d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:15.618173 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f944bf-d3dd-47fb-9a01-4272c6d014d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:15.618987 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f944bf-d3dd-47fb-9a01-4272c6d014d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:15.626353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f944bf-d3dd-47fb-9a01-4272c6d014d3 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:15.700147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1019/2013] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:15 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:59:15.704220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a4df8-e912-4d0d-8334-691344e77d43 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:15.714996 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a4df8-e912-4d0d-8334-691344e77d43 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:15.728277 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba510a-ee8d-4e63-94e4-211c7e5ba53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:15.730188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 995/2014] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:15 2022] POST /identity/v3/projects => generated 382 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:59:15.731335 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba510a-ee8d-4e63-94e4-211c7e5ba53d admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:15.731686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba510a-ee8d-4e63-94e4-211c7e5ba53d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:15.731908 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba510a-ee8d-4e63-94e4-211c7e5ba53d admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:15.732647 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba510a-ee8d-4e63-94e4-211c7e5ba53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:15.734859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f944bf-d3dd-47fb-9a01-4272c6d014d3 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:15.736799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba510a-ee8d-4e63-94e4-211c7e5ba53d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:15.756278 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1020/2015] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:15 2022] GET /identity/v3/roles => generated 1427 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:59:15.759226 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba510a-ee8d-4e63-94e4-211c7e5ba53d admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:15.771963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba510a-ee8d-4e63-94e4-211c7e5ba53d admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:15.840949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f944bf-d3dd-47fb-9a01-4272c6d014d3 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:15.846604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564a2ee-49d2-4a56-8e19-5bbd4cc77de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:15.847321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564a2ee-49d2-4a56-8e19-5bbd4cc77de7 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:15.847609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564a2ee-49d2-4a56-8e19-5bbd4cc77de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:15.847917 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564a2ee-49d2-4a56-8e19-5bbd4cc77de7 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:15.848759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564a2ee-49d2-4a56-8e19-5bbd4cc77de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:15.850866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564a2ee-49d2-4a56-8e19-5bbd4cc77de7 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:15.855129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500cf90-0730-41b0-8eaf-17fa9367ccc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:15.855881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500cf90-0730-41b0-8eaf-17fa9367ccc7 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:15.856241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500cf90-0730-41b0-8eaf-17fa9367ccc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:15.856593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500cf90-0730-41b0-8eaf-17fa9367ccc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:15.857687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500cf90-0730-41b0-8eaf-17fa9367ccc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:15.859792 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500cf90-0730-41b0-8eaf-17fa9367ccc7 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:15.871985 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1021/2016] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:15 2022] GET /identity/v3/roles => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:59:15.876775 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500cf90-0730-41b0-8eaf-17fa9367ccc7 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:15.891172 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500cf90-0730-41b0-8eaf-17fa9367ccc7 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:15.900177 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37fa30-3785-48e1-9f0f-5eb5558e1f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:15.900328 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37fa30-3785-48e1-9f0f-5eb5558e1f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:15.900613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37fa30-3785-48e1-9f0f-5eb5558e1f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:15.900897 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37fa30-3785-48e1-9f0f-5eb5558e1f42 admin admin] PATH_INFO: `/v3/projects/cb5015c95bdb4df398b7fbb87a9d7911/users/265c5705341f4d189c182c7f25247c29/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:15.936098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37fa30-3785-48e1-9f0f-5eb5558e1f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5015c95bdb4df398b7fbb87a9d7911, user_id=265c5705341f4d189c182c7f25247c29, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:15.939022 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37fa30-3785-48e1-9f0f-5eb5558e1f42 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:16.003389 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 996/2017] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:15 2022] POST /identity/v3/users => generated 298 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:59:16.005678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564a2ee-49d2-4a56-8e19-5bbd4cc77de7 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:16.016363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564a2ee-49d2-4a56-8e19-5bbd4cc77de7 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:16.021072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3276ba8-efd7-4c35-9233-13a69a95c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:16.021727 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3276ba8-efd7-4c35-9233-13a69a95c2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:16.022021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3276ba8-efd7-4c35-9233-13a69a95c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:16.022303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3276ba8-efd7-4c35-9233-13a69a95c2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:16.023071 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3276ba8-efd7-4c35-9233-13a69a95c2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:16.024673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3276ba8-efd7-4c35-9233-13a69a95c2e5 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:16.035288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 997/2018] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:16 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:59:16.039395 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3276ba8-efd7-4c35-9233-13a69a95c2e5 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:16.051212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3276ba8-efd7-4c35-9233-13a69a95c2e5 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:16.055767 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1022/2019] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:15 2022] PUT /identity/v3/projects/cb5015c95bdb4df398b7fbb87a9d7911/users/265c5705341f4d189c182c7f25247c29/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:16.067815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52828db0-11ac-45a8-aa64-c14724090c4a None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:16.068031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52828db0-11ac-45a8-aa64-c14724090c4a None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:16.068732 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52828db0-11ac-45a8-aa64-c14724090c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:16.098199 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-52828db0-11ac-45a8-aa64-c14724090c4a None None] MFA Rules not processed for user `265c5705341f4d189c182c7f25247c29`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:16.099458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-52828db0-11ac-45a8-aa64-c14724090c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:16.110854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdef717-96c4-41a7-b68f-29fe0228e9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:16.111762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdef717-96c4-41a7-b68f-29fe0228e9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:16.112049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdef717-96c4-41a7-b68f-29fe0228e9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:16.112329 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdef717-96c4-41a7-b68f-29fe0228e9b9 admin admin] PATH_INFO: `/v3/projects/0f1bf51a1a1b4a0b899b97aee4ec3695/users/536a2205238740b9a6cf37a66cc60a32/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:16.127206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdef717-96c4-41a7-b68f-29fe0228e9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1bf51a1a1b4a0b899b97aee4ec3695, user_id=536a2205238740b9a6cf37a66cc60a32, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:16.129889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdef717-96c4-41a7-b68f-29fe0228e9b9 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:16.166146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1023/2020] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:16.182746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52828db0-11ac-45a8-aa64-c14724090c4a None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:16.184244 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-52828db0-11ac-45a8-aa64-c14724090c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:16.219678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 998/2021] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:16 2022] PUT /identity/v3/projects/0f1bf51a1a1b4a0b899b97aee4ec3695/users/536a2205238740b9a6cf37a66cc60a32/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:16.223716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdef717-96c4-41a7-b68f-29fe0228e9b9 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:16.260024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52828db0-11ac-45a8-aa64-c14724090c4a None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:16.292922 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdef717-96c4-41a7-b68f-29fe0228e9b9 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:16.299093 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eca8de-7a39-4094-ab4e-254c3674a801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:16.299776 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eca8de-7a39-4094-ab4e-254c3674a801 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:16.300064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eca8de-7a39-4094-ab4e-254c3674a801 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:16.301183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eca8de-7a39-4094-ab4e-254c3674a801 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:16.301183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eca8de-7a39-4094-ab4e-254c3674a801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:16.302739 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eca8de-7a39-4094-ab4e-254c3674a801 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:16.314506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 999/2022] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:16 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:59:16.317793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eca8de-7a39-4094-ab4e-254c3674a801 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:16.329570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b0e82-7c1c-4966-9764-ddfe7ccb2138 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf32c811ead4fd0b69c83890a56509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:16.330627 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b0e82-7c1c-4966-9764-ddfe7ccb2138 service glance] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:16.330627 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b0e82-7c1c-4966-9764-ddfe7ccb2138 service glance] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:16.330936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b0e82-7c1c-4966-9764-ddfe7ccb2138 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:16.333115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eca8de-7a39-4094-ab4e-254c3674a801 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:16.339953 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca7159-6331-4d6e-aa13-5a7ac7e29021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:16.340861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca7159-6331-4d6e-aa13-5a7ac7e29021 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:16.341180 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca7159-6331-4d6e-aa13-5a7ac7e29021 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:16.342108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca7159-6331-4d6e-aa13-5a7ac7e29021 admin admin] PATH_INFO: `/v3/projects/0f1bf51a1a1b4a0b899b97aee4ec3695/users/536a2205238740b9a6cf37a66cc60a32/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:16.344698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca7159-6331-4d6e-aa13-5a7ac7e29021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1bf51a1a1b4a0b899b97aee4ec3695, user_id=536a2205238740b9a6cf37a66cc60a32, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:16.347481 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca7159-6331-4d6e-aa13-5a7ac7e29021 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:16.357988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1000/2023] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:16 2022] PUT /identity/v3/projects/0f1bf51a1a1b4a0b899b97aee4ec3695/users/536a2205238740b9a6cf37a66cc60a32/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:16.369361 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7534b2-9419-43e5-9aa1-79a89dc5a645 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:16.369361 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7534b2-9419-43e5-9aa1-79a89dc5a645 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:16.369999 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7534b2-9419-43e5-9aa1-79a89dc5a645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:16.397295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-de7534b2-9419-43e5-9aa1-79a89dc5a645 None None] MFA Rules not processed for user `536a2205238740b9a6cf37a66cc60a32`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:16.398582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-de7534b2-9419-43e5-9aa1-79a89dc5a645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:16.399706 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b0e82-7c1c-4966-9764-ddfe7ccb2138 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:16.401159 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b0e82-7c1c-4966-9764-ddfe7ccb2138 service glance] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:16.412059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1024/2024] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:59:16.476384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1001/2025] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:16.488466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b0e82-7c1c-4966-9764-ddfe7ccb2138 service glance] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:16.489936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-739b0e82-7c1c-4966-9764-ddfe7ccb2138 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:16.550429 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b0e82-7c1c-4966-9764-ddfe7ccb2138 service glance] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:16.602998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357b4a8-a0bc-4b6a-9fa5-63ddc11659ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:16.603673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357b4a8-a0bc-4b6a-9fa5-63ddc11659ef service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:16.604033 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357b4a8-a0bc-4b6a-9fa5-63ddc11659ef service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:16.604313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357b4a8-a0bc-4b6a-9fa5-63ddc11659ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:16.613821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357b4a8-a0bc-4b6a-9fa5-63ddc11659ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:16.615323 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357b4a8-a0bc-4b6a-9fa5-63ddc11659ef service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:16.625260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1025/2026] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:17.087580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:17.173275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:17.753336 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7534b2-9419-43e5-9aa1-79a89dc5a645 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:17.754787 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-de7534b2-9419-43e5-9aa1-79a89dc5a645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:17.767393 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7534b2-9419-43e5-9aa1-79a89dc5a645 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:17.771083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9e524-4357-4fb3-92b7-79e0530365ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:17.771694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9e524-4357-4fb3-92b7-79e0530365ae service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:17.772004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9e524-4357-4fb3-92b7-79e0530365ae service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:17.772271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9e524-4357-4fb3-92b7-79e0530365ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:17.774074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-56d9e524-4357-4fb3-92b7-79e0530365ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:17.839093 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9e524-4357-4fb3-92b7-79e0530365ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:17.840643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9e524-4357-4fb3-92b7-79e0530365ae service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:17.849662 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1002/2027] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:59:17.962252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357b4a8-a0bc-4b6a-9fa5-63ddc11659ef service cinder] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:17.969250 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357b4a8-a0bc-4b6a-9fa5-63ddc11659ef service cinder] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:17.973540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e49b-1f2a-4b4d-abef-53b5518909aa tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536a2205238740b9a6cf37a66cc60a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1bf51a1a1b4a0b899b97aee4ec3695', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:17.974191 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e49b-1f2a-4b4d-abef-53b5518909aa tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:17.974508 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e49b-1f2a-4b4d-abef-53b5518909aa tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:17.974790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e49b-1f2a-4b4d-abef-53b5518909aa tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:17.975535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19e49b-1f2a-4b4d-abef-53b5518909aa tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:59:17.975841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19e49b-1f2a-4b4d-abef-53b5518909aa tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:17.977484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19e49b-1f2a-4b4d-abef-53b5518909aa tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:17.991986 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1026/2028] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:59:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:59:17.995956 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9e524-4357-4fb3-92b7-79e0530365ae service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:18.007682 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9e524-4357-4fb3-92b7-79e0530365ae service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:18.012221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124f50-ba82-43f7-bb24-3bfa968b2b51 tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536a2205238740b9a6cf37a66cc60a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1bf51a1a1b4a0b899b97aee4ec3695', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:18.012871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124f50-ba82-43f7-bb24-3bfa968b2b51 tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:18.013160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124f50-ba82-43f7-bb24-3bfa968b2b51 tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:18.013441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124f50-ba82-43f7-bb24-3bfa968b2b51 tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:18.014127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a124f50-ba82-43f7-bb24-3bfa968b2b51 tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:18.016376 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a124f50-ba82-43f7-bb24-3bfa968b2b51 tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:18.117427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1003/2029] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:17 2022] POST /identity/v3/projects => generated 354 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:59:18.121573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e49b-1f2a-4b4d-abef-53b5518909aa tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:18.132458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e49b-1f2a-4b4d-abef-53b5518909aa tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:18.193095 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c966d1-aad0-46cb-b9f6-22bf63183c9c tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536a2205238740b9a6cf37a66cc60a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1bf51a1a1b4a0b899b97aee4ec3695', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:18.193862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c966d1-aad0-46cb-b9f6-22bf63183c9c tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:18.194217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c966d1-aad0-46cb-b9f6-22bf63183c9c tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:18.194531 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c966d1-aad0-46cb-b9f6-22bf63183c9c tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:18.195346 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c966d1-aad0-46cb-b9f6-22bf63183c9c tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:59:18.195700 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c966d1-aad0-46cb-b9f6-22bf63183c9c tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:18.197363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c966d1-aad0-46cb-b9f6-22bf63183c9c tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:18.214749 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1027/2030] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:59:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:59:18.255490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124f50-ba82-43f7-bb24-3bfa968b2b51 tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:18.266100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124f50-ba82-43f7-bb24-3bfa968b2b51 tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:18.271007 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536a2205238740b9a6cf37a66cc60a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1bf51a1a1b4a0b899b97aee4ec3695', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:18.271951 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:18.272249 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:18.272533 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] PATH_INFO: `/v3/projects/249bc4990d97440fa03ef89c5b18f74e` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:18.273726 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] RBAC: Authorizing `identity:delete_project(project_id=249bc4990d97440fa03ef89c5b18f74e)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:18.275724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:18.480132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249bc4990d97440fa03ef89c5b18f74e', 'request_id': 'req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:18.597538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249bc4990d97440fa03ef89c5b18f74e', 'request_id': 'req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:18.605552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249bc4990d97440fa03ef89c5b18f74e', 'request_id': 'req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:18.623169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] The token cache is being invalidate because project 249bc4990d97440fa03ef89c5b18f74e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:18.623897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:18.625015 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:18.627026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1004/2031] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:18 2022] DELETE /identity/v3/projects/249bc4990d97440fa03ef89c5b18f74e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:18.847291 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:19.241889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:19.314959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c966d1-aad0-46cb-b9f6-22bf63183c9c tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:19.316745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-67c966d1-aad0-46cb-b9f6-22bf63183c9c tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:19.384945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c966d1-aad0-46cb-b9f6-22bf63183c9c tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:19.449122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6012dc5-3704-4ddc-9640-40dffc2d1503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:19.450011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6012dc5-3704-4ddc-9640-40dffc2d1503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:19.450348 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6012dc5-3704-4ddc-9640-40dffc2d1503 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:19.450603 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6012dc5-3704-4ddc-9640-40dffc2d1503 admin admin] PATH_INFO: `/v3/users/3e88f4aafae845cfa379a58f37780f30` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:19.451884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6012dc5-3704-4ddc-9640-40dffc2d1503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e88f4aafae845cfa379a58f37780f30)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:19.455264 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6012dc5-3704-4ddc-9640-40dffc2d1503 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:19.680092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f6012dc5-3704-4ddc-9640-40dffc2d1503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e88f4aafae845cfa379a58f37780f30'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:19.680980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f6012dc5-3704-4ddc-9640-40dffc2d1503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e88f4aafae845cfa379a58f37780f30'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:19.689230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:19.690673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:19.697252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f6012dc5-3704-4ddc-9640-40dffc2d1503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e88f4aafae845cfa379a58f37780f30'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:19.757929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348411d7-5d4e-4af6-ad32-3831a7ca6c2e tempest-VolumeQuotaClassesTest-1980616063 tempest-VolumeQuotaClassesTest-1980616063-project-admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:19.762021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71dd39-91f7-43ae-a778-132ecb61df32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:19.762716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71dd39-91f7-43ae-a778-132ecb61df32 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:19.763034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71dd39-91f7-43ae-a778-132ecb61df32 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:19.763352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71dd39-91f7-43ae-a778-132ecb61df32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:19.765127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-da71dd39-91f7-43ae-a778-132ecb61df32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:19.807171 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f6012dc5-3704-4ddc-9640-40dffc2d1503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e88f4aafae845cfa379a58f37780f30'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:19.816969 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f6012dc5-3704-4ddc-9640-40dffc2d1503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e88f4aafae845cfa379a58f37780f30'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:19.826724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1028/2032] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:19 2022] DELETE /identity/v3/users/3e88f4aafae845cfa379a58f37780f30 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:19.829952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe71581-ec5a-461c-b021-f7fd1589578c None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:19.829952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe71581-ec5a-461c-b021-f7fd1589578c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:19.829952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe71581-ec5a-461c-b021-f7fd1589578c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:19.839126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71dd39-91f7-43ae-a778-132ecb61df32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:19.840973 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71dd39-91f7-43ae-a778-132ecb61df32 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:19.844120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:19.850158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-1fe71581-ec5a-461c-b021-f7fd1589578c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:19.855169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1fe71581-ec5a-461c-b021-f7fd1589578c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:19.868033 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1005/2033] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:59:19.911302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:19.944857 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1029/2034] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:19.945076 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71dd39-91f7-43ae-a778-132ecb61df32 service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:19.945076 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-da71dd39-91f7-43ae-a778-132ecb61df32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:20.010755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71dd39-91f7-43ae-a778-132ecb61df32 service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:20.072794 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49eeff-fd7e-4278-a36d-0e81230dfc1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:20.073628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49eeff-fd7e-4278-a36d-0e81230dfc1f service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:20.074036 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49eeff-fd7e-4278-a36d-0e81230dfc1f service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:20.074541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49eeff-fd7e-4278-a36d-0e81230dfc1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:20.086738 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49eeff-fd7e-4278-a36d-0e81230dfc1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:20.089184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49eeff-fd7e-4278-a36d-0e81230dfc1f service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:20.105005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1006/2035] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:59:20.609786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe71581-ec5a-461c-b021-f7fd1589578c None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:20.612085 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1fe71581-ec5a-461c-b021-f7fd1589578c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:20.628472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe71581-ec5a-461c-b021-f7fd1589578c None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:20.642299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d491ad0-f989-450d-b725-d42526d5c79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:20.644314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d491ad0-f989-450d-b725-d42526d5c79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:20.645255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d491ad0-f989-450d-b725-d42526d5c79e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:20.645756 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d491ad0-f989-450d-b725-d42526d5c79e admin admin] PATH_INFO: `/v3/projects/277561a2a8fd4feca618d10c537960f5` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:20.647762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d491ad0-f989-450d-b725-d42526d5c79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=277561a2a8fd4feca618d10c537960f5)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:20.649840 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d491ad0-f989-450d-b725-d42526d5c79e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:20.727968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:20.803678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-2d491ad0-f989-450d-b725-d42526d5c79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277561a2a8fd4feca618d10c537960f5', 'request_id': 'req-2d491ad0-f989-450d-b725-d42526d5c79e'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:20.904292 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-2d491ad0-f989-450d-b725-d42526d5c79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277561a2a8fd4feca618d10c537960f5', 'request_id': 'req-2d491ad0-f989-450d-b725-d42526d5c79e'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:20.912408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-2d491ad0-f989-450d-b725-d42526d5c79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277561a2a8fd4feca618d10c537960f5', 'request_id': 'req-2d491ad0-f989-450d-b725-d42526d5c79e'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:20.924097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-2d491ad0-f989-450d-b725-d42526d5c79e admin admin] The token cache is being invalidate because project 277561a2a8fd4feca618d10c537960f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:20.924387 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-2d491ad0-f989-450d-b725-d42526d5c79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:20.925086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-2d491ad0-f989-450d-b725-d42526d5c79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:20.926693 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1030/2036] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:20 2022] DELETE /identity/v3/projects/277561a2a8fd4feca618d10c537960f5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:20.930768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49eeff-fd7e-4278-a36d-0e81230dfc1f service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:20.941534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49eeff-fd7e-4278-a36d-0e81230dfc1f service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:21.003114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51f2dd-3c95-4a4a-a2bc-c8d4372b3af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:21.003919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51f2dd-3c95-4a4a-a2bc-c8d4372b3af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:21.004205 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51f2dd-3c95-4a4a-a2bc-c8d4372b3af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:21.004486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51f2dd-3c95-4a4a-a2bc-c8d4372b3af7 admin admin] PATH_INFO: `/v3/users/536a2205238740b9a6cf37a66cc60a32` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:21.005743 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51f2dd-3c95-4a4a-a2bc-c8d4372b3af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=536a2205238740b9a6cf37a66cc60a32)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:21.007723 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51f2dd-3c95-4a4a-a2bc-c8d4372b3af7 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:21.071249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:21.270170 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:21.314291 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0b51f2dd-3c95-4a4a-a2bc-c8d4372b3af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536a2205238740b9a6cf37a66cc60a32'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:21.314989 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0b51f2dd-3c95-4a4a-a2bc-c8d4372b3af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536a2205238740b9a6cf37a66cc60a32'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:21.315607 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0b51f2dd-3c95-4a4a-a2bc-c8d4372b3af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536a2205238740b9a6cf37a66cc60a32'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:21.418296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0b51f2dd-3c95-4a4a-a2bc-c8d4372b3af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536a2205238740b9a6cf37a66cc60a32'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:21.430696 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0b51f2dd-3c95-4a4a-a2bc-c8d4372b3af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536a2205238740b9a6cf37a66cc60a32'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:21.443516 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1007/2037] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:20 2022] DELETE /identity/v3/users/536a2205238740b9a6cf37a66cc60a32 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:21.516952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:21.987498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d491ad0-f989-450d-b725-d42526d5c79e admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:21.990173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-2d491ad0-f989-450d-b725-d42526d5c79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:22.006467 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d491ad0-f989-450d-b725-d42526d5c79e admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:22.066770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38de1d2-e2b6-4894-b5b5-c39bebaa5b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:22.067587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38de1d2-e2b6-4894-b5b5-c39bebaa5b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:22.067872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38de1d2-e2b6-4894-b5b5-c39bebaa5b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:22.068150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38de1d2-e2b6-4894-b5b5-c39bebaa5b1f admin admin] PATH_INFO: `/v3/projects/0f1bf51a1a1b4a0b899b97aee4ec3695` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:22.069332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38de1d2-e2b6-4894-b5b5-c39bebaa5b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f1bf51a1a1b4a0b899b97aee4ec3695)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:22.071277 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38de1d2-e2b6-4894-b5b5-c39bebaa5b1f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:22.189880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a38de1d2-e2b6-4894-b5b5-c39bebaa5b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f1bf51a1a1b4a0b899b97aee4ec3695', 'request_id': 'req-a38de1d2-e2b6-4894-b5b5-c39bebaa5b1f'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:22.319769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a38de1d2-e2b6-4894-b5b5-c39bebaa5b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f1bf51a1a1b4a0b899b97aee4ec3695', 'request_id': 'req-a38de1d2-e2b6-4894-b5b5-c39bebaa5b1f'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:22.326512 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a38de1d2-e2b6-4894-b5b5-c39bebaa5b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f1bf51a1a1b4a0b899b97aee4ec3695', 'request_id': 'req-a38de1d2-e2b6-4894-b5b5-c39bebaa5b1f'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:22.337947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a38de1d2-e2b6-4894-b5b5-c39bebaa5b1f admin admin] The token cache is being invalidate because project 0f1bf51a1a1b4a0b899b97aee4ec3695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:22.338242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a38de1d2-e2b6-4894-b5b5-c39bebaa5b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:22.338935 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a38de1d2-e2b6-4894-b5b5-c39bebaa5b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:22.339156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:22.340542 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1031/2038] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:21 2022] DELETE /identity/v3/projects/0f1bf51a1a1b4a0b899b97aee4ec3695 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:22.346695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e70079-50d8-4e51-b8ee-742a57241289 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:22.347100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e70079-50d8-4e51-b8ee-742a57241289 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:22.347454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e70079-50d8-4e51-b8ee-742a57241289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:22.367281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-75e70079-50d8-4e51-b8ee-742a57241289 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:22.368619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-75e70079-50d8-4e51-b8ee-742a57241289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:22.431859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1008/2039] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:22.439689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f59e1-fa0a-4bcf-8564-cf9aa907d68b None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:22.439982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f59e1-fa0a-4bcf-8564-cf9aa907d68b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:22.440268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f59e1-fa0a-4bcf-8564-cf9aa907d68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:22.463750 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-bd7f59e1-fa0a-4bcf-8564-cf9aa907d68b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:22.465106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-bd7f59e1-fa0a-4bcf-8564-cf9aa907d68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:22.473698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1032/2040] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:22.478208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e70079-50d8-4e51-b8ee-742a57241289 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:22.489632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e70079-50d8-4e51-b8ee-742a57241289 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:22.495054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e61174-9fc7-4a91-ba20-704104ee37df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:22.495808 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61174-9fc7-4a91-ba20-704104ee37df admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:22.496166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61174-9fc7-4a91-ba20-704104ee37df admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:22.496519 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61174-9fc7-4a91-ba20-704104ee37df admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:22.497387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e61174-9fc7-4a91-ba20-704104ee37df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:59:22.497769 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e61174-9fc7-4a91-ba20-704104ee37df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:22.499687 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e61174-9fc7-4a91-ba20-704104ee37df admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:22.511759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1009/2041] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:59:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:59:22.517042 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f59e1-fa0a-4bcf-8564-cf9aa907d68b None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:22.528625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f59e1-fa0a-4bcf-8564-cf9aa907d68b None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:22.539163 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6b10a-36b9-45ae-bfdd-44a88ea46971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:22.545247 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6b10a-36b9-45ae-bfdd-44a88ea46971 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:22.545247 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6b10a-36b9-45ae-bfdd-44a88ea46971 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:22.545247 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6b10a-36b9-45ae-bfdd-44a88ea46971 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:22.545247 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6b10a-36b9-45ae-bfdd-44a88ea46971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:22.545247 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6b10a-36b9-45ae-bfdd-44a88ea46971 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:22.661464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1033/2042] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:22 2022] POST /identity/v3/projects => generated 392 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:22.669665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e61174-9fc7-4a91-ba20-704104ee37df admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:22.684845 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e61174-9fc7-4a91-ba20-704104ee37df admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:22.848233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf60ccd-399f-4690-b309-d25de96b57bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:22.848233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf60ccd-399f-4690-b309-d25de96b57bc admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:22.848528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf60ccd-399f-4690-b309-d25de96b57bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:22.849060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf60ccd-399f-4690-b309-d25de96b57bc admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:22.850189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf60ccd-399f-4690-b309-d25de96b57bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:22.852643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf60ccd-399f-4690-b309-d25de96b57bc admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:22.970043 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1010/2043] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:22 2022] POST /identity/v3/users => generated 297 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:22.974229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6b10a-36b9-45ae-bfdd-44a88ea46971 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:22.988812 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6b10a-36b9-45ae-bfdd-44a88ea46971 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:22.994728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6f90d-d91d-4f5c-80d5-b0c77d810342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:22.995586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6f90d-d91d-4f5c-80d5-b0c77d810342 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:22.995892 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6f90d-d91d-4f5c-80d5-b0c77d810342 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:22.996175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6f90d-d91d-4f5c-80d5-b0c77d810342 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:22.996970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6f90d-d91d-4f5c-80d5-b0c77d810342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:22.999061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6f90d-d91d-4f5c-80d5-b0c77d810342 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:23.016821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1034/2044] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:22 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:59:23.017998 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf60ccd-399f-4690-b309-d25de96b57bc admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:23.028052 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf60ccd-399f-4690-b309-d25de96b57bc admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:23.033424 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938eba7-8f66-4660-96b1-527ac2bbaef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:23.034101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938eba7-8f66-4660-96b1-527ac2bbaef7 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:23.034410 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938eba7-8f66-4660-96b1-527ac2bbaef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:23.034692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938eba7-8f66-4660-96b1-527ac2bbaef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:23.035418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938eba7-8f66-4660-96b1-527ac2bbaef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:23.037017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938eba7-8f66-4660-96b1-527ac2bbaef7 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:23.041409 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:23.054945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1011/2045] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:23 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:59:23.059827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6f90d-d91d-4f5c-80d5-b0c77d810342 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:23.071213 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6f90d-d91d-4f5c-80d5-b0c77d810342 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:23.075860 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedc48e-220c-4215-94ae-0f763d25e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:23.076735 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedc48e-220c-4215-94ae-0f763d25e57b admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:23.080450 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedc48e-220c-4215-94ae-0f763d25e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:23.080450 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedc48e-220c-4215-94ae-0f763d25e57b admin admin] PATH_INFO: `/v3/projects/2a0252c494604e979a007125a1d349c8/users/402a02443eea4da0a603d7a1084dc6e9/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:23.092114 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedc48e-220c-4215-94ae-0f763d25e57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0252c494604e979a007125a1d349c8, user_id=402a02443eea4da0a603d7a1084dc6e9, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:23.095437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedc48e-220c-4215-94ae-0f763d25e57b admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:23.208950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1035/2046] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:23 2022] PUT /identity/v3/projects/2a0252c494604e979a007125a1d349c8/users/402a02443eea4da0a603d7a1084dc6e9/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:23.222451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba1cb5-33b2-42d4-a8e4-eabf85ae85c6 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:23.222765 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba1cb5-33b2-42d4-a8e4-eabf85ae85c6 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:23.223034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba1cb5-33b2-42d4-a8e4-eabf85ae85c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:23.248748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-b5ba1cb5-33b2-42d4-a8e4-eabf85ae85c6 None None] MFA Rules not processed for user `402a02443eea4da0a603d7a1084dc6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:23.249976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b5ba1cb5-33b2-42d4-a8e4-eabf85ae85c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:23.314257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1012/2047] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:23.319293 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedc48e-220c-4215-94ae-0f763d25e57b admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:23.338423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:23.386595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedc48e-220c-4215-94ae-0f763d25e57b admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:23.392281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46e412-d5bf-41fa-ae2c-2c98e5a18f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:23.392952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46e412-d5bf-41fa-ae2c-2c98e5a18f54 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:23.393242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46e412-d5bf-41fa-ae2c-2c98e5a18f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:23.393669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46e412-d5bf-41fa-ae2c-2c98e5a18f54 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:23.394301 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46e412-d5bf-41fa-ae2c-2c98e5a18f54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:23.396240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46e412-d5bf-41fa-ae2c-2c98e5a18f54 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:23.493804 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1036/2048] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:23 2022] POST /identity/v3/projects => generated 394 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:23.498014 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba1cb5-33b2-42d4-a8e4-eabf85ae85c6 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:23.509293 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba1cb5-33b2-42d4-a8e4-eabf85ae85c6 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:23.564660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6bc7c-48b5-4bb9-832d-4216ab0bd329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:23.565382 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6bc7c-48b5-4bb9-832d-4216ab0bd329 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:23.565670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6bc7c-48b5-4bb9-832d-4216ab0bd329 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:23.566265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6bc7c-48b5-4bb9-832d-4216ab0bd329 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:23.567528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6bc7c-48b5-4bb9-832d-4216ab0bd329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:23.569821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6bc7c-48b5-4bb9-832d-4216ab0bd329 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:23.650535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1013/2049] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:23 2022] POST /identity/v3/users => generated 304 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:23.651772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46e412-d5bf-41fa-ae2c-2c98e5a18f54 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:23.664956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46e412-d5bf-41fa-ae2c-2c98e5a18f54 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:23.670028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd195a-e1f6-42b0-90fb-15735fa974a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:23.670600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd195a-e1f6-42b0-90fb-15735fa974a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:23.670882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd195a-e1f6-42b0-90fb-15735fa974a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:23.671186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd195a-e1f6-42b0-90fb-15735fa974a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:23.671950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd195a-e1f6-42b0-90fb-15735fa974a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:23.674701 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd195a-e1f6-42b0-90fb-15735fa974a5 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:23.689787 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1037/2050] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:23 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:23.691064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6bc7c-48b5-4bb9-832d-4216ab0bd329 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:23.701598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6bc7c-48b5-4bb9-832d-4216ab0bd329 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:23.707475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef13853-c5c4-48da-9ede-1dce981f2aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:23.708570 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef13853-c5c4-48da-9ede-1dce981f2aba admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:23.708863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef13853-c5c4-48da-9ede-1dce981f2aba admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:23.709145 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef13853-c5c4-48da-9ede-1dce981f2aba admin admin] PATH_INFO: `/v3/projects/5e09aaa7aab844a8822ce8f0401398a6/users/ef3ab384ca674206b029fe60e867b1da/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:23.724536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef13853-c5c4-48da-9ede-1dce981f2aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e09aaa7aab844a8822ce8f0401398a6, user_id=ef3ab384ca674206b029fe60e867b1da, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:23.727275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef13853-c5c4-48da-9ede-1dce981f2aba admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:23.784267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1014/2051] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:23 2022] PUT /identity/v3/projects/5e09aaa7aab844a8822ce8f0401398a6/users/ef3ab384ca674206b029fe60e867b1da/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:23.788262 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd195a-e1f6-42b0-90fb-15735fa974a5 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:23.798307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd195a-e1f6-42b0-90fb-15735fa974a5 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:23.870628 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757c919-4f7b-4901-906b-6cb33c5ab45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:23.871301 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757c919-4f7b-4901-906b-6cb33c5ab45e admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:23.871587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757c919-4f7b-4901-906b-6cb33c5ab45e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:23.871864 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757c919-4f7b-4901-906b-6cb33c5ab45e admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:23.872736 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757c919-4f7b-4901-906b-6cb33c5ab45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:23.874450 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757c919-4f7b-4901-906b-6cb33c5ab45e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:23.885311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1038/2052] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:23 2022] GET /identity/v3/roles => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:23.889454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef13853-c5c4-48da-9ede-1dce981f2aba admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:23.910181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef13853-c5c4-48da-9ede-1dce981f2aba admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:23.916273 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18573e0f-89ba-409a-aff5-43377da1b3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:23.917278 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18573e0f-89ba-409a-aff5-43377da1b3ea admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:23.917555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18573e0f-89ba-409a-aff5-43377da1b3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:23.917718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18573e0f-89ba-409a-aff5-43377da1b3ea admin admin] PATH_INFO: `/v3/projects/5e09aaa7aab844a8822ce8f0401398a6/users/ef3ab384ca674206b029fe60e867b1da/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:23.924544 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18573e0f-89ba-409a-aff5-43377da1b3ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e09aaa7aab844a8822ce8f0401398a6, user_id=ef3ab384ca674206b029fe60e867b1da, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:23.928794 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18573e0f-89ba-409a-aff5-43377da1b3ea admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:23.937468 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:23.944780 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1015/2053] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:23 2022] PUT /identity/v3/projects/5e09aaa7aab844a8822ce8f0401398a6/users/ef3ab384ca674206b029fe60e867b1da/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:23.955615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817b2cb-3e6b-49d6-81ab-a5ce5e564974 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:23.955943 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817b2cb-3e6b-49d6-81ab-a5ce5e564974 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:23.956249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817b2cb-3e6b-49d6-81ab-a5ce5e564974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:23.985652 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e817b2cb-3e6b-49d6-81ab-a5ce5e564974 None None] MFA Rules not processed for user `ef3ab384ca674206b029fe60e867b1da`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:23.986904 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e817b2cb-3e6b-49d6-81ab-a5ce5e564974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:24.056380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1039/2054] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:23 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:24.067801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18573e0f-89ba-409a-aff5-43377da1b3ea admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:24.069551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-18573e0f-89ba-409a-aff5-43377da1b3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:24.128008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18573e0f-89ba-409a-aff5-43377da1b3ea admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:24.131886 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67ad95-5015-4f0a-b726-eac3c892046c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:24.132545 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67ad95-5015-4f0a-b726-eac3c892046c service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:24.132839 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67ad95-5015-4f0a-b726-eac3c892046c service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:24.133121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67ad95-5015-4f0a-b726-eac3c892046c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:24.142128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:24.144696 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67ad95-5015-4f0a-b726-eac3c892046c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:24.146080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67ad95-5015-4f0a-b726-eac3c892046c service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:24.156813 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1016/2055] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:24.212592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817b2cb-3e6b-49d6-81ab-a5ce5e564974 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:24.223134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817b2cb-3e6b-49d6-81ab-a5ce5e564974 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:24.226831 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b2381-9fad-4216-9de3-9dcb6c01a6f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:24.227478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b2381-9fad-4216-9de3-9dcb6c01a6f9 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:24.227769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b2381-9fad-4216-9de3-9dcb6c01a6f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:24.228050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b2381-9fad-4216-9de3-9dcb6c01a6f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:24.236650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:24.288354 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b2381-9fad-4216-9de3-9dcb6c01a6f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:24.289770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b2381-9fad-4216-9de3-9dcb6c01a6f9 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:24.298652 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1040/2056] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:24.688278 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:25.948446 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67ad95-5015-4f0a-b726-eac3c892046c service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:25.949886 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-da67ad95-5015-4f0a-b726-eac3c892046c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:26.016511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67ad95-5015-4f0a-b726-eac3c892046c service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:26.021162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b2ef1-56ed-44ed-9358-2441da64860f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:26.022052 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b2ef1-56ed-44ed-9358-2441da64860f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:26.022425 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b2ef1-56ed-44ed-9358-2441da64860f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:26.022709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b2ef1-56ed-44ed-9358-2441da64860f admin admin] PATH_INFO: `/v3/users/776d6f76451e463e95deb3a17177e36c` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:26.023898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b2ef1-56ed-44ed-9358-2441da64860f admin admin] RBAC: Authorizing `identity:delete_user(user_id=776d6f76451e463e95deb3a17177e36c)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:26.025826 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b2ef1-56ed-44ed-9358-2441da64860f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:26.219796 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:26.222315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fa4b2ef1-56ed-44ed-9358-2441da64860f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776d6f76451e463e95deb3a17177e36c'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:26.223012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fa4b2ef1-56ed-44ed-9358-2441da64860f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776d6f76451e463e95deb3a17177e36c'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:26.223614 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fa4b2ef1-56ed-44ed-9358-2441da64860f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776d6f76451e463e95deb3a17177e36c'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:26.321115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fa4b2ef1-56ed-44ed-9358-2441da64860f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776d6f76451e463e95deb3a17177e36c'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:26.335356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fa4b2ef1-56ed-44ed-9358-2441da64860f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776d6f76451e463e95deb3a17177e36c'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:26.348345 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1017/2057] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:25 2022] DELETE /identity/v3/users/776d6f76451e463e95deb3a17177e36c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:26.352800 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecba6d-9c0d-4eef-a9c9-2bb55a4c642a None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:26.353250 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecba6d-9c0d-4eef-a9c9-2bb55a4c642a None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:26.353363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecba6d-9c0d-4eef-a9c9-2bb55a4c642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:26.373140 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-19ecba6d-9c0d-4eef-a9c9-2bb55a4c642a None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:26.374398 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-19ecba6d-9c0d-4eef-a9c9-2bb55a4c642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:26.433666 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1041/2058] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:26.443233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b2ef1-56ed-44ed-9358-2441da64860f admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:26.444721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-fa4b2ef1-56ed-44ed-9358-2441da64860f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:26.503157 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b2ef1-56ed-44ed-9358-2441da64860f admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:26.506855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b39c4d-d629-47ce-b1bf-5a398a113f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:26.507513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b39c4d-d629-47ce-b1bf-5a398a113f26 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:26.507807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b39c4d-d629-47ce-b1bf-5a398a113f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:26.508094 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b39c4d-d629-47ce-b1bf-5a398a113f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:26.521074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b39c4d-d629-47ce-b1bf-5a398a113f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:26.522559 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b39c4d-d629-47ce-b1bf-5a398a113f26 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:26.533397 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1018/2059] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:26.980269 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecba6d-9c0d-4eef-a9c9-2bb55a4c642a None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:26.985597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-19ecba6d-9c0d-4eef-a9c9-2bb55a4c642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:27.006356 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecba6d-9c0d-4eef-a9c9-2bb55a4c642a None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:27.017495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:27.018395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:27.018683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:27.018989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee admin admin] PATH_INFO: `/v3/projects/3aecbb3e9bdc4df3bb9be6dbf4890f72` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:27.020182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aecbb3e9bdc4df3bb9be6dbf4890f72)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:27.022113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:27.134576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aecbb3e9bdc4df3bb9be6dbf4890f72', 'request_id': 'req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:27.212527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aecbb3e9bdc4df3bb9be6dbf4890f72', 'request_id': 'req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:27.222340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aecbb3e9bdc4df3bb9be6dbf4890f72', 'request_id': 'req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:27.233220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee admin admin] The token cache is being invalidate because project 3aecbb3e9bdc4df3bb9be6dbf4890f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:27.233506 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:27.234814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:27.236479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1042/2060] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:26 2022] DELETE /identity/v3/projects/3aecbb3e9bdc4df3bb9be6dbf4890f72 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:27.240422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b39c4d-d629-47ce-b1bf-5a398a113f26 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:27.251028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b39c4d-d629-47ce-b1bf-5a398a113f26 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:27.310532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71329ab7-b1f6-4a6b-a079-e604726bda6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:27.311418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71329ab7-b1f6-4a6b-a079-e604726bda6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:27.311712 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71329ab7-b1f6-4a6b-a079-e604726bda6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:27.312023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71329ab7-b1f6-4a6b-a079-e604726bda6e admin admin] PATH_INFO: `/v3/users/b6f9763094dd48b4a5755ad0623dbccf` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:27.313257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71329ab7-b1f6-4a6b-a079-e604726bda6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f9763094dd48b4a5755ad0623dbccf)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:27.315297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71329ab7-b1f6-4a6b-a079-e604726bda6e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:27.477994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-71329ab7-b1f6-4a6b-a079-e604726bda6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f9763094dd48b4a5755ad0623dbccf'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:27.478662 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-71329ab7-b1f6-4a6b-a079-e604726bda6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f9763094dd48b4a5755ad0623dbccf'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:27.479275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-71329ab7-b1f6-4a6b-a079-e604726bda6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f9763094dd48b4a5755ad0623dbccf'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:27.572226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-71329ab7-b1f6-4a6b-a079-e604726bda6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f9763094dd48b4a5755ad0623dbccf'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:27.593707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:27.601978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-71329ab7-b1f6-4a6b-a079-e604726bda6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f9763094dd48b4a5755ad0623dbccf'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:27.616199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1019/2061] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:27 2022] DELETE /identity/v3/users/b6f9763094dd48b4a5755ad0623dbccf => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:28.140983 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:28.142803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:28.158518 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae244adf-7e91-40b3-b0e5-5733cb5d01ee admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:28.202030 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:28.232565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34aca6-84da-402e-9a65-fd56abee4304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:28.233541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34aca6-84da-402e-9a65-fd56abee4304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:28.233830 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34aca6-84da-402e-9a65-fd56abee4304 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:28.234770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34aca6-84da-402e-9a65-fd56abee4304 admin admin] PATH_INFO: `/v3/projects/2000cba8a1d24fd7a6dcad4ee9fc0541` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:28.236137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34aca6-84da-402e-9a65-fd56abee4304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2000cba8a1d24fd7a6dcad4ee9fc0541)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:28.238069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34aca6-84da-402e-9a65-fd56abee4304 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:28.422761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6f34aca6-84da-402e-9a65-fd56abee4304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2000cba8a1d24fd7a6dcad4ee9fc0541', 'request_id': 'req-6f34aca6-84da-402e-9a65-fd56abee4304'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:28.555628 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6f34aca6-84da-402e-9a65-fd56abee4304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2000cba8a1d24fd7a6dcad4ee9fc0541', 'request_id': 'req-6f34aca6-84da-402e-9a65-fd56abee4304'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:28.565261 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6f34aca6-84da-402e-9a65-fd56abee4304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2000cba8a1d24fd7a6dcad4ee9fc0541', 'request_id': 'req-6f34aca6-84da-402e-9a65-fd56abee4304'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:28.578924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6f34aca6-84da-402e-9a65-fd56abee4304 admin admin] The token cache is being invalidate because project 2000cba8a1d24fd7a6dcad4ee9fc0541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:28.579341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6f34aca6-84da-402e-9a65-fd56abee4304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:28.580127 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6f34aca6-84da-402e-9a65-fd56abee4304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:28.582348 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1043/2062] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:28 2022] DELETE /identity/v3/projects/2000cba8a1d24fd7a6dcad4ee9fc0541 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:28.586386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71329ab7-b1f6-4a6b-a079-e604726bda6e admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:28.587862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-71329ab7-b1f6-4a6b-a079-e604726bda6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:28.603883 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71329ab7-b1f6-4a6b-a079-e604726bda6e admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:28.671393 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004a879-189f-419e-8415-45a687edbd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:28.672643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004a879-189f-419e-8415-45a687edbd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:28.672956 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004a879-189f-419e-8415-45a687edbd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:28.673254 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004a879-189f-419e-8415-45a687edbd4e admin admin] PATH_INFO: `/v3/users/8296636be8bb4ef19ce57a50ebd0c1d9` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:28.674607 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004a879-189f-419e-8415-45a687edbd4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8296636be8bb4ef19ce57a50ebd0c1d9)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:28.676511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004a879-189f-419e-8415-45a687edbd4e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:28.901628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-6004a879-189f-419e-8415-45a687edbd4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8296636be8bb4ef19ce57a50ebd0c1d9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:28.902295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-6004a879-189f-419e-8415-45a687edbd4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8296636be8bb4ef19ce57a50ebd0c1d9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:28.902950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-6004a879-189f-419e-8415-45a687edbd4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8296636be8bb4ef19ce57a50ebd0c1d9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:28.972180 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-6004a879-189f-419e-8415-45a687edbd4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8296636be8bb4ef19ce57a50ebd0c1d9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:28.988017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-6004a879-189f-419e-8415-45a687edbd4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8296636be8bb4ef19ce57a50ebd0c1d9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:29.001256 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1020/2063] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:28 2022] DELETE /identity/v3/users/8296636be8bb4ef19ce57a50ebd0c1d9 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:29.431351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34aca6-84da-402e-9a65-fd56abee4304 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:29.432888 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6f34aca6-84da-402e-9a65-fd56abee4304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:29.446646 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34aca6-84da-402e-9a65-fd56abee4304 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:29.513644 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4b281-0ee3-4742-8cc2-167bf1655c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:29.514488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4b281-0ee3-4742-8cc2-167bf1655c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:29.514779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4b281-0ee3-4742-8cc2-167bf1655c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:29.515132 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4b281-0ee3-4742-8cc2-167bf1655c77 admin admin] PATH_INFO: `/v3/projects/c52ef1f904a642b6af98cc1275cf1d4f` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:29.517198 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4b281-0ee3-4742-8cc2-167bf1655c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52ef1f904a642b6af98cc1275cf1d4f)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:29.519027 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4b281-0ee3-4742-8cc2-167bf1655c77 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:29.625068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-83b4b281-0ee3-4742-8cc2-167bf1655c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52ef1f904a642b6af98cc1275cf1d4f', 'request_id': 'req-83b4b281-0ee3-4742-8cc2-167bf1655c77'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:29.681342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-83b4b281-0ee3-4742-8cc2-167bf1655c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52ef1f904a642b6af98cc1275cf1d4f', 'request_id': 'req-83b4b281-0ee3-4742-8cc2-167bf1655c77'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:29.688741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-83b4b281-0ee3-4742-8cc2-167bf1655c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52ef1f904a642b6af98cc1275cf1d4f', 'request_id': 'req-83b4b281-0ee3-4742-8cc2-167bf1655c77'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:29.697085 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:29.700911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-83b4b281-0ee3-4742-8cc2-167bf1655c77 admin admin] The token cache is being invalidate because project c52ef1f904a642b6af98cc1275cf1d4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:29.701200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-83b4b281-0ee3-4742-8cc2-167bf1655c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:29.701877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-83b4b281-0ee3-4742-8cc2-167bf1655c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:29.704548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1044/2064] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:29 2022] DELETE /identity/v3/projects/c52ef1f904a642b6af98cc1275cf1d4f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:29.716166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b4ac5-15af-4298-929b-6103e823b491 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:29.716635 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b4ac5-15af-4298-929b-6103e823b491 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:29.716858 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b4ac5-15af-4298-929b-6103e823b491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:29.738945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-9c3b4ac5-15af-4298-929b-6103e823b491 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:29.740196 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9c3b4ac5-15af-4298-929b-6103e823b491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:29.831137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1021/2065] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:29.840149 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ee009-7d8e-49f3-ac3e-82f3d5921439 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:29.840437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ee009-7d8e-49f3-ac3e-82f3d5921439 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:29.840715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ee009-7d8e-49f3-ac3e-82f3d5921439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:29.862358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-f45ee009-7d8e-49f3-ac3e-82f3d5921439 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:29.863593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-f45ee009-7d8e-49f3-ac3e-82f3d5921439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:29.872301 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1045/2066] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:29.876639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b4ac5-15af-4298-929b-6103e823b491 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:29.881485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:29.886709 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b4ac5-15af-4298-929b-6103e823b491 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:29.892125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe9dd1-b084-42bf-adb5-204d3a538cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:29.892795 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe9dd1-b084-42bf-adb5-204d3a538cbf admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:29.893085 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe9dd1-b084-42bf-adb5-204d3a538cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:29.893365 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe9dd1-b084-42bf-adb5-204d3a538cbf admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:29.894104 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe9dd1-b084-42bf-adb5-204d3a538cbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:59:29.894526 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe9dd1-b084-42bf-adb5-204d3a538cbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:29.896137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe9dd1-b084-42bf-adb5-204d3a538cbf admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:29.909139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1022/2067] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:59:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:59:29.913574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ee009-7d8e-49f3-ac3e-82f3d5921439 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:29.923387 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ee009-7d8e-49f3-ac3e-82f3d5921439 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:29.928153 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e357e5-0ae2-41d9-acaa-ccb93b0ffe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:29.928804 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e357e5-0ae2-41d9-acaa-ccb93b0ffe9d admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:29.929096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e357e5-0ae2-41d9-acaa-ccb93b0ffe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:29.929371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e357e5-0ae2-41d9-acaa-ccb93b0ffe9d admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:29.930058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e357e5-0ae2-41d9-acaa-ccb93b0ffe9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:29.932009 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e357e5-0ae2-41d9-acaa-ccb93b0ffe9d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:30.037881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1046/2068] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:29 2022] POST /identity/v3/projects => generated 384 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:30.041821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe9dd1-b084-42bf-adb5-204d3a538cbf admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:30.052378 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe9dd1-b084-42bf-adb5-204d3a538cbf admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:30.111503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16111874-18fc-4837-be13-b99f34fe0218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:30.112175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16111874-18fc-4837-be13-b99f34fe0218 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:30.112459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16111874-18fc-4837-be13-b99f34fe0218 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:30.112737 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16111874-18fc-4837-be13-b99f34fe0218 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:30.113418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16111874-18fc-4837-be13-b99f34fe0218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:30.115399 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16111874-18fc-4837-be13-b99f34fe0218 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:30.193438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1023/2069] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:30 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:30.194749 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e357e5-0ae2-41d9-acaa-ccb93b0ffe9d admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:30.207201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e357e5-0ae2-41d9-acaa-ccb93b0ffe9d admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:30.212216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd9835-20fd-4e28-bcca-813edd2488ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:30.212882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd9835-20fd-4e28-bcca-813edd2488ea admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:30.213169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd9835-20fd-4e28-bcca-813edd2488ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:30.213449 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd9835-20fd-4e28-bcca-813edd2488ea admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:30.214312 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd9835-20fd-4e28-bcca-813edd2488ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:30.215987 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd9835-20fd-4e28-bcca-813edd2488ea admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:30.227479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1047/2070] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:30 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:30.231592 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16111874-18fc-4837-be13-b99f34fe0218 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:30.241839 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16111874-18fc-4837-be13-b99f34fe0218 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:30.246569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab2dec-a6d7-487b-a225-d331c2cd07e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:30.247237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab2dec-a6d7-487b-a225-d331c2cd07e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:30.247529 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab2dec-a6d7-487b-a225-d331c2cd07e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:30.247812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab2dec-a6d7-487b-a225-d331c2cd07e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:30.248538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab2dec-a6d7-487b-a225-d331c2cd07e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:30.250743 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab2dec-a6d7-487b-a225-d331c2cd07e5 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:30.260905 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1024/2071] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:30 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:30.264888 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd9835-20fd-4e28-bcca-813edd2488ea admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:30.276358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd9835-20fd-4e28-bcca-813edd2488ea admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:30.281821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ac14d-a87e-4603-883d-a2f6f7d8300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:30.291448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ac14d-a87e-4603-883d-a2f6f7d8300f admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:30.291448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ac14d-a87e-4603-883d-a2f6f7d8300f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:30.291448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ac14d-a87e-4603-883d-a2f6f7d8300f admin admin] PATH_INFO: `/v3/projects/3684109c25814f2dadd52c7f00d5e025/users/1f3a90c131984e8f8ab7b63679b39adc/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:30.301729 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ac14d-a87e-4603-883d-a2f6f7d8300f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3684109c25814f2dadd52c7f00d5e025, user_id=1f3a90c131984e8f8ab7b63679b39adc, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:30.304408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ac14d-a87e-4603-883d-a2f6f7d8300f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:30.379209 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1048/2072] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:30 2022] PUT /identity/v3/projects/3684109c25814f2dadd52c7f00d5e025/users/1f3a90c131984e8f8ab7b63679b39adc/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:30.384240 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b6af9-0ffb-4e80-a13a-478a7677176f None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:30.384555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b6af9-0ffb-4e80-a13a-478a7677176f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:30.384868 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b6af9-0ffb-4e80-a13a-478a7677176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:30.404038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-079b6af9-0ffb-4e80-a13a-478a7677176f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:30.405217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-079b6af9-0ffb-4e80-a13a-478a7677176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:30.480507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1025/2073] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:30.491536 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ac14d-a87e-4603-883d-a2f6f7d8300f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:30.493977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8a9ac14d-a87e-4603-883d-a2f6f7d8300f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:30.496002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b6af9-0ffb-4e80-a13a-478a7677176f None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:30.497740 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-079b6af9-0ffb-4e80-a13a-478a7677176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:30.512758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b6af9-0ffb-4e80-a13a-478a7677176f None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:30.518925 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db4c69-db9b-46a2-b695-fb14859e4f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:30.519954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db4c69-db9b-46a2-b695-fb14859e4f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:30.520243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db4c69-db9b-46a2-b695-fb14859e4f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:30.520585 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db4c69-db9b-46a2-b695-fb14859e4f8b admin admin] PATH_INFO: `/v3/users/402a02443eea4da0a603d7a1084dc6e9` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:30.521811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db4c69-db9b-46a2-b695-fb14859e4f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=402a02443eea4da0a603d7a1084dc6e9)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:30.523847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db4c69-db9b-46a2-b695-fb14859e4f8b admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:30.570070 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ac14d-a87e-4603-883d-a2f6f7d8300f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:30.573680 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebea77-5513-41ce-b14f-bbf8d2231116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:30.574339 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebea77-5513-41ce-b14f-bbf8d2231116 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:30.574634 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebea77-5513-41ce-b14f-bbf8d2231116 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:30.574910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebea77-5513-41ce-b14f-bbf8d2231116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:30.586497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebea77-5513-41ce-b14f-bbf8d2231116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:30.588132 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebea77-5513-41ce-b14f-bbf8d2231116 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:30.600116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1049/2074] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:30.980600 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b7db4c69-db9b-46a2-b695-fb14859e4f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '402a02443eea4da0a603d7a1084dc6e9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:30.981251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b7db4c69-db9b-46a2-b695-fb14859e4f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '402a02443eea4da0a603d7a1084dc6e9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:30.981854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b7db4c69-db9b-46a2-b695-fb14859e4f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '402a02443eea4da0a603d7a1084dc6e9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:31.082176 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b7db4c69-db9b-46a2-b695-fb14859e4f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '402a02443eea4da0a603d7a1084dc6e9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:31.092366 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:31.098165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b7db4c69-db9b-46a2-b695-fb14859e4f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '402a02443eea4da0a603d7a1084dc6e9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:31.121140 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcba1b-c395-4792-909c-57dd49ace0cf None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:31.121140 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcba1b-c395-4792-909c-57dd49ace0cf None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:31.121140 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcba1b-c395-4792-909c-57dd49ace0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:31.122019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1026/2075] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:30 2022] DELETE /identity/v3/users/402a02443eea4da0a603d7a1084dc6e9 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:31.139600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-5bfcba1b-c395-4792-909c-57dd49ace0cf None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:31.144163 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5bfcba1b-c395-4792-909c-57dd49ace0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:31.233291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1050/2076] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:31.245964 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db4c69-db9b-46a2-b695-fb14859e4f8b admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:31.247539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b7db4c69-db9b-46a2-b695-fb14859e4f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:31.315746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db4c69-db9b-46a2-b695-fb14859e4f8b admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:31.319383 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da4db9-b580-49f9-8d6c-e2b535432b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:31.320101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da4db9-b580-49f9-8d6c-e2b535432b64 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:31.320450 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da4db9-b580-49f9-8d6c-e2b535432b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:31.320790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da4db9-b580-49f9-8d6c-e2b535432b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:31.330574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da4db9-b580-49f9-8d6c-e2b535432b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:31.332348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da4db9-b580-49f9-8d6c-e2b535432b64 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:31.342638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1027/2077] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:31.856031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcba1b-c395-4792-909c-57dd49ace0cf None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:31.857755 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5bfcba1b-c395-4792-909c-57dd49ace0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:31.873620 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcba1b-c395-4792-909c-57dd49ace0cf None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:31.881217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b63ed1-d953-4029-9254-541378296620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:31.882418 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b63ed1-d953-4029-9254-541378296620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:31.882845 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b63ed1-d953-4029-9254-541378296620 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:31.883186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b63ed1-d953-4029-9254-541378296620 admin admin] PATH_INFO: `/v3/projects/2a0252c494604e979a007125a1d349c8` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:31.884465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b63ed1-d953-4029-9254-541378296620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a0252c494604e979a007125a1d349c8)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:31.888952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b63ed1-d953-4029-9254-541378296620 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:32.032491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:32.064996 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-76b63ed1-d953-4029-9254-541378296620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0252c494604e979a007125a1d349c8', 'request_id': 'req-76b63ed1-d953-4029-9254-541378296620'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:32.169217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-76b63ed1-d953-4029-9254-541378296620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0252c494604e979a007125a1d349c8', 'request_id': 'req-76b63ed1-d953-4029-9254-541378296620'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:32.182447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-76b63ed1-d953-4029-9254-541378296620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0252c494604e979a007125a1d349c8', 'request_id': 'req-76b63ed1-d953-4029-9254-541378296620'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:32.208073 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-76b63ed1-d953-4029-9254-541378296620 admin admin] The token cache is being invalidate because project 2a0252c494604e979a007125a1d349c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:32.208438 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-76b63ed1-d953-4029-9254-541378296620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:32.209178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-76b63ed1-d953-4029-9254-541378296620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:32.213529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1051/2078] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:31 2022] DELETE /identity/v3/projects/2a0252c494604e979a007125a1d349c8 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:32.220348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da4db9-b580-49f9-8d6c-e2b535432b64 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:32.237972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da4db9-b580-49f9-8d6c-e2b535432b64 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:32.352536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68f219-8da1-4cb2-ad7f-91ac358cee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:32.353415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68f219-8da1-4cb2-ad7f-91ac358cee93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:32.353804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68f219-8da1-4cb2-ad7f-91ac358cee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:32.354177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68f219-8da1-4cb2-ad7f-91ac358cee93 admin admin] PATH_INFO: `/v3/users/ef3ab384ca674206b029fe60e867b1da` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:32.355694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68f219-8da1-4cb2-ad7f-91ac358cee93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3ab384ca674206b029fe60e867b1da)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:32.360670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68f219-8da1-4cb2-ad7f-91ac358cee93 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:32.658296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-da68f219-8da1-4cb2-ad7f-91ac358cee93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3ab384ca674206b029fe60e867b1da'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:32.659159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-da68f219-8da1-4cb2-ad7f-91ac358cee93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3ab384ca674206b029fe60e867b1da'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:32.659822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-da68f219-8da1-4cb2-ad7f-91ac358cee93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3ab384ca674206b029fe60e867b1da'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:32.738408 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-da68f219-8da1-4cb2-ad7f-91ac358cee93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3ab384ca674206b029fe60e867b1da'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:32.753350 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-da68f219-8da1-4cb2-ad7f-91ac358cee93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3ab384ca674206b029fe60e867b1da'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:32.768874 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1028/2079] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:32 2022] DELETE /identity/v3/users/ef3ab384ca674206b029fe60e867b1da => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:33.295132 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b63ed1-d953-4029-9254-541378296620 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:33.296885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-76b63ed1-d953-4029-9254-541378296620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:33.327947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b63ed1-d953-4029-9254-541378296620 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:33.429014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fabb8-cdbd-4eaa-92fb-7d435fcf0c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:33.430192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fabb8-cdbd-4eaa-92fb-7d435fcf0c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:33.430689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fabb8-cdbd-4eaa-92fb-7d435fcf0c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:33.431891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fabb8-cdbd-4eaa-92fb-7d435fcf0c22 admin admin] PATH_INFO: `/v3/projects/5e09aaa7aab844a8822ce8f0401398a6` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:33.433912 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fabb8-cdbd-4eaa-92fb-7d435fcf0c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e09aaa7aab844a8822ce8f0401398a6)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:33.436424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fabb8-cdbd-4eaa-92fb-7d435fcf0c22 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:33.529374 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-4a0fabb8-cdbd-4eaa-92fb-7d435fcf0c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e09aaa7aab844a8822ce8f0401398a6', 'request_id': 'req-4a0fabb8-cdbd-4eaa-92fb-7d435fcf0c22'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:33.596465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-4a0fabb8-cdbd-4eaa-92fb-7d435fcf0c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e09aaa7aab844a8822ce8f0401398a6', 'request_id': 'req-4a0fabb8-cdbd-4eaa-92fb-7d435fcf0c22'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:33.604566 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-4a0fabb8-cdbd-4eaa-92fb-7d435fcf0c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e09aaa7aab844a8822ce8f0401398a6', 'request_id': 'req-4a0fabb8-cdbd-4eaa-92fb-7d435fcf0c22'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:33.619597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-4a0fabb8-cdbd-4eaa-92fb-7d435fcf0c22 admin admin] The token cache is being invalidate because project 5e09aaa7aab844a8822ce8f0401398a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:33.619889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-4a0fabb8-cdbd-4eaa-92fb-7d435fcf0c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:33.620564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-4a0fabb8-cdbd-4eaa-92fb-7d435fcf0c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:33.626427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1052/2080] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:33 2022] DELETE /identity/v3/projects/5e09aaa7aab844a8822ce8f0401398a6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:33.630133 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d2287-5eae-43ea-8c07-e531f78a8b9c None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:33.630133 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d2287-5eae-43ea-8c07-e531f78a8b9c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:33.630133 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d2287-5eae-43ea-8c07-e531f78a8b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:33.637986 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:33.664240 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-e25d2287-5eae-43ea-8c07-e531f78a8b9c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:33.665492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-e25d2287-5eae-43ea-8c07-e531f78a8b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:33.753873 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1029/2081] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:33.754843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23410ed0-2e5c-4d1d-976c-48407c942ab9 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:33.755400 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23410ed0-2e5c-4d1d-976c-48407c942ab9 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:33.755849 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23410ed0-2e5c-4d1d-976c-48407c942ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:33.801947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-23410ed0-2e5c-4d1d-976c-48407c942ab9 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:33.803983 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-23410ed0-2e5c-4d1d-976c-48407c942ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:33.816289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1053/2082] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:33.822360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d2287-5eae-43ea-8c07-e531f78a8b9c None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:33.841661 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d2287-5eae-43ea-8c07-e531f78a8b9c None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:33.851848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a9b5f-95c2-4a4c-b568-0190311f0412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:33.853335 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a9b5f-95c2-4a4c-b568-0190311f0412 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:33.853643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a9b5f-95c2-4a4c-b568-0190311f0412 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:33.853929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a9b5f-95c2-4a4c-b568-0190311f0412 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:33.855889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a9b5f-95c2-4a4c-b568-0190311f0412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:59:33.856214 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a9b5f-95c2-4a4c-b568-0190311f0412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:33.858524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a9b5f-95c2-4a4c-b568-0190311f0412 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:33.877129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1030/2083] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:59:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:59:33.879330 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23410ed0-2e5c-4d1d-976c-48407c942ab9 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:33.901530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23410ed0-2e5c-4d1d-976c-48407c942ab9 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:33.901530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72563596-34a2-48c3-bdde-1ba9f9db6f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:33.901530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72563596-34a2-48c3-bdde-1ba9f9db6f6f admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:33.901530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72563596-34a2-48c3-bdde-1ba9f9db6f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:33.901980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72563596-34a2-48c3-bdde-1ba9f9db6f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:33.901980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72563596-34a2-48c3-bdde-1ba9f9db6f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:33.901980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72563596-34a2-48c3-bdde-1ba9f9db6f6f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:34.061762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1054/2084] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:33 2022] POST /identity/v3/projects => generated 384 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:34.063953 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a9b5f-95c2-4a4c-b568-0190311f0412 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:34.078611 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a9b5f-95c2-4a4c-b568-0190311f0412 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:34.215344 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93060fb0-9cd8-4c8a-a7dc-66be7e4e2963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:34.216072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93060fb0-9cd8-4c8a-a7dc-66be7e4e2963 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:34.216362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93060fb0-9cd8-4c8a-a7dc-66be7e4e2963 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:34.216649 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93060fb0-9cd8-4c8a-a7dc-66be7e4e2963 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:34.217378 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93060fb0-9cd8-4c8a-a7dc-66be7e4e2963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:34.219732 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93060fb0-9cd8-4c8a-a7dc-66be7e4e2963 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:34.373556 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1031/2085] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:34 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:59:34.378365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72563596-34a2-48c3-bdde-1ba9f9db6f6f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:34.391050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72563596-34a2-48c3-bdde-1ba9f9db6f6f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:34.427110 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5ac27-62a3-4cb5-877c-575c6d4e807a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:34.428077 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5ac27-62a3-4cb5-877c-575c6d4e807a admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:34.428523 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5ac27-62a3-4cb5-877c-575c6d4e807a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:34.432410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5ac27-62a3-4cb5-877c-575c6d4e807a admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:34.432410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5ac27-62a3-4cb5-877c-575c6d4e807a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:34.432410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5ac27-62a3-4cb5-877c-575c6d4e807a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:34.467919 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1055/2086] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:34 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:34.468616 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93060fb0-9cd8-4c8a-a7dc-66be7e4e2963 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:34.481312 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93060fb0-9cd8-4c8a-a7dc-66be7e4e2963 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:34.488618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac56aa-f8a9-4fef-a2b0-ebe0677ce463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:34.490199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac56aa-f8a9-4fef-a2b0-ebe0677ce463 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:34.490199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac56aa-f8a9-4fef-a2b0-ebe0677ce463 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:34.490199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac56aa-f8a9-4fef-a2b0-ebe0677ce463 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:34.491812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac56aa-f8a9-4fef-a2b0-ebe0677ce463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:34.492596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac56aa-f8a9-4fef-a2b0-ebe0677ce463 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:34.520177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1032/2087] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:34 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:34.524471 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5ac27-62a3-4cb5-877c-575c6d4e807a admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:34.538855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5ac27-62a3-4cb5-877c-575c6d4e807a admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:34.552987 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac0811-600c-456d-8b79-e610d24f23ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:34.554078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac0811-600c-456d-8b79-e610d24f23ac admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:34.554313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac0811-600c-456d-8b79-e610d24f23ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:34.554624 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac0811-600c-456d-8b79-e610d24f23ac admin admin] PATH_INFO: `/v3/projects/670756c16d884b83aed16674cea2a8bf/users/afb878128d9e470cadb82d1e57dc1568/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:34.568260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:34.595942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac0811-600c-456d-8b79-e610d24f23ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=670756c16d884b83aed16674cea2a8bf, user_id=afb878128d9e470cadb82d1e57dc1568, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:34.602972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac0811-600c-456d-8b79-e610d24f23ac admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:34.738960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1056/2088] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:34 2022] PUT /identity/v3/projects/670756c16d884b83aed16674cea2a8bf/users/afb878128d9e470cadb82d1e57dc1568/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:34.749954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cbd4a-e85a-47a3-a4ae-0cc848c55218 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:34.750658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cbd4a-e85a-47a3-a4ae-0cc848c55218 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:34.750658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cbd4a-e85a-47a3-a4ae-0cc848c55218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:34.779472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836415d3-17f7-43fc-b90d-2482ae37a58f None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:34.779764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836415d3-17f7-43fc-b90d-2482ae37a58f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:34.780048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836415d3-17f7-43fc-b90d-2482ae37a58f None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:34.782698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1057/2089] 10.222.0.112 () {54 vars in 926 bytes} [Thu May 26 16:59:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:59:34.783128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-b68cbd4a-e85a-47a3-a4ae-0cc848c55218 None None] MFA Rules not processed for user `afb878128d9e470cadb82d1e57dc1568`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:34.784360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b68cbd4a-e85a-47a3-a4ae-0cc848c55218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:34.827202 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f576a0-9996-42a8-ac93-8a2d207ae123 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:34.827607 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f576a0-9996-42a8-ac93-8a2d207ae123 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:34.833509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f576a0-9996-42a8-ac93-8a2d207ae123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:34.865908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:34.873833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1033/2090] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:34.879265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cbd4a-e85a-47a3-a4ae-0cc848c55218 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:34.902082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-c5f576a0-9996-42a8-ac93-8a2d207ae123 None None] MFA Rules not processed for user `b415e7fca03e4602b3d711436d47f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:34.932087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c5f576a0-9996-42a8-ac93-8a2d207ae123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:34.955842 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cbd4a-e85a-47a3-a4ae-0cc848c55218 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:34.965020 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e8f50-8bf0-4ca7-b381-4bfc49bead67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:34.965861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e8f50-8bf0-4ca7-b381-4bfc49bead67 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:34.966219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e8f50-8bf0-4ca7-b381-4bfc49bead67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:34.966544 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e8f50-8bf0-4ca7-b381-4bfc49bead67 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:34.969104 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e8f50-8bf0-4ca7-b381-4bfc49bead67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:34.970803 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e8f50-8bf0-4ca7-b381-4bfc49bead67 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:35.010163 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1058/2091] 10.222.0.112 () {58 vars in 1023 bytes} [Thu May 26 16:59:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:35.011075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f576a0-9996-42a8-ac93-8a2d207ae123 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:35.013122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c5f576a0-9996-42a8-ac93-8a2d207ae123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:35.028495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f576a0-9996-42a8-ac93-8a2d207ae123 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:35.036644 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e561f05-86ba-4155-b3a8-ce42a0e144b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:35.037557 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e561f05-86ba-4155-b3a8-ce42a0e144b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:35.037842 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e561f05-86ba-4155-b3a8-ce42a0e144b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:35.038122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e561f05-86ba-4155-b3a8-ce42a0e144b1 admin admin] PATH_INFO: `/v3/users/5bdb3e36e5934d1fbf2204cac57be139` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:35.039402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e561f05-86ba-4155-b3a8-ce42a0e144b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bdb3e36e5934d1fbf2204cac57be139)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:35.041468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e561f05-86ba-4155-b3a8-ce42a0e144b1 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:35.098025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1034/2092] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:34 2022] POST /identity/v3/projects => generated 382 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:59:35.098025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e8f50-8bf0-4ca7-b381-4bfc49bead67 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:35.101788 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5c8e8f50-8bf0-4ca7-b381-4bfc49bead67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:35.189928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e8f50-8bf0-4ca7-b381-4bfc49bead67 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:35.197550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb65f9c-2809-4756-8770-236733f94f05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:35.197550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb65f9c-2809-4756-8770-236733f94f05 service placement] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:35.197550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb65f9c-2809-4756-8770-236733f94f05 service placement] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:35.197550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb65f9c-2809-4756-8770-236733f94f05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:35.222181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb65f9c-2809-4756-8770-236733f94f05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:35.224845 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb65f9c-2809-4756-8770-236733f94f05 service placement] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:35.236851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1035/2093] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:35.237772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb65f9c-2809-4756-8770-236733f94f05 service placement] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:35.313119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5e561f05-86ba-4155-b3a8-ce42a0e144b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bdb3e36e5934d1fbf2204cac57be139'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:35.315997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5e561f05-86ba-4155-b3a8-ce42a0e144b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bdb3e36e5934d1fbf2204cac57be139'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:35.341029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5e561f05-86ba-4155-b3a8-ce42a0e144b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bdb3e36e5934d1fbf2204cac57be139'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:35.380012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb65f9c-2809-4756-8770-236733f94f05 service placement] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:35.397346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbc37a-123a-4b47-b47d-7babdf890ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:35.397695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5e561f05-86ba-4155-b3a8-ce42a0e144b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bdb3e36e5934d1fbf2204cac57be139'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:35.398691 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbc37a-123a-4b47-b47d-7babdf890ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:35.400236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbc37a-123a-4b47-b47d-7babdf890ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:35.400601 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbc37a-123a-4b47-b47d-7babdf890ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:35.402058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbc37a-123a-4b47-b47d-7babdf890ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:35.407856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5e561f05-86ba-4155-b3a8-ce42a0e144b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bdb3e36e5934d1fbf2204cac57be139'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:35.410092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbc37a-123a-4b47-b47d-7babdf890ed0 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:35.420288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1059/2094] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:35 2022] DELETE /identity/v3/users/5bdb3e36e5934d1fbf2204cac57be139 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:35.511106 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1036/2095] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:35 2022] POST /identity/v3/users => generated 298 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:35.516212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e561f05-86ba-4155-b3a8-ce42a0e144b1 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:35.520764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5e561f05-86ba-4155-b3a8-ce42a0e144b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:35.568109 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:35.658075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e561f05-86ba-4155-b3a8-ce42a0e144b1 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:35.666638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c84cc-73eb-4d41-9335-6856991ec7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:35.667841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c84cc-73eb-4d41-9335-6856991ec7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:35.668125 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c84cc-73eb-4d41-9335-6856991ec7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:35.668472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c84cc-73eb-4d41-9335-6856991ec7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:35.669179 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c84cc-73eb-4d41-9335-6856991ec7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:35.671846 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c84cc-73eb-4d41-9335-6856991ec7c5 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:35.688573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1060/2096] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:35 2022] GET /identity/v3/roles => generated 1427 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:35.698627 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbc37a-123a-4b47-b47d-7babdf890ed0 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:35.698627 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:35.708767 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbc37a-123a-4b47-b47d-7babdf890ed0 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:35.715428 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b006935-bcde-4778-abe8-e5bd10c3bbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:35.721426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b006935-bcde-4778-abe8-e5bd10c3bbb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:35.721426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b006935-bcde-4778-abe8-e5bd10c3bbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:35.721426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b006935-bcde-4778-abe8-e5bd10c3bbb8 admin admin] PATH_INFO: `/v3/projects/b0f5c25b58684841b4ef38ce0e5247ec/users/c5565de486d74db5bee3e37a9bda3c78/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:35.736658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b006935-bcde-4778-abe8-e5bd10c3bbb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f5c25b58684841b4ef38ce0e5247ec, user_id=c5565de486d74db5bee3e37a9bda3c78, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:35.739736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b006935-bcde-4778-abe8-e5bd10c3bbb8 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:35.842210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1037/2097] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:35 2022] PUT /identity/v3/projects/b0f5c25b58684841b4ef38ce0e5247ec/users/c5565de486d74db5bee3e37a9bda3c78/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:35.847319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c84cc-73eb-4d41-9335-6856991ec7c5 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:35.858227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c84cc-73eb-4d41-9335-6856991ec7c5 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:35.916034 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2c0a0-394a-42ab-8565-0c661c29118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:35.916701 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2c0a0-394a-42ab-8565-0c661c29118d admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:35.916988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2c0a0-394a-42ab-8565-0c661c29118d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:35.917270 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2c0a0-394a-42ab-8565-0c661c29118d admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:35.917993 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2c0a0-394a-42ab-8565-0c661c29118d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:35.919641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2c0a0-394a-42ab-8565-0c661c29118d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:35.933087 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b006935-bcde-4778-abe8-e5bd10c3bbb8 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:35.933087 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-3b006935-bcde-4778-abe8-e5bd10c3bbb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:35.941471 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1061/2098] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:35 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:35.943791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2c0a0-394a-42ab-8565-0c661c29118d admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:35.958923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2c0a0-394a-42ab-8565-0c661c29118d admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:35.964560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb268dce-54df-47b4-8a78-1da3cb4c97c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:35.965674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb268dce-54df-47b4-8a78-1da3cb4c97c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:35.966116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb268dce-54df-47b4-8a78-1da3cb4c97c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:35.966436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb268dce-54df-47b4-8a78-1da3cb4c97c4 admin admin] PATH_INFO: `/v3/projects/b0f5c25b58684841b4ef38ce0e5247ec/users/c5565de486d74db5bee3e37a9bda3c78/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:35.967534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b006935-bcde-4778-abe8-e5bd10c3bbb8 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:35.969367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb268dce-54df-47b4-8a78-1da3cb4c97c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f5c25b58684841b4ef38ce0e5247ec, user_id=c5565de486d74db5bee3e37a9bda3c78, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:35.972747 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb268dce-54df-47b4-8a78-1da3cb4c97c4 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:35.977072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9f4c7-2356-4a88-b232-a118e38344f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:35.979019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9f4c7-2356-4a88-b232-a118e38344f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:35.979402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9f4c7-2356-4a88-b232-a118e38344f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:35.979683 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9f4c7-2356-4a88-b232-a118e38344f5 admin admin] PATH_INFO: `/v3/projects/642e24c7c239432b93d0e03f7022cc0e` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:35.980951 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9f4c7-2356-4a88-b232-a118e38344f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=642e24c7c239432b93d0e03f7022cc0e)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:35.982985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9f4c7-2356-4a88-b232-a118e38344f5 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:35.998171 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1062/2099] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:35 2022] PUT /identity/v3/projects/b0f5c25b58684841b4ef38ce0e5247ec/users/c5565de486d74db5bee3e37a9bda3c78/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:36.006516 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ebd48-5b44-41d0-9c72-c48131e13712 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:36.006835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ebd48-5b44-41d0-9c72-c48131e13712 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:36.007146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ebd48-5b44-41d0-9c72-c48131e13712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:36.065182 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-0a4ebd48-5b44-41d0-9c72-c48131e13712 None None] MFA Rules not processed for user `c5565de486d74db5bee3e37a9bda3c78`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:36.066203 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0a4ebd48-5b44-41d0-9c72-c48131e13712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:36.151858 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0ea9f4c7-2356-4a88-b232-a118e38344f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '642e24c7c239432b93d0e03f7022cc0e', 'request_id': 'req-0ea9f4c7-2356-4a88-b232-a118e38344f5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:36.170504 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1063/2100] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:36.174134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ebd48-5b44-41d0-9c72-c48131e13712 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:36.175580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0a4ebd48-5b44-41d0-9c72-c48131e13712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:36.253525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ebd48-5b44-41d0-9c72-c48131e13712 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:36.311923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a3a9c-fc78-49f1-8be3-814aed0f6b09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:36.312807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a3a9c-fc78-49f1-8be3-814aed0f6b09 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:36.313317 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a3a9c-fc78-49f1-8be3-814aed0f6b09 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:36.313432 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a3a9c-fc78-49f1-8be3-814aed0f6b09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:36.317037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0ea9f4c7-2356-4a88-b232-a118e38344f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '642e24c7c239432b93d0e03f7022cc0e', 'request_id': 'req-0ea9f4c7-2356-4a88-b232-a118e38344f5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:36.325567 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0ea9f4c7-2356-4a88-b232-a118e38344f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '642e24c7c239432b93d0e03f7022cc0e', 'request_id': 'req-0ea9f4c7-2356-4a88-b232-a118e38344f5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:36.339261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0ea9f4c7-2356-4a88-b232-a118e38344f5 admin admin] The token cache is being invalidate because project 642e24c7c239432b93d0e03f7022cc0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:36.339571 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0ea9f4c7-2356-4a88-b232-a118e38344f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:36.340396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0ea9f4c7-2356-4a88-b232-a118e38344f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:36.346644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1038/2101] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:35 2022] DELETE /identity/v3/projects/642e24c7c239432b93d0e03f7022cc0e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:36.348451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd862e7-b9eb-4e17-b89b-8ff5a1f62ae2 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:36.348820 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd862e7-b9eb-4e17-b89b-8ff5a1f62ae2 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:36.349179 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd862e7-b9eb-4e17-b89b-8ff5a1f62ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:36.375797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-2cd862e7-b9eb-4e17-b89b-8ff5a1f62ae2 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:36.377190 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2cd862e7-b9eb-4e17-b89b-8ff5a1f62ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:36.391682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:36.414043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a3a9c-fc78-49f1-8be3-814aed0f6b09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:36.415917 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a3a9c-fc78-49f1-8be3-814aed0f6b09 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:36.438470 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1064/2102] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:59:36.506442 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1039/2103] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:36.513214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b0a4b-ef36-4e13-bb52-93e570f6d585 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:36.513508 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b0a4b-ef36-4e13-bb52-93e570f6d585 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:36.513791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b0a4b-ef36-4e13-bb52-93e570f6d585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:36.548326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-640b0a4b-ef36-4e13-bb52-93e570f6d585 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:36.550225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-640b0a4b-ef36-4e13-bb52-93e570f6d585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:36.584509 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd862e7-b9eb-4e17-b89b-8ff5a1f62ae2 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:36.587755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2cd862e7-b9eb-4e17-b89b-8ff5a1f62ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:36.600391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1065/2104] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:36.601242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b0a4b-ef36-4e13-bb52-93e570f6d585 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:36.616926 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd862e7-b9eb-4e17-b89b-8ff5a1f62ae2 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:36.625468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b0a4b-ef36-4e13-bb52-93e570f6d585 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:36.628637 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39426d-fbda-4d40-873d-9d95dd6ee76e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:36.631539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39426d-fbda-4d40-873d-9d95dd6ee76e service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:36.631838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39426d-fbda-4d40-873d-9d95dd6ee76e service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:36.632122 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39426d-fbda-4d40-873d-9d95dd6ee76e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:36.635540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0d39426d-fbda-4d40-873d-9d95dd6ee76e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:36.642090 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d8af0-7862-4dd3-acf0-122fd68d41f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:36.642821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d8af0-7862-4dd3-acf0-122fd68d41f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:36.643117 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d8af0-7862-4dd3-acf0-122fd68d41f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:36.643385 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d8af0-7862-4dd3-acf0-122fd68d41f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:36.644356 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d8af0-7862-4dd3-acf0-122fd68d41f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:59:36.644607 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d8af0-7862-4dd3-acf0-122fd68d41f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:36.646208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d8af0-7862-4dd3-acf0-122fd68d41f7 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:36.677744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1066/2105] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:59:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:59:36.683613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d8af0-7862-4dd3-acf0-122fd68d41f7 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:36.704389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d8af0-7862-4dd3-acf0-122fd68d41f7 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:36.711499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476bc4b-f8d9-47f8-b2ba-5a891231647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:36.712113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476bc4b-f8d9-47f8-b2ba-5a891231647e admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:36.712571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476bc4b-f8d9-47f8-b2ba-5a891231647e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:36.712853 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476bc4b-f8d9-47f8-b2ba-5a891231647e admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:36.713553 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476bc4b-f8d9-47f8-b2ba-5a891231647e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:36.715605 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476bc4b-f8d9-47f8-b2ba-5a891231647e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:36.771583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39426d-fbda-4d40-873d-9d95dd6ee76e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:36.774299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39426d-fbda-4d40-873d-9d95dd6ee76e service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:36.784990 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:36.794984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1040/2106] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:59:36.848202 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1067/2107] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:36 2022] POST /identity/v3/projects => generated 394 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:36.849090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39426d-fbda-4d40-873d-9d95dd6ee76e service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:36.862698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39426d-fbda-4d40-873d-9d95dd6ee76e service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:36.953301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1a3a3-8d9e-477c-bc20-6316a6c67ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:36.953301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1a3a3-8d9e-477c-bc20-6316a6c67ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:36.953301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1a3a3-8d9e-477c-bc20-6316a6c67ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:36.953894 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1a3a3-8d9e-477c-bc20-6316a6c67ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:36.954261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1a3a3-8d9e-477c-bc20-6316a6c67ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:36.958507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1a3a3-8d9e-477c-bc20-6316a6c67ab4 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:37.073297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1041/2108] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:36 2022] POST /identity/v3/users => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:59:37.073464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476bc4b-f8d9-47f8-b2ba-5a891231647e admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:37.091641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476bc4b-f8d9-47f8-b2ba-5a891231647e admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:37.111284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ac077-7024-4a52-a340-4afb0c7a7725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:37.111974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ac077-7024-4a52-a340-4afb0c7a7725 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:37.112276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ac077-7024-4a52-a340-4afb0c7a7725 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:37.112536 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ac077-7024-4a52-a340-4afb0c7a7725 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:37.113268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ac077-7024-4a52-a340-4afb0c7a7725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:37.114913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ac077-7024-4a52-a340-4afb0c7a7725 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:37.126749 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1068/2109] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:37 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:37.133095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1a3a3-8d9e-477c-bc20-6316a6c67ab4 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:37.147739 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1a3a3-8d9e-477c-bc20-6316a6c67ab4 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:37.152936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114e265-8a23-4dbc-9e7c-e844ae7c1566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:37.153702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114e265-8a23-4dbc-9e7c-e844ae7c1566 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:37.154107 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114e265-8a23-4dbc-9e7c-e844ae7c1566 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:37.154602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114e265-8a23-4dbc-9e7c-e844ae7c1566 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:37.157569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114e265-8a23-4dbc-9e7c-e844ae7c1566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:37.157569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114e265-8a23-4dbc-9e7c-e844ae7c1566 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:37.183707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1042/2110] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:37 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:37.185255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ac077-7024-4a52-a340-4afb0c7a7725 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:37.206518 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ac077-7024-4a52-a340-4afb0c7a7725 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:37.213037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b4dfc-8e68-4bac-96ed-219e0323f3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:37.214072 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b4dfc-8e68-4bac-96ed-219e0323f3c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:37.214385 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b4dfc-8e68-4bac-96ed-219e0323f3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:37.214667 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b4dfc-8e68-4bac-96ed-219e0323f3c6 admin admin] PATH_INFO: `/v3/projects/d84da619d6f042ed8ccf92259d52e180/users/a3ccb15b11de4cfea727f0aa453f6e2b/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:37.237264 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b4dfc-8e68-4bac-96ed-219e0323f3c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84da619d6f042ed8ccf92259d52e180, user_id=a3ccb15b11de4cfea727f0aa453f6e2b, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:37.240212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b4dfc-8e68-4bac-96ed-219e0323f3c6 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:37.336169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1069/2111] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:37 2022] PUT /identity/v3/projects/d84da619d6f042ed8ccf92259d52e180/users/a3ccb15b11de4cfea727f0aa453f6e2b/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:37.341400 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def5934-3328-4cd9-8ca3-ee181f0ae017 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:37.341697 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def5934-3328-4cd9-8ca3-ee181f0ae017 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:37.341975 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def5934-3328-4cd9-8ca3-ee181f0ae017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:37.370655 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-4def5934-3328-4cd9-8ca3-ee181f0ae017 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:37.372347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4def5934-3328-4cd9-8ca3-ee181f0ae017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:37.466637 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1043/2112] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:37.474002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b4dfc-8e68-4bac-96ed-219e0323f3c6 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:37.476314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6f3b4dfc-8e68-4bac-96ed-219e0323f3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:37.503596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:37.595993 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b4dfc-8e68-4bac-96ed-219e0323f3c6 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:37.601838 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350ee08-8f0d-45d3-97af-c3804d8f66b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:37.602715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350ee08-8f0d-45d3-97af-c3804d8f66b8 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:37.603107 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350ee08-8f0d-45d3-97af-c3804d8f66b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:37.603579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350ee08-8f0d-45d3-97af-c3804d8f66b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:37.627193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350ee08-8f0d-45d3-97af-c3804d8f66b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:37.628933 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350ee08-8f0d-45d3-97af-c3804d8f66b8 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:37.682139 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1070/2113] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:59:37.915918 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5271e-f465-4465-a50b-2d747f0eee25 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:37.916482 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5271e-f465-4465-a50b-2d747f0eee25 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:37.916582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5271e-f465-4465-a50b-2d747f0eee25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:37.945948 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-afe5271e-f465-4465-a50b-2d747f0eee25 None None] MFA Rules not processed for user `1f3a90c131984e8f8ab7b63679b39adc`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:37.947284 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-afe5271e-f465-4465-a50b-2d747f0eee25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:38.014004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1044/2114] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:38.018646 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350ee08-8f0d-45d3-97af-c3804d8f66b8 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:38.020199 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-4350ee08-8f0d-45d3-97af-c3804d8f66b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:38.040004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350ee08-8f0d-45d3-97af-c3804d8f66b8 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:38.051435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bba213-f83d-4cbb-8cfe-8b0507868868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:38.052187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bba213-f83d-4cbb-8cfe-8b0507868868 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:38.052481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bba213-f83d-4cbb-8cfe-8b0507868868 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:38.052920 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bba213-f83d-4cbb-8cfe-8b0507868868 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:38.053718 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bba213-f83d-4cbb-8cfe-8b0507868868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:38.058739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bba213-f83d-4cbb-8cfe-8b0507868868 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:38.171345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1071/2115] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:38 2022] POST /identity/v3/projects => generated 384 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:38.172647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5271e-f465-4465-a50b-2d747f0eee25 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:38.183871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5271e-f465-4465-a50b-2d747f0eee25 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:38.189032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:38.262599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed147ad-9d75-405f-a3ad-a3fb62f31b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:38.263287 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed147ad-9d75-405f-a3ad-a3fb62f31b16 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:38.263577 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed147ad-9d75-405f-a3ad-a3fb62f31b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:38.263860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed147ad-9d75-405f-a3ad-a3fb62f31b16 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:38.264568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed147ad-9d75-405f-a3ad-a3fb62f31b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:38.267450 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed147ad-9d75-405f-a3ad-a3fb62f31b16 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:38.386057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1045/2116] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:38 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:59:38.392167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bba213-f83d-4cbb-8cfe-8b0507868868 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:38.405644 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bba213-f83d-4cbb-8cfe-8b0507868868 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:38.411556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049720b-23aa-4f88-baa5-5acd343db247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:38.412249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049720b-23aa-4f88-baa5-5acd343db247 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:38.412529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049720b-23aa-4f88-baa5-5acd343db247 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:38.412805 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049720b-23aa-4f88-baa5-5acd343db247 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:38.413529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049720b-23aa-4f88-baa5-5acd343db247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:38.415161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049720b-23aa-4f88-baa5-5acd343db247 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:38.428407 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1072/2117] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:38 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:38.432604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed147ad-9d75-405f-a3ad-a3fb62f31b16 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:38.444114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed147ad-9d75-405f-a3ad-a3fb62f31b16 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:38.450471 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4efde-afbc-42cc-b77b-1713f4612569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:38.451418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4efde-afbc-42cc-b77b-1713f4612569 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:38.451743 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4efde-afbc-42cc-b77b-1713f4612569 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:38.452026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4efde-afbc-42cc-b77b-1713f4612569 admin admin] PATH_INFO: `/v3/projects/6cf4694175fb4161a4f42273a11d75c2/users/6b1b2ee56e634f6ca79dc20be730b30b/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:38.467819 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4efde-afbc-42cc-b77b-1713f4612569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf4694175fb4161a4f42273a11d75c2, user_id=6b1b2ee56e634f6ca79dc20be730b30b, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:38.470582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4efde-afbc-42cc-b77b-1713f4612569 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:38.534342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1046/2118] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:38 2022] PUT /identity/v3/projects/6cf4694175fb4161a4f42273a11d75c2/users/6b1b2ee56e634f6ca79dc20be730b30b/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:38.538258 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049720b-23aa-4f88-baa5-5acd343db247 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:38.550001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049720b-23aa-4f88-baa5-5acd343db247 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:38.621341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45187901-f4d7-4f3f-9ac8-2cf6bcc33e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:38.622420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45187901-f4d7-4f3f-9ac8-2cf6bcc33e00 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:38.622965 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45187901-f4d7-4f3f-9ac8-2cf6bcc33e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:38.623464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45187901-f4d7-4f3f-9ac8-2cf6bcc33e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:38.624517 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45187901-f4d7-4f3f-9ac8-2cf6bcc33e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:38.626073 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45187901-f4d7-4f3f-9ac8-2cf6bcc33e00 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:38.640215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1073/2119] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:38 2022] GET /identity/v3/roles => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:38.641998 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4efde-afbc-42cc-b77b-1713f4612569 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:38.653708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4efde-afbc-42cc-b77b-1713f4612569 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:38.659505 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c50f9-6eef-41bc-b7fe-b9368986dff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:38.660548 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c50f9-6eef-41bc-b7fe-b9368986dff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:38.660725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c50f9-6eef-41bc-b7fe-b9368986dff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:38.660966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c50f9-6eef-41bc-b7fe-b9368986dff3 admin admin] PATH_INFO: `/v3/projects/6cf4694175fb4161a4f42273a11d75c2/users/6b1b2ee56e634f6ca79dc20be730b30b/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:38.663023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c50f9-6eef-41bc-b7fe-b9368986dff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf4694175fb4161a4f42273a11d75c2, user_id=6b1b2ee56e634f6ca79dc20be730b30b, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:38.665685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c50f9-6eef-41bc-b7fe-b9368986dff3 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:38.680543 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1047/2120] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:38 2022] PUT /identity/v3/projects/6cf4694175fb4161a4f42273a11d75c2/users/6b1b2ee56e634f6ca79dc20be730b30b/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:41.295777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45187901-f4d7-4f3f-9ac8-2cf6bcc33e00 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:41.299337 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-45187901-f4d7-4f3f-9ac8-2cf6bcc33e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:41.323543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45187901-f4d7-4f3f-9ac8-2cf6bcc33e00 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:41.413076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb2528-bace-44de-91be-5f6789f85983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:41.414399 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb2528-bace-44de-91be-5f6789f85983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:41.414399 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb2528-bace-44de-91be-5f6789f85983 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:41.414686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb2528-bace-44de-91be-5f6789f85983 admin admin] PATH_INFO: `/v3/users/afb878128d9e470cadb82d1e57dc1568` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:41.415963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb2528-bace-44de-91be-5f6789f85983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb878128d9e470cadb82d1e57dc1568)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:41.418062 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb2528-bace-44de-91be-5f6789f85983 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:41.457142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:41.664810 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-98cb2528-bace-44de-91be-5f6789f85983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb878128d9e470cadb82d1e57dc1568'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:41.682562 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-98cb2528-bace-44de-91be-5f6789f85983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb878128d9e470cadb82d1e57dc1568'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:41.699493 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-98cb2528-bace-44de-91be-5f6789f85983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb878128d9e470cadb82d1e57dc1568'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:41.848946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-98cb2528-bace-44de-91be-5f6789f85983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb878128d9e470cadb82d1e57dc1568'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:41.872936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-98cb2528-bace-44de-91be-5f6789f85983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb878128d9e470cadb82d1e57dc1568'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:41.893713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1074/2121] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:41 2022] DELETE /identity/v3/users/afb878128d9e470cadb82d1e57dc1568 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:41.898947 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed41ae9-9431-4a3e-b282-264380ffc4ae None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:41.899858 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed41ae9-9431-4a3e-b282-264380ffc4ae None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:41.900286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed41ae9-9431-4a3e-b282-264380ffc4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:41.930647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-0ed41ae9-9431-4a3e-b282-264380ffc4ae None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:41.931888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0ed41ae9-9431-4a3e-b282-264380ffc4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:42.050960 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1048/2122] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:42.260469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb2528-bace-44de-91be-5f6789f85983 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:42.262811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-98cb2528-bace-44de-91be-5f6789f85983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:42.400168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb2528-bace-44de-91be-5f6789f85983 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:42.405187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f0749-4f55-47c2-adb8-250f3e200766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:42.407424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0749-4f55-47c2-adb8-250f3e200766 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:42.407816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0749-4f55-47c2-adb8-250f3e200766 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:42.408196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0749-4f55-47c2-adb8-250f3e200766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:42.442692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f0749-4f55-47c2-adb8-250f3e200766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:42.446568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f0749-4f55-47c2-adb8-250f3e200766 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:42.473457 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1075/2123] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:44.016434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed41ae9-9431-4a3e-b282-264380ffc4ae None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:44.018606 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0ed41ae9-9431-4a3e-b282-264380ffc4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:44.048212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed41ae9-9431-4a3e-b282-264380ffc4ae None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:44.069816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89264bbc-70a3-4c7e-be6f-513241b624a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:44.070993 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89264bbc-70a3-4c7e-be6f-513241b624a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:44.071473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89264bbc-70a3-4c7e-be6f-513241b624a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:44.073240 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89264bbc-70a3-4c7e-be6f-513241b624a3 admin admin] PATH_INFO: `/v3/projects/670756c16d884b83aed16674cea2a8bf` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:44.075401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89264bbc-70a3-4c7e-be6f-513241b624a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=670756c16d884b83aed16674cea2a8bf)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:44.080045 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89264bbc-70a3-4c7e-be6f-513241b624a3 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:44.293556 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-89264bbc-70a3-4c7e-be6f-513241b624a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670756c16d884b83aed16674cea2a8bf', 'request_id': 'req-89264bbc-70a3-4c7e-be6f-513241b624a3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:44.378898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-89264bbc-70a3-4c7e-be6f-513241b624a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670756c16d884b83aed16674cea2a8bf', 'request_id': 'req-89264bbc-70a3-4c7e-be6f-513241b624a3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:44.386035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:44.395977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-89264bbc-70a3-4c7e-be6f-513241b624a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670756c16d884b83aed16674cea2a8bf', 'request_id': 'req-89264bbc-70a3-4c7e-be6f-513241b624a3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:44.417689 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-89264bbc-70a3-4c7e-be6f-513241b624a3 admin admin] The token cache is being invalidate because project 670756c16d884b83aed16674cea2a8bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:44.418130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-89264bbc-70a3-4c7e-be6f-513241b624a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:44.418933 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-89264bbc-70a3-4c7e-be6f-513241b624a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:44.421258 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1049/2124] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:44 2022] DELETE /identity/v3/projects/670756c16d884b83aed16674cea2a8bf => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:44.425636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f0749-4f55-47c2-adb8-250f3e200766 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:44.440951 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f0749-4f55-47c2-adb8-250f3e200766 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:44.527912 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd9450-4f75-49bd-849a-a125aba93e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:44.529352 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd9450-4f75-49bd-849a-a125aba93e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:44.529889 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd9450-4f75-49bd-849a-a125aba93e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:44.530573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd9450-4f75-49bd-849a-a125aba93e0c admin admin] PATH_INFO: `/v3/users/c5565de486d74db5bee3e37a9bda3c78` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:44.535300 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd9450-4f75-49bd-849a-a125aba93e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5565de486d74db5bee3e37a9bda3c78)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:44.535300 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd9450-4f75-49bd-849a-a125aba93e0c admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:44.748139 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:44.754188 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-47bd9450-4f75-49bd-849a-a125aba93e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5565de486d74db5bee3e37a9bda3c78'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:44.754963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-47bd9450-4f75-49bd-849a-a125aba93e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5565de486d74db5bee3e37a9bda3c78'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:44.769247 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-47bd9450-4f75-49bd-849a-a125aba93e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5565de486d74db5bee3e37a9bda3c78'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:44.955843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-47bd9450-4f75-49bd-849a-a125aba93e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5565de486d74db5bee3e37a9bda3c78'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:44.966471 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-47bd9450-4f75-49bd-849a-a125aba93e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5565de486d74db5bee3e37a9bda3c78'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:44.974016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1076/2125] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:44 2022] DELETE /identity/v3/users/c5565de486d74db5bee3e37a9bda3c78 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:45.905190 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89264bbc-70a3-4c7e-be6f-513241b624a3 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:45.907730 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-89264bbc-70a3-4c7e-be6f-513241b624a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:45.935730 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89264bbc-70a3-4c7e-be6f-513241b624a3 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:45.959189 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e169222-097b-473b-8d28-9547ca4e1801 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:45.959743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e169222-097b-473b-8d28-9547ca4e1801 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:45.959743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e169222-097b-473b-8d28-9547ca4e1801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:46.017789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-7e169222-097b-473b-8d28-9547ca4e1801 None None] MFA Rules not processed for user `a3ccb15b11de4cfea727f0aa453f6e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:46.019108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7e169222-097b-473b-8d28-9547ca4e1801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:46.031510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5fa0f-3a9a-4852-bfb2-b87287cb6540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:46.032615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5fa0f-3a9a-4852-bfb2-b87287cb6540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:46.032975 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5fa0f-3a9a-4852-bfb2-b87287cb6540 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:46.033387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5fa0f-3a9a-4852-bfb2-b87287cb6540 admin admin] PATH_INFO: `/v3/projects/b0f5c25b58684841b4ef38ce0e5247ec` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:46.035093 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5fa0f-3a9a-4852-bfb2-b87287cb6540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f5c25b58684841b4ef38ce0e5247ec)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:46.037404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5fa0f-3a9a-4852-bfb2-b87287cb6540 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:46.151115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1077/2126] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:46.160579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af0e70-e12a-4845-8775-048744d617ea None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:46.160865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af0e70-e12a-4845-8775-048744d617ea None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:46.161141 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af0e70-e12a-4845-8775-048744d617ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:46.211870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-16af0e70-e12a-4845-8775-048744d617ea None None] MFA Rules not processed for user `a3ccb15b11de4cfea727f0aa453f6e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:46.219065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-16af0e70-e12a-4845-8775-048744d617ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:46.231655 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-07f5fa0f-3a9a-4852-bfb2-b87287cb6540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f5c25b58684841b4ef38ce0e5247ec', 'request_id': 'req-07f5fa0f-3a9a-4852-bfb2-b87287cb6540'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:46.310947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1078/2127] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:46.316670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af0e70-e12a-4845-8775-048744d617ea None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:46.318072 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-16af0e70-e12a-4845-8775-048744d617ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:46.345854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-07f5fa0f-3a9a-4852-bfb2-b87287cb6540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f5c25b58684841b4ef38ce0e5247ec', 'request_id': 'req-07f5fa0f-3a9a-4852-bfb2-b87287cb6540'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:46.355145 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-07f5fa0f-3a9a-4852-bfb2-b87287cb6540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f5c25b58684841b4ef38ce0e5247ec', 'request_id': 'req-07f5fa0f-3a9a-4852-bfb2-b87287cb6540'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:46.373189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-07f5fa0f-3a9a-4852-bfb2-b87287cb6540 admin admin] The token cache is being invalidate because project b0f5c25b58684841b4ef38ce0e5247ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:46.374042 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-07f5fa0f-3a9a-4852-bfb2-b87287cb6540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:46.374931 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-07f5fa0f-3a9a-4852-bfb2-b87287cb6540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:46.377413 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1050/2128] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:45 2022] DELETE /identity/v3/projects/b0f5c25b58684841b4ef38ce0e5247ec => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:46.384380 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0b90b-6aa3-493e-94a9-f100c1a43aef None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:46.384896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0b90b-6aa3-493e-94a9-f100c1a43aef None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:46.385188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0b90b-6aa3-493e-94a9-f100c1a43aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:46.417285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-ebc0b90b-6aa3-493e-94a9-f100c1a43aef None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:46.418155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-ebc0b90b-6aa3-493e-94a9-f100c1a43aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:46.445217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:46.551671 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af0e70-e12a-4845-8775-048744d617ea None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:46.557732 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e18b1a-f398-4379-ae06-8e3e3e782525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:46.558468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e18b1a-f398-4379-ae06-8e3e3e782525 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:46.558754 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e18b1a-f398-4379-ae06-8e3e3e782525 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:46.559396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e18b1a-f398-4379-ae06-8e3e3e782525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:46.561528 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-50e18b1a-f398-4379-ae06-8e3e3e782525 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:46.565599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1051/2129] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:46.568225 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fcf72-d6a6-4462-99db-0e23a099a4c2 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:46.568634 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fcf72-d6a6-4462-99db-0e23a099a4c2 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:46.569023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fcf72-d6a6-4462-99db-0e23a099a4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:46.576704 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e18b1a-f398-4379-ae06-8e3e3e782525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:46.580375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e18b1a-f398-4379-ae06-8e3e3e782525 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:46.597280 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-7e8fcf72-d6a6-4462-99db-0e23a099a4c2 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:46.599857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7e8fcf72-d6a6-4462-99db-0e23a099a4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:46.607286 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1079/2130] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:46.611607 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1052/2131] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:46.619297 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e18b1a-f398-4379-ae06-8e3e3e782525 service nova] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:46.641454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e18b1a-f398-4379-ae06-8e3e3e782525 service nova] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:46.650527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809e414-1667-4a4c-8a6f-99778380de82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:46.652798 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809e414-1667-4a4c-8a6f-99778380de82 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:46.653094 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809e414-1667-4a4c-8a6f-99778380de82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:46.655076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809e414-1667-4a4c-8a6f-99778380de82 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:46.655076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809e414-1667-4a4c-8a6f-99778380de82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:59:46.655076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809e414-1667-4a4c-8a6f-99778380de82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:46.656788 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809e414-1667-4a4c-8a6f-99778380de82 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:46.670430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1080/2132] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:59:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:59:46.677936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fcf72-d6a6-4462-99db-0e23a099a4c2 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:46.686347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fcf72-d6a6-4462-99db-0e23a099a4c2 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:46.691504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280ab0c-b649-499d-a635-3b2f0d0f1562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:46.692188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280ab0c-b649-499d-a635-3b2f0d0f1562 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:46.692482 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280ab0c-b649-499d-a635-3b2f0d0f1562 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:46.692738 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280ab0c-b649-499d-a635-3b2f0d0f1562 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:46.693428 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280ab0c-b649-499d-a635-3b2f0d0f1562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:46.695480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280ab0c-b649-499d-a635-3b2f0d0f1562 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:46.699827 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:46.824220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1053/2133] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:46 2022] POST /identity/v3/projects => generated 388 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:46.825463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809e414-1667-4a4c-8a6f-99778380de82 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:46.837151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809e414-1667-4a4c-8a6f-99778380de82 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:46.949244 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1243c6-8f96-4862-90b0-81a29007432c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:46.950071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1243c6-8f96-4862-90b0-81a29007432c admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:46.950503 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1243c6-8f96-4862-90b0-81a29007432c admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:46.950900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1243c6-8f96-4862-90b0-81a29007432c admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:46.951709 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1243c6-8f96-4862-90b0-81a29007432c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:46.955064 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1243c6-8f96-4862-90b0-81a29007432c admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:47.113097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1081/2134] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:46 2022] POST /identity/v3/users => generated 295 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:47.117371 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280ab0c-b649-499d-a635-3b2f0d0f1562 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:47.132157 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280ab0c-b649-499d-a635-3b2f0d0f1562 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:47.147301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd90a90-4780-46a9-a170-66521439f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:47.148012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd90a90-4780-46a9-a170-66521439f19f admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:47.148307 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd90a90-4780-46a9-a170-66521439f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:47.148595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd90a90-4780-46a9-a170-66521439f19f admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:47.149670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd90a90-4780-46a9-a170-66521439f19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:47.151848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd90a90-4780-46a9-a170-66521439f19f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:47.175741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1054/2135] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:47 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:47.180453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1243c6-8f96-4862-90b0-81a29007432c admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:47.199300 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1243c6-8f96-4862-90b0-81a29007432c admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:47.210425 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d4df8-179a-40b1-a58e-ee5041263409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:47.218419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d4df8-179a-40b1-a58e-ee5041263409 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:47.218851 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d4df8-179a-40b1-a58e-ee5041263409 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:47.219276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d4df8-179a-40b1-a58e-ee5041263409 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:47.220404 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d4df8-179a-40b1-a58e-ee5041263409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:47.224372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d4df8-179a-40b1-a58e-ee5041263409 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:47.247624 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1082/2136] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:47 2022] GET /identity/v3/roles => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:47.248467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd90a90-4780-46a9-a170-66521439f19f admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:47.265273 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd90a90-4780-46a9-a170-66521439f19f admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:47.270938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991f008-872a-48a5-8601-83936388ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:47.271943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991f008-872a-48a5-8601-83936388ed0b admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:47.272309 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991f008-872a-48a5-8601-83936388ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:47.272666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991f008-872a-48a5-8601-83936388ed0b admin admin] PATH_INFO: `/v3/projects/c0535675f5bd4a38855c6dd5fc90b9d6/users/0e1227476f1442f8b3bfebb2fec3472c/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:47.291636 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991f008-872a-48a5-8601-83936388ed0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0535675f5bd4a38855c6dd5fc90b9d6, user_id=0e1227476f1442f8b3bfebb2fec3472c, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:47.294531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991f008-872a-48a5-8601-83936388ed0b admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:47.373223 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1055/2137] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:47 2022] PUT /identity/v3/projects/c0535675f5bd4a38855c6dd5fc90b9d6/users/0e1227476f1442f8b3bfebb2fec3472c/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:47.388296 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769676a0-05f5-4830-929b-3521c1fd342a None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:47.388781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769676a0-05f5-4830-929b-3521c1fd342a None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:47.389214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769676a0-05f5-4830-929b-3521c1fd342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:47.466558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760c92e-5c27-4c48-93dd-516e5a004d07 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:47.468451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760c92e-5c27-4c48-93dd-516e5a004d07 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:47.468451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760c92e-5c27-4c48-93dd-516e5a004d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:47.470946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-769676a0-05f5-4830-929b-3521c1fd342a None None] MFA Rules not processed for user `0e1227476f1442f8b3bfebb2fec3472c`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:47.472988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-769676a0-05f5-4830-929b-3521c1fd342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:47.526344 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-1760c92e-5c27-4c48-93dd-516e5a004d07 None None] MFA Rules not processed for user `6b1b2ee56e634f6ca79dc20be730b30b`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:47.528477 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1760c92e-5c27-4c48-93dd-516e5a004d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:47.610436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1083/2138] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:47.614006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769676a0-05f5-4830-929b-3521c1fd342a None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:47.666373 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1056/2139] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:47.677837 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760c92e-5c27-4c48-93dd-516e5a004d07 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:47.679929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1760c92e-5c27-4c48-93dd-516e5a004d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:47.727638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769676a0-05f5-4830-929b-3521c1fd342a None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:47.732567 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922f6d9-8a91-44e4-940e-ad77b85565d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:47.735289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922f6d9-8a91-44e4-940e-ad77b85565d3 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:47.735289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922f6d9-8a91-44e4-940e-ad77b85565d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:47.735289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922f6d9-8a91-44e4-940e-ad77b85565d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:47.735289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922f6d9-8a91-44e4-940e-ad77b85565d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:47.736900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922f6d9-8a91-44e4-940e-ad77b85565d3 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:47.797357 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760c92e-5c27-4c48-93dd-516e5a004d07 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:47.801666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13993c89-7622-4751-abbf-391440a6ab7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf32c811ead4fd0b69c83890a56509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:47.802344 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13993c89-7622-4751-abbf-391440a6ab7d service glance] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:47.802814 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13993c89-7622-4751-abbf-391440a6ab7d service glance] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:47.803110 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13993c89-7622-4751-abbf-391440a6ab7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:47.805303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-13993c89-7622-4751-abbf-391440a6ab7d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:47.896062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13993c89-7622-4751-abbf-391440a6ab7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:47.898687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1084/2140] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:47 2022] POST /identity/v3/projects => generated 384 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:47.900503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13993c89-7622-4751-abbf-391440a6ab7d service glance] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:47.904202 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:47.907156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922f6d9-8a91-44e4-940e-ad77b85565d3 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:47.925897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1057/2141] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:59:47.944955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffa55f-49e8-4668-a6ba-3178fc63a2ec None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:47.945512 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffa55f-49e8-4668-a6ba-3178fc63a2ec None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:47.945982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffa55f-49e8-4668-a6ba-3178fc63a2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:47.975540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-c7ffa55f-49e8-4668-a6ba-3178fc63a2ec None None] MFA Rules not processed for user `a3ccb15b11de4cfea727f0aa453f6e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:47.977004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-c7ffa55f-49e8-4668-a6ba-3178fc63a2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:47.999301 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922f6d9-8a91-44e4-940e-ad77b85565d3 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:48.008310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd01c8-1659-4dcf-b05d-3e429585a3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:48.009580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd01c8-1659-4dcf-b05d-3e429585a3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:48.009935 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd01c8-1659-4dcf-b05d-3e429585a3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:48.010291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd01c8-1659-4dcf-b05d-3e429585a3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:48.011469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd01c8-1659-4dcf-b05d-3e429585a3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:48.014227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd01c8-1659-4dcf-b05d-3e429585a3b4 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:48.083261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1058/2142] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:48.163775 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1085/2143] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:47 2022] POST /identity/v3/users => generated 299 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:48.164970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffa55f-49e8-4668-a6ba-3178fc63a2ec None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:48.180718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:48.186071 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffa55f-49e8-4668-a6ba-3178fc63a2ec None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:48.200532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4403e-b4df-49ce-9145-194e5b8fb37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:48.201341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4403e-b4df-49ce-9145-194e5b8fb37c admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:48.201513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4403e-b4df-49ce-9145-194e5b8fb37c admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:48.201796 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4403e-b4df-49ce-9145-194e5b8fb37c admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:48.203173 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4403e-b4df-49ce-9145-194e5b8fb37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:48.204972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4403e-b4df-49ce-9145-194e5b8fb37c admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:48.244780 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1059/2144] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:48 2022] GET /identity/v3/roles => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:48.246015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd01c8-1659-4dcf-b05d-3e429585a3b4 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:48.284672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd01c8-1659-4dcf-b05d-3e429585a3b4 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:48.303145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefa156-ca9a-443d-aa64-895dab8bd9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:48.304322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefa156-ca9a-443d-aa64-895dab8bd9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:48.307024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefa156-ca9a-443d-aa64-895dab8bd9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:48.307469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefa156-ca9a-443d-aa64-895dab8bd9a4 admin admin] PATH_INFO: `/v3/projects/2e02820540934b4a9c69a739390524f7/users/6b443c01a3864f32a9bd5f579ee9ba04/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:48.339862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefa156-ca9a-443d-aa64-895dab8bd9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e02820540934b4a9c69a739390524f7, user_id=6b443c01a3864f32a9bd5f579ee9ba04, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:48.348779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefa156-ca9a-443d-aa64-895dab8bd9a4 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:48.388190 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a3160-bbeb-4e90-b237-3467305b710f None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:48.388485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a3160-bbeb-4e90-b237-3467305b710f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:48.388766 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a3160-bbeb-4e90-b237-3467305b710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:48.473919 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1086/2145] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:48 2022] PUT /identity/v3/projects/2e02820540934b4a9c69a739390524f7/users/6b443c01a3864f32a9bd5f579ee9ba04/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:48.477859 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefa156-ca9a-443d-aa64-895dab8bd9a4 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:48.517359 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-a22a3160-bbeb-4e90-b237-3467305b710f None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:48.518615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a22a3160-bbeb-4e90-b237-3467305b710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:48.656971 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefa156-ca9a-443d-aa64-895dab8bd9a4 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:48.675138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9775b9b-ccc4-48f1-b5ea-d636a229cda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:48.676659 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9775b9b-ccc4-48f1-b5ea-d636a229cda3 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:48.676659 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9775b9b-ccc4-48f1-b5ea-d636a229cda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:48.676659 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9775b9b-ccc4-48f1-b5ea-d636a229cda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:48.677387 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9775b9b-ccc4-48f1-b5ea-d636a229cda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:48.679600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9775b9b-ccc4-48f1-b5ea-d636a229cda3 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:48.708856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1087/2146] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:48 2022] GET /identity/v3/roles => generated 1427 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:48.715972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9775b9b-ccc4-48f1-b5ea-d636a229cda3 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:48.739855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9775b9b-ccc4-48f1-b5ea-d636a229cda3 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:48.744495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1060/2147] 10.222.0.112 () {58 vars in 1014 bytes} [Thu May 26 16:59:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:48.754846 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6456f4a-2302-4d3e-b5e3-a2ff7340094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:48.755507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6456f4a-2302-4d3e-b5e3-a2ff7340094d admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:48.755887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6456f4a-2302-4d3e-b5e3-a2ff7340094d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:48.756275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6456f4a-2302-4d3e-b5e3-a2ff7340094d admin admin] PATH_INFO: `/v3/projects/2e02820540934b4a9c69a739390524f7/users/6b443c01a3864f32a9bd5f579ee9ba04/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:48.760852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6456f4a-2302-4d3e-b5e3-a2ff7340094d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e02820540934b4a9c69a739390524f7, user_id=6b443c01a3864f32a9bd5f579ee9ba04, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:48.767017 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6456f4a-2302-4d3e-b5e3-a2ff7340094d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:48.809101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a3160-bbeb-4e90-b237-3467305b710f None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:48.810843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a22a3160-bbeb-4e90-b237-3467305b710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:48.811980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1088/2148] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:48 2022] PUT /identity/v3/projects/2e02820540934b4a9c69a739390524f7/users/6b443c01a3864f32a9bd5f579ee9ba04/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:48.817082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276306d9-5e86-4325-bbea-d248c9f29599 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:48.817082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276306d9-5e86-4325-bbea-d248c9f29599 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:48.817082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276306d9-5e86-4325-bbea-d248c9f29599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:48.875087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-276306d9-5e86-4325-bbea-d248c9f29599 None None] MFA Rules not processed for user `6b443c01a3864f32a9bd5f579ee9ba04`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:48.876496 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-276306d9-5e86-4325-bbea-d248c9f29599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:49.021288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a3160-bbeb-4e90-b237-3467305b710f None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:49.063901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1089/2149] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:49.075926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276306d9-5e86-4325-bbea-d248c9f29599 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:49.078430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-276306d9-5e86-4325-bbea-d248c9f29599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:49.126211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:49.184970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da905ab7-e92f-4a7d-b3b2-3de8979774c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:49.185699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da905ab7-e92f-4a7d-b3b2-3de8979774c8 service swift] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:49.186042 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da905ab7-e92f-4a7d-b3b2-3de8979774c8 service swift] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:49.186493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da905ab7-e92f-4a7d-b3b2-3de8979774c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:49.247793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:49.251685 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276306d9-5e86-4325-bbea-d248c9f29599 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:49.259424 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da905ab7-e92f-4a7d-b3b2-3de8979774c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:49.261364 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da905ab7-e92f-4a7d-b3b2-3de8979774c8 service swift] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:49.261737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ad756-7ddc-4bbb-b2f2-9c276f92fa1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:49.263032 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ad756-7ddc-4bbb-b2f2-9c276f92fa1b service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:49.263324 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ad756-7ddc-4bbb-b2f2-9c276f92fa1b service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:49.263610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ad756-7ddc-4bbb-b2f2-9c276f92fa1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:49.275480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1061/2150] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 16:59:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 16:59:49.287096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ad756-7ddc-4bbb-b2f2-9c276f92fa1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:49.288868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ad756-7ddc-4bbb-b2f2-9c276f92fa1b service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:49.320740 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1090/2151] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:59:51.592214 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da905ab7-e92f-4a7d-b3b2-3de8979774c8 service swift] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:51.662077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da905ab7-e92f-4a7d-b3b2-3de8979774c8 service swift] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:51.670147 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d62c27-fc1c-4879-8205-b3659a09699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:51.671846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d62c27-fc1c-4879-8205-b3659a09699a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:51.672280 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d62c27-fc1c-4879-8205-b3659a09699a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:51.672729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d62c27-fc1c-4879-8205-b3659a09699a admin admin] PATH_INFO: `/v3/users/0e1227476f1442f8b3bfebb2fec3472c` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:51.674055 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d62c27-fc1c-4879-8205-b3659a09699a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e1227476f1442f8b3bfebb2fec3472c)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:51.676574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d62c27-fc1c-4879-8205-b3659a09699a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:51.679271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:51.931822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-28d62c27-fc1c-4879-8205-b3659a09699a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e1227476f1442f8b3bfebb2fec3472c'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:51.931822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-28d62c27-fc1c-4879-8205-b3659a09699a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e1227476f1442f8b3bfebb2fec3472c'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:51.931822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-28d62c27-fc1c-4879-8205-b3659a09699a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e1227476f1442f8b3bfebb2fec3472c'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:52.158956 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-28d62c27-fc1c-4879-8205-b3659a09699a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e1227476f1442f8b3bfebb2fec3472c'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:52.185588 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-28d62c27-fc1c-4879-8205-b3659a09699a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e1227476f1442f8b3bfebb2fec3472c'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:52.241511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1062/2152] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:51 2022] DELETE /identity/v3/users/0e1227476f1442f8b3bfebb2fec3472c => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:59:52.245177 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e095558-e083-4a0e-81f8-86fea8069fcd None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:52.245742 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e095558-e083-4a0e-81f8-86fea8069fcd None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:52.245882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e095558-e083-4a0e-81f8-86fea8069fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:52.295749 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-7e095558-e083-4a0e-81f8-86fea8069fcd None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:52.303621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7e095558-e083-4a0e-81f8-86fea8069fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:52.403139 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1091/2153] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:52.413329 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d62c27-fc1c-4879-8205-b3659a09699a admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:52.416854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-28d62c27-fc1c-4879-8205-b3659a09699a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:52.539740 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d62c27-fc1c-4879-8205-b3659a09699a admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:52.547393 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b96826-a798-4a92-aa08-b1d2ac2becbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:52.548386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96826-a798-4a92-aa08-b1d2ac2becbc service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:52.548507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96826-a798-4a92-aa08-b1d2ac2becbc service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:52.548774 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96826-a798-4a92-aa08-b1d2ac2becbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:52.562859 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b96826-a798-4a92-aa08-b1d2ac2becbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:52.564384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b96826-a798-4a92-aa08-b1d2ac2becbc service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:52.581415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1063/2154] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:53.705083 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e095558-e083-4a0e-81f8-86fea8069fcd None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:53.708410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7e095558-e083-4a0e-81f8-86fea8069fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:53.727899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e095558-e083-4a0e-81f8-86fea8069fcd None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:53.758495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256ab6b-5e77-4fff-8e81-fb51509e2717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:53.758495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256ab6b-5e77-4fff-8e81-fb51509e2717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:53.758495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256ab6b-5e77-4fff-8e81-fb51509e2717 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:53.758495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256ab6b-5e77-4fff-8e81-fb51509e2717 admin admin] PATH_INFO: `/v3/projects/c0535675f5bd4a38855c6dd5fc90b9d6` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:53.777378 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256ab6b-5e77-4fff-8e81-fb51509e2717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0535675f5bd4a38855c6dd5fc90b9d6)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:53.791219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256ab6b-5e77-4fff-8e81-fb51509e2717 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:53.804426 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:54.033894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8256ab6b-5e77-4fff-8e81-fb51509e2717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0535675f5bd4a38855c6dd5fc90b9d6', 'request_id': 'req-8256ab6b-5e77-4fff-8e81-fb51509e2717'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:54.155046 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8256ab6b-5e77-4fff-8e81-fb51509e2717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0535675f5bd4a38855c6dd5fc90b9d6', 'request_id': 'req-8256ab6b-5e77-4fff-8e81-fb51509e2717'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:54.167533 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8256ab6b-5e77-4fff-8e81-fb51509e2717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0535675f5bd4a38855c6dd5fc90b9d6', 'request_id': 'req-8256ab6b-5e77-4fff-8e81-fb51509e2717'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:54.192999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8256ab6b-5e77-4fff-8e81-fb51509e2717 admin admin] The token cache is being invalidate because project c0535675f5bd4a38855c6dd5fc90b9d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:54.194097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8256ab6b-5e77-4fff-8e81-fb51509e2717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:54.195709 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8256ab6b-5e77-4fff-8e81-fb51509e2717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:54.220228 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1092/2155] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:53 2022] DELETE /identity/v3/projects/c0535675f5bd4a38855c6dd5fc90b9d6 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:54.227211 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b96826-a798-4a92-aa08-b1d2ac2becbc service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:54.244981 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b96826-a798-4a92-aa08-b1d2ac2becbc service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:54.362063 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0e9d3-ffd3-4103-a6b1-a2f0413c997f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:54.363027 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0e9d3-ffd3-4103-a6b1-a2f0413c997f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:54.363317 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0e9d3-ffd3-4103-a6b1-a2f0413c997f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:54.363736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0e9d3-ffd3-4103-a6b1-a2f0413c997f admin admin] PATH_INFO: `/v3/users/6b443c01a3864f32a9bd5f579ee9ba04` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:54.365872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0e9d3-ffd3-4103-a6b1-a2f0413c997f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b443c01a3864f32a9bd5f579ee9ba04)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:54.368950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0e9d3-ffd3-4103-a6b1-a2f0413c997f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:54.522101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:54.663965 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-76c0e9d3-ffd3-4103-a6b1-a2f0413c997f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b443c01a3864f32a9bd5f579ee9ba04'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:54.664776 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-76c0e9d3-ffd3-4103-a6b1-a2f0413c997f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b443c01a3864f32a9bd5f579ee9ba04'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:54.665395 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-76c0e9d3-ffd3-4103-a6b1-a2f0413c997f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b443c01a3864f32a9bd5f579ee9ba04'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:54.744161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-76c0e9d3-ffd3-4103-a6b1-a2f0413c997f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b443c01a3864f32a9bd5f579ee9ba04'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:54.766023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-76c0e9d3-ffd3-4103-a6b1-a2f0413c997f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b443c01a3864f32a9bd5f579ee9ba04'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:54.795446 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1064/2156] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 16:59:54 2022] DELETE /identity/v3/users/6b443c01a3864f32a9bd5f579ee9ba04 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:55.529493 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256ab6b-5e77-4fff-8e81-fb51509e2717 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:55.531577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8256ab6b-5e77-4fff-8e81-fb51509e2717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:55.557252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256ab6b-5e77-4fff-8e81-fb51509e2717 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:55.695428 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f018fc5-6f08-4137-907f-6f194f1307e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:55.696396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f018fc5-6f08-4137-907f-6f194f1307e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:55.701522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f018fc5-6f08-4137-907f-6f194f1307e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:55.702807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f018fc5-6f08-4137-907f-6f194f1307e2 admin admin] PATH_INFO: `/v3/projects/2e02820540934b4a9c69a739390524f7` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:55.704559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f018fc5-6f08-4137-907f-6f194f1307e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e02820540934b4a9c69a739390524f7)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:55.706791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f018fc5-6f08-4137-907f-6f194f1307e2 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:55.926516 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9f018fc5-6f08-4137-907f-6f194f1307e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e02820540934b4a9c69a739390524f7', 'request_id': 'req-9f018fc5-6f08-4137-907f-6f194f1307e2'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:56.043625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9f018fc5-6f08-4137-907f-6f194f1307e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e02820540934b4a9c69a739390524f7', 'request_id': 'req-9f018fc5-6f08-4137-907f-6f194f1307e2'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:56.062626 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9f018fc5-6f08-4137-907f-6f194f1307e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e02820540934b4a9c69a739390524f7', 'request_id': 'req-9f018fc5-6f08-4137-907f-6f194f1307e2'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:56.129131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9f018fc5-6f08-4137-907f-6f194f1307e2 admin admin] The token cache is being invalidate because project 2e02820540934b4a9c69a739390524f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:56.129694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9f018fc5-6f08-4137-907f-6f194f1307e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:56.135262 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9f018fc5-6f08-4137-907f-6f194f1307e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:56.152986 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1093/2157] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 16:59:55 2022] DELETE /identity/v3/projects/2e02820540934b4a9c69a739390524f7 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:56.160997 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba550ae-ac0b-4ce7-93ab-37957e537923 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:56.161463 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba550ae-ac0b-4ce7-93ab-37957e537923 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:56.161556 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba550ae-ac0b-4ce7-93ab-37957e537923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:56.193471 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-bba550ae-ac0b-4ce7-93ab-37957e537923 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:56.198736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-bba550ae-ac0b-4ce7-93ab-37957e537923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:56.326257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1065/2158] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:56.341663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983569bf-6ded-4acc-9d05-13fa759be11e None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:56.341663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983569bf-6ded-4acc-9d05-13fa759be11e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:56.341663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983569bf-6ded-4acc-9d05-13fa759be11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:56.392459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-983569bf-6ded-4acc-9d05-13fa759be11e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:56.393714 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-983569bf-6ded-4acc-9d05-13fa759be11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:56.441203 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1094/2159] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:56.447562 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba550ae-ac0b-4ce7-93ab-37957e537923 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:56.468426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba550ae-ac0b-4ce7-93ab-37957e537923 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:56.487430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c3ae7-092e-41a6-9d99-32ee2553ef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:56.488126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c3ae7-092e-41a6-9d99-32ee2553ef44 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:56.488419 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c3ae7-092e-41a6-9d99-32ee2553ef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:56.488702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c3ae7-092e-41a6-9d99-32ee2553ef44 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:56.489461 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c3ae7-092e-41a6-9d99-32ee2553ef44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:59:56.489776 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c3ae7-092e-41a6-9d99-32ee2553ef44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:56.491621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c3ae7-092e-41a6-9d99-32ee2553ef44 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:56.532714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1066/2160] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 16:59:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:59:56.538892 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983569bf-6ded-4acc-9d05-13fa759be11e None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:56.556989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983569bf-6ded-4acc-9d05-13fa759be11e None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:56.604899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088780bf-deff-4720-86bc-ce65e84d92d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:56.605861 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088780bf-deff-4720-86bc-ce65e84d92d2 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:56.606337 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088780bf-deff-4720-86bc-ce65e84d92d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:56.606774 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088780bf-deff-4720-86bc-ce65e84d92d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:56.607643 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088780bf-deff-4720-86bc-ce65e84d92d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:56.611090 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088780bf-deff-4720-86bc-ce65e84d92d2 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:56.672613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:56.755591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1095/2161] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 16:59:56 2022] POST /identity/v3/projects => generated 378 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:56.760293 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c3ae7-092e-41a6-9d99-32ee2553ef44 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:56.778394 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c3ae7-092e-41a6-9d99-32ee2553ef44 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:56.899518 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d430746-15b1-40a7-a00c-24cd340559a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:56.901475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d430746-15b1-40a7-a00c-24cd340559a8 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:56.902395 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d430746-15b1-40a7-a00c-24cd340559a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:56.902843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d430746-15b1-40a7-a00c-24cd340559a8 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:56.904333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d430746-15b1-40a7-a00c-24cd340559a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:56.908672 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d430746-15b1-40a7-a00c-24cd340559a8 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:57.091196 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1067/2162] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 16:59:56 2022] POST /identity/v3/users => generated 290 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:57.094989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088780bf-deff-4720-86bc-ce65e84d92d2 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:57.121657 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088780bf-deff-4720-86bc-ce65e84d92d2 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:57.122968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af642a-0670-46c6-a15a-cf73aa97219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:57.123655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af642a-0670-46c6-a15a-cf73aa97219a admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:57.124106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af642a-0670-46c6-a15a-cf73aa97219a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:57.124462 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af642a-0670-46c6-a15a-cf73aa97219a admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:57.125301 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af642a-0670-46c6-a15a-cf73aa97219a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:57.134561 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af642a-0670-46c6-a15a-cf73aa97219a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:57.163474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1096/2163] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:57 2022] GET /identity/v3/roles => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:57.164413 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d430746-15b1-40a7-a00c-24cd340559a8 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:57.195251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d430746-15b1-40a7-a00c-24cd340559a8 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:57.212841 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ca80f-9a9f-4e87-ab06-989305e422b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:57.213547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ca80f-9a9f-4e87-ab06-989305e422b0 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:57.213839 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ca80f-9a9f-4e87-ab06-989305e422b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:57.214124 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ca80f-9a9f-4e87-ab06-989305e422b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:57.214891 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ca80f-9a9f-4e87-ab06-989305e422b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:57.216575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ca80f-9a9f-4e87-ab06-989305e422b0 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:57.246914 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1068/2164] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 16:59:57 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:57.248438 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af642a-0670-46c6-a15a-cf73aa97219a admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:57.268767 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af642a-0670-46c6-a15a-cf73aa97219a admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:57.284523 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60b74c-9f07-4ed6-80dc-3828aafe6c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:57.285648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60b74c-9f07-4ed6-80dc-3828aafe6c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:57.286096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60b74c-9f07-4ed6-80dc-3828aafe6c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:57.286579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60b74c-9f07-4ed6-80dc-3828aafe6c60 admin admin] PATH_INFO: `/v3/projects/ed4f536fcafe46b5ae159b93acb7e041/users/530b2b1951644755afd1432381cf37f9/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:57.314009 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60b74c-9f07-4ed6-80dc-3828aafe6c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed4f536fcafe46b5ae159b93acb7e041, user_id=530b2b1951644755afd1432381cf37f9, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:57.317087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60b74c-9f07-4ed6-80dc-3828aafe6c60 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:57.408303 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1097/2165] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 16:59:57 2022] PUT /identity/v3/projects/ed4f536fcafe46b5ae159b93acb7e041/users/530b2b1951644755afd1432381cf37f9/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:57.413639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3473b-4eb0-47a0-b241-1197c083fc90 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:57.413935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3473b-4eb0-47a0-b241-1197c083fc90 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:57.414220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3473b-4eb0-47a0-b241-1197c083fc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:57.457381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-73b3473b-4eb0-47a0-b241-1197c083fc90 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:57.460382 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-73b3473b-4eb0-47a0-b241-1197c083fc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:57.469789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:57.578668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1069/2166] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 16:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:57.587150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60b74c-9f07-4ed6-80dc-3828aafe6c60 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:57.589466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-cc60b74c-9f07-4ed6-80dc-3828aafe6c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:57.665246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60b74c-9f07-4ed6-80dc-3828aafe6c60 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:57.670842 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e0334-7fec-4b07-9054-99ab2b00f00a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:57.671764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e0334-7fec-4b07-9054-99ab2b00f00a service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:57.672059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e0334-7fec-4b07-9054-99ab2b00f00a service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:57.672339 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e0334-7fec-4b07-9054-99ab2b00f00a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:57.685166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e0334-7fec-4b07-9054-99ab2b00f00a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:57.686713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e0334-7fec-4b07-9054-99ab2b00f00a service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:57.697552 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1098/2167] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 16:59:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:04.699610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5a023-48d4-4ae2-9fb5-c759c5e64391 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:04.703790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5a023-48d4-4ae2-9fb5-c759c5e64391 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:04.705001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5a023-48d4-4ae2-9fb5-c759c5e64391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:04.726679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-c2e5a023-48d4-4ae2-9fb5-c759c5e64391 None None] MFA Rules not processed for user `1f3a90c131984e8f8ab7b63679b39adc`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:04.726679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-c2e5a023-48d4-4ae2-9fb5-c759c5e64391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:04.819424 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1070/2168] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:00:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:05.584194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ba339-7a6f-4461-8d57-88a223467c3b None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:05.586023 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ba339-7a6f-4461-8d57-88a223467c3b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:05.586734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ba339-7a6f-4461-8d57-88a223467c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:05.607164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-2a4ba339-7a6f-4461-8d57-88a223467c3b None None] MFA Rules not processed for user `0288901db0244eab9a737af460ce1bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:05.609631 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-2a4ba339-7a6f-4461-8d57-88a223467c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:05.616468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1099/2169] 10.222.0.112 () {58 vars in 1014 bytes} [Thu May 26 17:00:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:00:05.643027 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5a023-48d4-4ae2-9fb5-c759c5e64391 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:05.655514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5a023-48d4-4ae2-9fb5-c759c5e64391 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:05.659962 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7fa4e-7451-4f1b-b19f-24ab8a0ddbe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:05.660702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7fa4e-7451-4f1b-b19f-24ab8a0ddbe1 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:05.661080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7fa4e-7451-4f1b-b19f-24ab8a0ddbe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:05.661439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7fa4e-7451-4f1b-b19f-24ab8a0ddbe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:05.669371 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7fa4e-7451-4f1b-b19f-24ab8a0ddbe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:05.671565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7fa4e-7451-4f1b-b19f-24ab8a0ddbe1 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:05.679938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1071/2170] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:00:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:06.073486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f7333-abf1-4e9a-a580-2f7513225365 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:06.073777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f7333-abf1-4e9a-a580-2f7513225365 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:06.075600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f7333-abf1-4e9a-a580-2f7513225365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:06.113895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-877f7333-abf1-4e9a-a580-2f7513225365 None None] MFA Rules not processed for user `530b2b1951644755afd1432381cf37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:06.115343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-877f7333-abf1-4e9a-a580-2f7513225365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:06.257184 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1100/2171] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:00:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:06.265342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7fa4e-7451-4f1b-b19f-24ab8a0ddbe1 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:06.279687 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7fa4e-7451-4f1b-b19f-24ab8a0ddbe1 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:06.284880 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7e04d-23ef-41e2-9fa2-274f62c57945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:06.285592 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7e04d-23ef-41e2-9fa2-274f62c57945 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:06.293292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7e04d-23ef-41e2-9fa2-274f62c57945 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:06.293292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7e04d-23ef-41e2-9fa2-274f62c57945 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:06.293292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7e04d-23ef-41e2-9fa2-274f62c57945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:06.293292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7e04d-23ef-41e2-9fa2-274f62c57945 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:06.385247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1072/2172] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:00:06 2022] POST /identity/v3/projects => generated 380 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:00:06.387669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f7333-abf1-4e9a-a580-2f7513225365 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:06.402523 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f7333-abf1-4e9a-a580-2f7513225365 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:06.488997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:06.507490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0422b23-805d-44cd-8074-1540a72dfa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:06.508557 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0422b23-805d-44cd-8074-1540a72dfa7a admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:06.508701 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0422b23-805d-44cd-8074-1540a72dfa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:06.508944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0422b23-805d-44cd-8074-1540a72dfa7a admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:06.509744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0422b23-805d-44cd-8074-1540a72dfa7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:06.512356 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0422b23-805d-44cd-8074-1540a72dfa7a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:06.626258 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1101/2173] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:00:06 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:00:06.627104 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7e04d-23ef-41e2-9fa2-274f62c57945 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:06.655522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7e04d-23ef-41e2-9fa2-274f62c57945 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:06.669287 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048e4e8-d2d6-4a00-bfc5-a42435211f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:06.674676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048e4e8-d2d6-4a00-bfc5-a42435211f6c admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:06.675452 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048e4e8-d2d6-4a00-bfc5-a42435211f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:06.675930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048e4e8-d2d6-4a00-bfc5-a42435211f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:06.676890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048e4e8-d2d6-4a00-bfc5-a42435211f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:06.678754 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048e4e8-d2d6-4a00-bfc5-a42435211f6c admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:06.730381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1073/2174] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:00:06 2022] GET /identity/v3/roles => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:06.732765 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0422b23-805d-44cd-8074-1540a72dfa7a admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:06.746199 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0422b23-805d-44cd-8074-1540a72dfa7a admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:06.760555 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256eabe-000f-4965-9a55-55d704e95f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:06.766982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256eabe-000f-4965-9a55-55d704e95f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:06.766982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256eabe-000f-4965-9a55-55d704e95f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:06.766982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256eabe-000f-4965-9a55-55d704e95f3a admin admin] PATH_INFO: `/v3/projects/6b8a6bd0c7274c68b1eb6d40d20b2eb1/users/dfa767a4b12e41d5a4e6653eb559f9f7/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:06.786731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256eabe-000f-4965-9a55-55d704e95f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8a6bd0c7274c68b1eb6d40d20b2eb1, user_id=dfa767a4b12e41d5a4e6653eb559f9f7, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:06.789819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256eabe-000f-4965-9a55-55d704e95f3a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:06.877049 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1102/2175] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:00:06 2022] PUT /identity/v3/projects/6b8a6bd0c7274c68b1eb6d40d20b2eb1/users/dfa767a4b12e41d5a4e6653eb559f9f7/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:06.882467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048e4e8-d2d6-4a00-bfc5-a42435211f6c admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:06.893539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048e4e8-d2d6-4a00-bfc5-a42435211f6c admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:06.955599 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756a27b-2434-4556-b2cb-e0f90846cf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:06.956322 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756a27b-2434-4556-b2cb-e0f90846cf08 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:06.956613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756a27b-2434-4556-b2cb-e0f90846cf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:06.956893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756a27b-2434-4556-b2cb-e0f90846cf08 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:06.957877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756a27b-2434-4556-b2cb-e0f90846cf08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:06.959614 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756a27b-2434-4556-b2cb-e0f90846cf08 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:06.972886 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1074/2176] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:00:06 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:06.974145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256eabe-000f-4965-9a55-55d704e95f3a admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:06.986080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256eabe-000f-4965-9a55-55d704e95f3a admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:06.992158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88589d73-54ee-40d5-a8e7-af03ee867b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:06.993287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88589d73-54ee-40d5-a8e7-af03ee867b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:06.993453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88589d73-54ee-40d5-a8e7-af03ee867b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:06.993658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88589d73-54ee-40d5-a8e7-af03ee867b49 admin admin] PATH_INFO: `/v3/projects/6b8a6bd0c7274c68b1eb6d40d20b2eb1/users/dfa767a4b12e41d5a4e6653eb559f9f7/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:06.995660 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88589d73-54ee-40d5-a8e7-af03ee867b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8a6bd0c7274c68b1eb6d40d20b2eb1, user_id=dfa767a4b12e41d5a4e6653eb559f9f7, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:06.999232 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88589d73-54ee-40d5-a8e7-af03ee867b49 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:07.010110 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1103/2177] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:00:06 2022] PUT /identity/v3/projects/6b8a6bd0c7274c68b1eb6d40d20b2eb1/users/dfa767a4b12e41d5a4e6653eb559f9f7/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:00:08.146074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756a27b-2434-4556-b2cb-e0f90846cf08 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:08.149167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2756a27b-2434-4556-b2cb-e0f90846cf08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:08.164463 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:08.169173 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756a27b-2434-4556-b2cb-e0f90846cf08 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:08.273536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f46a96-c117-4598-9002-9f0c3d4fdfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:08.275072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f46a96-c117-4598-9002-9f0c3d4fdfd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:08.275239 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f46a96-c117-4598-9002-9f0c3d4fdfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:08.275686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f46a96-c117-4598-9002-9f0c3d4fdfd2 admin admin] PATH_INFO: `/v3/users/265c5705341f4d189c182c7f25247c29` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:08.276954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f46a96-c117-4598-9002-9f0c3d4fdfd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=265c5705341f4d189c182c7f25247c29)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:08.278997 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f46a96-c117-4598-9002-9f0c3d4fdfd2 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:08.547894 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-71f46a96-c117-4598-9002-9f0c3d4fdfd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '265c5705341f4d189c182c7f25247c29'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:08.548768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-71f46a96-c117-4598-9002-9f0c3d4fdfd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '265c5705341f4d189c182c7f25247c29'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:08.549568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-71f46a96-c117-4598-9002-9f0c3d4fdfd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '265c5705341f4d189c182c7f25247c29'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:08.646846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-71f46a96-c117-4598-9002-9f0c3d4fdfd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '265c5705341f4d189c182c7f25247c29'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:08.661280 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-71f46a96-c117-4598-9002-9f0c3d4fdfd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '265c5705341f4d189c182c7f25247c29'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:08.675644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1075/2178] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:00:08 2022] DELETE /identity/v3/users/265c5705341f4d189c182c7f25247c29 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:08.680475 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ac13a-1012-4a89-809c-5d29821835b3 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:08.681008 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ac13a-1012-4a89-809c-5d29821835b3 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:08.681008 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ac13a-1012-4a89-809c-5d29821835b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:08.710735 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-550ac13a-1012-4a89-809c-5d29821835b3 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:08.712164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-550ac13a-1012-4a89-809c-5d29821835b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:08.775151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1104/2179] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:08.786749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f46a96-c117-4598-9002-9f0c3d4fdfd2 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:08.789536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-71f46a96-c117-4598-9002-9f0c3d4fdfd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:08.865054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f46a96-c117-4598-9002-9f0c3d4fdfd2 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:08.869609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b712466-32d3-4bdc-919e-b62bf12e3eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:08.870216 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b712466-32d3-4bdc-919e-b62bf12e3eae service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:08.870550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b712466-32d3-4bdc-919e-b62bf12e3eae service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:08.870852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b712466-32d3-4bdc-919e-b62bf12e3eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:08.888681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b712466-32d3-4bdc-919e-b62bf12e3eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:08.891569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b712466-32d3-4bdc-919e-b62bf12e3eae service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:08.911578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1076/2180] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:09.610952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ac13a-1012-4a89-809c-5d29821835b3 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:09.612428 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-550ac13a-1012-4a89-809c-5d29821835b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:09.635779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ac13a-1012-4a89-809c-5d29821835b3 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:09.643602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af6ee3-62e7-4b62-a77c-d3de36fb8595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:09.644824 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af6ee3-62e7-4b62-a77c-d3de36fb8595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:09.645151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af6ee3-62e7-4b62-a77c-d3de36fb8595 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:09.645534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af6ee3-62e7-4b62-a77c-d3de36fb8595 admin admin] PATH_INFO: `/v3/projects/cb5015c95bdb4df398b7fbb87a9d7911` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:09.646921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af6ee3-62e7-4b62-a77c-d3de36fb8595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb5015c95bdb4df398b7fbb87a9d7911)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:09.649280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af6ee3-62e7-4b62-a77c-d3de36fb8595 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:09.853474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-09af6ee3-62e7-4b62-a77c-d3de36fb8595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb5015c95bdb4df398b7fbb87a9d7911', 'request_id': 'req-09af6ee3-62e7-4b62-a77c-d3de36fb8595'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:10.035020 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-09af6ee3-62e7-4b62-a77c-d3de36fb8595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb5015c95bdb4df398b7fbb87a9d7911', 'request_id': 'req-09af6ee3-62e7-4b62-a77c-d3de36fb8595'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:10.046913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-09af6ee3-62e7-4b62-a77c-d3de36fb8595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb5015c95bdb4df398b7fbb87a9d7911', 'request_id': 'req-09af6ee3-62e7-4b62-a77c-d3de36fb8595'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:10.070101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-09af6ee3-62e7-4b62-a77c-d3de36fb8595 admin admin] The token cache is being invalidate because project cb5015c95bdb4df398b7fbb87a9d7911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:00:10.070429 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-09af6ee3-62e7-4b62-a77c-d3de36fb8595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:10.072682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-09af6ee3-62e7-4b62-a77c-d3de36fb8595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:10.074933 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1105/2181] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:00:09 2022] DELETE /identity/v3/projects/cb5015c95bdb4df398b7fbb87a9d7911 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:00:10.079915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c923e4b-2336-43cb-80aa-ca7a2b853407 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:10.080394 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c923e4b-2336-43cb-80aa-ca7a2b853407 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:10.080488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c923e4b-2336-43cb-80aa-ca7a2b853407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:10.100850 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-8c923e4b-2336-43cb-80aa-ca7a2b853407 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:10.104370 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8c923e4b-2336-43cb-80aa-ca7a2b853407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:10.177575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:10.315961 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1077/2182] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:10.318811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f505bb3-eab1-4e76-8016-9806a6504e6b None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:10.319358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f505bb3-eab1-4e76-8016-9806a6504e6b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:10.319847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f505bb3-eab1-4e76-8016-9806a6504e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:10.355770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-6f505bb3-eab1-4e76-8016-9806a6504e6b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:10.357543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6f505bb3-eab1-4e76-8016-9806a6504e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:10.383310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1106/2183] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:10.388934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c923e4b-2336-43cb-80aa-ca7a2b853407 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:10.404862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c923e4b-2336-43cb-80aa-ca7a2b853407 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:10.415241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1eae8-11af-4a4b-9358-440c7aece635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:10.416760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1eae8-11af-4a4b-9358-440c7aece635 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:10.417475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1eae8-11af-4a4b-9358-440c7aece635 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:10.417903 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1eae8-11af-4a4b-9358-440c7aece635 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:10.419648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1eae8-11af-4a4b-9358-440c7aece635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:00:10.420846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1eae8-11af-4a4b-9358-440c7aece635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:10.437402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1eae8-11af-4a4b-9358-440c7aece635 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:10.476745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1078/2184] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:00:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:00:10.477103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f505bb3-eab1-4e76-8016-9806a6504e6b None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:10.495029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f505bb3-eab1-4e76-8016-9806a6504e6b None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:10.502018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7288904-1167-4dc8-ab51-efcb9d1bd47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:10.507485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7288904-1167-4dc8-ab51-efcb9d1bd47d admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:10.507797 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7288904-1167-4dc8-ab51-efcb9d1bd47d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:10.510712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7288904-1167-4dc8-ab51-efcb9d1bd47d admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:10.511454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7288904-1167-4dc8-ab51-efcb9d1bd47d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:10.514620 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7288904-1167-4dc8-ab51-efcb9d1bd47d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:10.535072 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:10.638214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1107/2185] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:00:10 2022] POST /identity/v3/projects => generated 360 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:00:10.643708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1eae8-11af-4a4b-9358-440c7aece635 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:10.656158 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1eae8-11af-4a4b-9358-440c7aece635 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:10.750198 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865c5f5-2831-4873-ae14-b4db338e902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:10.750995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865c5f5-2831-4873-ae14-b4db338e902f admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:10.751288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865c5f5-2831-4873-ae14-b4db338e902f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:10.752143 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865c5f5-2831-4873-ae14-b4db338e902f admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:10.752878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865c5f5-2831-4873-ae14-b4db338e902f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:10.756352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865c5f5-2831-4873-ae14-b4db338e902f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:10.918364 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1079/2186] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:00:10 2022] POST /identity/v3/users => generated 281 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:00:10.920198 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7288904-1167-4dc8-ab51-efcb9d1bd47d admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:10.935210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7288904-1167-4dc8-ab51-efcb9d1bd47d admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:10.936110 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd4290-a29d-4b57-af31-ee95f0f68358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:10.936864 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd4290-a29d-4b57-af31-ee95f0f68358 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:10.937144 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd4290-a29d-4b57-af31-ee95f0f68358 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:10.937417 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd4290-a29d-4b57-af31-ee95f0f68358 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:10.938136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd4290-a29d-4b57-af31-ee95f0f68358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:10.939780 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd4290-a29d-4b57-af31-ee95f0f68358 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:10.950132 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1108/2187] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:00:10 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:10.954200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865c5f5-2831-4873-ae14-b4db338e902f admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:10.965036 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865c5f5-2831-4873-ae14-b4db338e902f admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:10.970684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e14ed-6242-43b3-9200-98cfa7840eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:10.971361 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e14ed-6242-43b3-9200-98cfa7840eaf admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:10.971653 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e14ed-6242-43b3-9200-98cfa7840eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:10.971939 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e14ed-6242-43b3-9200-98cfa7840eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:10.972670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e14ed-6242-43b3-9200-98cfa7840eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:10.974362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e14ed-6242-43b3-9200-98cfa7840eaf admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:10.985365 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1080/2188] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:00:10 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:10.989598 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd4290-a29d-4b57-af31-ee95f0f68358 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:11.000211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd4290-a29d-4b57-af31-ee95f0f68358 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:11.004891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add9731-6a59-47a1-9f4c-b69f76e5e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:11.005884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add9731-6a59-47a1-9f4c-b69f76e5e5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:11.006173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add9731-6a59-47a1-9f4c-b69f76e5e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:11.006531 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add9731-6a59-47a1-9f4c-b69f76e5e5e5 admin admin] PATH_INFO: `/v3/projects/ddf8dd258e614d30958a47f43678c698/users/f217fd54a60a4353b04ce8bda2da1e6b/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:11.021230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add9731-6a59-47a1-9f4c-b69f76e5e5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf8dd258e614d30958a47f43678c698, user_id=f217fd54a60a4353b04ce8bda2da1e6b, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:11.024035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add9731-6a59-47a1-9f4c-b69f76e5e5e5 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:11.169967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1109/2189] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:00:10 2022] PUT /identity/v3/projects/ddf8dd258e614d30958a47f43678c698/users/f217fd54a60a4353b04ce8bda2da1e6b/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:11.180527 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974d51a-f6ab-4821-889e-0d55f63c5380 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:11.181046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974d51a-f6ab-4821-889e-0d55f63c5380 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:11.181123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974d51a-f6ab-4821-889e-0d55f63c5380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:11.219927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-3974d51a-f6ab-4821-889e-0d55f63c5380 None None] MFA Rules not processed for user `f217fd54a60a4353b04ce8bda2da1e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:11.221196 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-3974d51a-f6ab-4821-889e-0d55f63c5380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:11.300359 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1081/2190] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:00:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:00:11.339248 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add9731-6a59-47a1-9f4c-b69f76e5e5e5 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:11.342607 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-3add9731-6a59-47a1-9f4c-b69f76e5e5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:11.418678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add9731-6a59-47a1-9f4c-b69f76e5e5e5 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:11.426279 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a6556-d1d8-40b8-8c6a-526237fd002d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:11.427239 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a6556-d1d8-40b8-8c6a-526237fd002d service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:11.427529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a6556-d1d8-40b8-8c6a-526237fd002d service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:11.427801 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a6556-d1d8-40b8-8c6a-526237fd002d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:11.440184 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a6556-d1d8-40b8-8c6a-526237fd002d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:11.441824 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a6556-d1d8-40b8-8c6a-526237fd002d service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:11.467198 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1110/2191] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:00:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:11.487527 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974d51a-f6ab-4821-889e-0d55f63c5380 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:11.520740 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:11.563374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974d51a-f6ab-4821-889e-0d55f63c5380 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:11.568044 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436581dc-5d3a-491b-accf-c63a0dfe400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:11.568931 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436581dc-5d3a-491b-accf-c63a0dfe400d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:11.569214 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436581dc-5d3a-491b-accf-c63a0dfe400d admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:11.569491 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436581dc-5d3a-491b-accf-c63a0dfe400d admin admin] PATH_INFO: `/v3/users/f217fd54a60a4353b04ce8bda2da1e6b` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:11.570865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436581dc-5d3a-491b-accf-c63a0dfe400d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f217fd54a60a4353b04ce8bda2da1e6b)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:11.572814 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436581dc-5d3a-491b-accf-c63a0dfe400d admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:11.794779 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-436581dc-5d3a-491b-accf-c63a0dfe400d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f217fd54a60a4353b04ce8bda2da1e6b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:11.796926 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-436581dc-5d3a-491b-accf-c63a0dfe400d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f217fd54a60a4353b04ce8bda2da1e6b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:11.797750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-436581dc-5d3a-491b-accf-c63a0dfe400d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f217fd54a60a4353b04ce8bda2da1e6b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:11.921584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-436581dc-5d3a-491b-accf-c63a0dfe400d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f217fd54a60a4353b04ce8bda2da1e6b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:11.942423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-436581dc-5d3a-491b-accf-c63a0dfe400d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f217fd54a60a4353b04ce8bda2da1e6b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:11.962846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1082/2192] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:00:11 2022] DELETE /identity/v3/users/f217fd54a60a4353b04ce8bda2da1e6b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:11.968275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45db424-3ae4-4380-a157-84a606662469 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:11.969278 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45db424-3ae4-4380-a157-84a606662469 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:11.970142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45db424-3ae4-4380-a157-84a606662469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:11.997364 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-d45db424-3ae4-4380-a157-84a606662469 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:11.999886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d45db424-3ae4-4380-a157-84a606662469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:12.090488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1111/2193] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:12.101187 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436581dc-5d3a-491b-accf-c63a0dfe400d admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:12.103654 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-436581dc-5d3a-491b-accf-c63a0dfe400d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:12.236628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436581dc-5d3a-491b-accf-c63a0dfe400d admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:12.253126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5a756-a9ad-4521-900b-1f9ad8e6a1fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:12.254088 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5a756-a9ad-4521-900b-1f9ad8e6a1fb service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:12.255046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5a756-a9ad-4521-900b-1f9ad8e6a1fb service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:12.256054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5a756-a9ad-4521-900b-1f9ad8e6a1fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:12.272519 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5a756-a9ad-4521-900b-1f9ad8e6a1fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:12.274938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5a756-a9ad-4521-900b-1f9ad8e6a1fb service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:12.318175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1083/2194] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:12.900210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45db424-3ae4-4380-a157-84a606662469 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:12.902263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d45db424-3ae4-4380-a157-84a606662469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:12.915563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45db424-3ae4-4380-a157-84a606662469 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:12.921410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222cb55-8fbe-4e42-bda7-bd16ef5c371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:12.924078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222cb55-8fbe-4e42-bda7-bd16ef5c371a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:12.924078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222cb55-8fbe-4e42-bda7-bd16ef5c371a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:12.924078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222cb55-8fbe-4e42-bda7-bd16ef5c371a admin admin] PATH_INFO: `/v3/projects/ddf8dd258e614d30958a47f43678c698` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:12.928036 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222cb55-8fbe-4e42-bda7-bd16ef5c371a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf8dd258e614d30958a47f43678c698)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:12.930139 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222cb55-8fbe-4e42-bda7-bd16ef5c371a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:13.092023 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6222cb55-8fbe-4e42-bda7-bd16ef5c371a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf8dd258e614d30958a47f43678c698', 'request_id': 'req-6222cb55-8fbe-4e42-bda7-bd16ef5c371a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:13.098807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:13.166743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6222cb55-8fbe-4e42-bda7-bd16ef5c371a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf8dd258e614d30958a47f43678c698', 'request_id': 'req-6222cb55-8fbe-4e42-bda7-bd16ef5c371a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:13.179562 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6222cb55-8fbe-4e42-bda7-bd16ef5c371a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf8dd258e614d30958a47f43678c698', 'request_id': 'req-6222cb55-8fbe-4e42-bda7-bd16ef5c371a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:13.191592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6222cb55-8fbe-4e42-bda7-bd16ef5c371a admin admin] The token cache is being invalidate because project ddf8dd258e614d30958a47f43678c698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:00:13.191885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6222cb55-8fbe-4e42-bda7-bd16ef5c371a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:13.192567 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6222cb55-8fbe-4e42-bda7-bd16ef5c371a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:13.195924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1112/2195] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:00:12 2022] DELETE /identity/v3/projects/ddf8dd258e614d30958a47f43678c698 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:13.199660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e3011-4777-4740-989b-938496890ee6 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:13.199952 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e3011-4777-4740-989b-938496890ee6 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:13.210063 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e3011-4777-4740-989b-938496890ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:13.220692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-eb4e3011-4777-4740-989b-938496890ee6 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:13.221983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-eb4e3011-4777-4740-989b-938496890ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:13.280497 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:13.337196 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1084/2196] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:00:13.348907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d6b9f-546d-4100-870b-13d81ddd80a2 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:13.350727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d6b9f-546d-4100-870b-13d81ddd80a2 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:13.351252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d6b9f-546d-4100-870b-13d81ddd80a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:13.386668 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-c44d6b9f-546d-4100-870b-13d81ddd80a2 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:13.387980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c44d6b9f-546d-4100-870b-13d81ddd80a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:13.410471 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1113/2197] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:13.414798 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e3011-4777-4740-989b-938496890ee6 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:13.429222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e3011-4777-4740-989b-938496890ee6 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:13.439322 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dcfa9-cbfb-433e-904a-d9dff6ab8f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:13.440232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dcfa9-cbfb-433e-904a-d9dff6ab8f0b admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:13.440679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dcfa9-cbfb-433e-904a-d9dff6ab8f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:13.441114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dcfa9-cbfb-433e-904a-d9dff6ab8f0b admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:13.442569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dcfa9-cbfb-433e-904a-d9dff6ab8f0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:00:13.443057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dcfa9-cbfb-433e-904a-d9dff6ab8f0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:13.446110 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dcfa9-cbfb-433e-904a-d9dff6ab8f0b admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:13.465964 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1085/2198] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:00:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:00:13.467697 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d6b9f-546d-4100-870b-13d81ddd80a2 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:13.479427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d6b9f-546d-4100-870b-13d81ddd80a2 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:13.485888 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010497c-d3a2-4a42-b943-bfcebf2536c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:13.486615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010497c-d3a2-4a42-b943-bfcebf2536c7 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:13.486907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010497c-d3a2-4a42-b943-bfcebf2536c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:13.487186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010497c-d3a2-4a42-b943-bfcebf2536c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:13.488233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010497c-d3a2-4a42-b943-bfcebf2536c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:13.490214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010497c-d3a2-4a42-b943-bfcebf2536c7 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:13.611800 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1114/2199] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:00:13 2022] POST /identity/v3/projects => generated 376 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:00:13.615760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dcfa9-cbfb-433e-904a-d9dff6ab8f0b admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:13.629221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dcfa9-cbfb-433e-904a-d9dff6ab8f0b admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:13.720413 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c40cfd-d103-4880-952b-1875b85298e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:13.721368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c40cfd-d103-4880-952b-1875b85298e1 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:13.721823 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c40cfd-d103-4880-952b-1875b85298e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:13.722450 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c40cfd-d103-4880-952b-1875b85298e1 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:13.723317 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c40cfd-d103-4880-952b-1875b85298e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:13.725511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c40cfd-d103-4880-952b-1875b85298e1 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:13.830676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1086/2200] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:00:13 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:00:13.837906 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010497c-d3a2-4a42-b943-bfcebf2536c7 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:13.851876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010497c-d3a2-4a42-b943-bfcebf2536c7 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:13.862089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe06900-6bc7-4a96-b31e-049a83c80268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:13.863395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe06900-6bc7-4a96-b31e-049a83c80268 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:13.863683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe06900-6bc7-4a96-b31e-049a83c80268 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:13.863958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe06900-6bc7-4a96-b31e-049a83c80268 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:13.864726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe06900-6bc7-4a96-b31e-049a83c80268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:13.866617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe06900-6bc7-4a96-b31e-049a83c80268 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:13.879169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1115/2201] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:00:13 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:13.883650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c40cfd-d103-4880-952b-1875b85298e1 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:13.898973 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c40cfd-d103-4880-952b-1875b85298e1 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:13.905987 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540014d-3def-47d5-89d4-762093c69b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:13.906703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540014d-3def-47d5-89d4-762093c69b51 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:13.906988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540014d-3def-47d5-89d4-762093c69b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:13.907338 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540014d-3def-47d5-89d4-762093c69b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:13.907995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540014d-3def-47d5-89d4-762093c69b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:13.909765 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540014d-3def-47d5-89d4-762093c69b51 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:13.923607 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1087/2202] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:00:13 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:13.928321 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe06900-6bc7-4a96-b31e-049a83c80268 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:13.945035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe06900-6bc7-4a96-b31e-049a83c80268 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:13.950495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0efea-67df-4aae-8b0b-9120db7a8bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:13.951592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0efea-67df-4aae-8b0b-9120db7a8bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:13.951944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0efea-67df-4aae-8b0b-9120db7a8bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:13.952296 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0efea-67df-4aae-8b0b-9120db7a8bb1 admin admin] PATH_INFO: `/v3/projects/7d68e5b2a9da4a0682932cb5298dff8e/users/6fbc89e17fb34ba6b7c67f226e54b557/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:13.973027 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0efea-67df-4aae-8b0b-9120db7a8bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d68e5b2a9da4a0682932cb5298dff8e, user_id=6fbc89e17fb34ba6b7c67f226e54b557, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:13.975846 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0efea-67df-4aae-8b0b-9120db7a8bb1 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:13.999401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dc001-2aee-4c04-b85a-244879101d8e None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:13.999690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dc001-2aee-4c04-b85a-244879101d8e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:14.000385 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dc001-2aee-4c04-b85a-244879101d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:14.028413 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-4b0dc001-2aee-4c04-b85a-244879101d8e None None] MFA Rules not processed for user `dfa767a4b12e41d5a4e6653eb559f9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:14.030175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4b0dc001-2aee-4c04-b85a-244879101d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:14.090781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1116/2203] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:00:13 2022] PUT /identity/v3/projects/7d68e5b2a9da4a0682932cb5298dff8e/users/6fbc89e17fb34ba6b7c67f226e54b557/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:14.094627 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ce5a5-24dc-4553-b516-a7a3dd56fc79 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:14.095190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ce5a5-24dc-4553-b516-a7a3dd56fc79 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:14.095271 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ce5a5-24dc-4553-b516-a7a3dd56fc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:14.119652 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1088/2204] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:00:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:00:14.130251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-f31ce5a5-24dc-4553-b516-a7a3dd56fc79 None None] MFA Rules not processed for user `6fbc89e17fb34ba6b7c67f226e54b557`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:14.131570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-f31ce5a5-24dc-4553-b516-a7a3dd56fc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:14.134578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dc001-2aee-4c04-b85a-244879101d8e None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:14.136253 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4b0dc001-2aee-4c04-b85a-244879101d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:14.186524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:14.210481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1117/2205] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:00:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:00:14.222642 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ce5a5-24dc-4553-b516-a7a3dd56fc79 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:14.226837 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-f31ce5a5-24dc-4553-b516-a7a3dd56fc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:14.234771 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dc001-2aee-4c04-b85a-244879101d8e None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:14.290267 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ce5a5-24dc-4553-b516-a7a3dd56fc79 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:14.295654 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cce14-c102-4994-9b61-4ab5d0f0289b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:14.296541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cce14-c102-4994-9b61-4ab5d0f0289b service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:14.296843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cce14-c102-4994-9b61-4ab5d0f0289b service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:14.297272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cce14-c102-4994-9b61-4ab5d0f0289b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:14.312124 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cce14-c102-4994-9b61-4ab5d0f0289b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:14.314227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cce14-c102-4994-9b61-4ab5d0f0289b service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:14.322234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fa1c6-cf84-4c3c-9ff6-70d23a480d22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:14.330108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fa1c6-cf84-4c3c-9ff6-70d23a480d22 service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:14.330108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fa1c6-cf84-4c3c-9ff6-70d23a480d22 service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:14.330108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fa1c6-cf84-4c3c-9ff6-70d23a480d22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:14.330108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8d3fa1c6-cf84-4c3c-9ff6-70d23a480d22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:14.330677 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1118/2206] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:00:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:00:14.386778 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fa1c6-cf84-4c3c-9ff6-70d23a480d22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:14.388382 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fa1c6-cf84-4c3c-9ff6-70d23a480d22 service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:14.398559 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1089/2207] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:00:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:00:23.665978 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e9f70-0f8f-47a3-9bdb-510ef9dedbab None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:23.666508 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e9f70-0f8f-47a3-9bdb-510ef9dedbab None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:23.666594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e9f70-0f8f-47a3-9bdb-510ef9dedbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:23.688279 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-811e9f70-0f8f-47a3-9bdb-510ef9dedbab None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:23.689508 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-811e9f70-0f8f-47a3-9bdb-510ef9dedbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:23.696753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:23.752957 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1119/2208] 10.222.0.112 () {58 vars in 1014 bytes} [Thu May 26 17:00:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:23.767932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fa1c6-cf84-4c3c-9ff6-70d23a480d22 service nova] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:23.769478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8d3fa1c6-cf84-4c3c-9ff6-70d23a480d22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:23.853457 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fa1c6-cf84-4c3c-9ff6-70d23a480d22 service nova] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:23.858897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8257f92-356f-41a2-bce2-89d1edb120b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:23.859601 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8257f92-356f-41a2-bce2-89d1edb120b3 service swift] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:23.859893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8257f92-356f-41a2-bce2-89d1edb120b3 service swift] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:23.860176 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8257f92-356f-41a2-bce2-89d1edb120b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:23.869731 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8257f92-356f-41a2-bce2-89d1edb120b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:23.871389 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8257f92-356f-41a2-bce2-89d1edb120b3 service swift] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:23.876688 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:23.881616 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1090/2209] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 17:00:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:00:34.064380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=20 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:44.376284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e9f70-0f8f-47a3-9bdb-510ef9dedbab None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:44.379603 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-811e9f70-0f8f-47a3-9bdb-510ef9dedbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:44.470878 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e9f70-0f8f-47a3-9bdb-510ef9dedbab None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:44.476563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa3e12-3397-4304-86f8-a225c355c470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:44.477454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa3e12-3397-4304-86f8-a225c355c470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:44.477758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa3e12-3397-4304-86f8-a225c355c470 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:44.478024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa3e12-3397-4304-86f8-a225c355c470 admin admin] PATH_INFO: `/v3/users/8f289555872e4e30a73ed9b67584c89c` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:44.479368 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa3e12-3397-4304-86f8-a225c355c470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f289555872e4e30a73ed9b67584c89c)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:44.481371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa3e12-3397-4304-86f8-a225c355c470 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:44.762221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-39fa3e12-3397-4304-86f8-a225c355c470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f289555872e4e30a73ed9b67584c89c'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:44.762899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-39fa3e12-3397-4304-86f8-a225c355c470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f289555872e4e30a73ed9b67584c89c'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:44.774507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-39fa3e12-3397-4304-86f8-a225c355c470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f289555872e4e30a73ed9b67584c89c'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:44.851669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-39fa3e12-3397-4304-86f8-a225c355c470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f289555872e4e30a73ed9b67584c89c'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:44.860187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-39fa3e12-3397-4304-86f8-a225c355c470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f289555872e4e30a73ed9b67584c89c'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:44.866263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1120/2210] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:00:44 2022] DELETE /identity/v3/users/8f289555872e4e30a73ed9b67584c89c => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:44.870712 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177fbf3-1487-45a1-aaa0-47ecddb8f18a None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:44.871320 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177fbf3-1487-45a1-aaa0-47ecddb8f18a None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:44.871432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177fbf3-1487-45a1-aaa0-47ecddb8f18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:44.888888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-d177fbf3-1487-45a1-aaa0-47ecddb8f18a None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:44.890079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d177fbf3-1487-45a1-aaa0-47ecddb8f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:44.962596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1091/2211] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:44.972669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa3e12-3397-4304-86f8-a225c355c470 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:44.974059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-39fa3e12-3397-4304-86f8-a225c355c470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:45.032610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa3e12-3397-4304-86f8-a225c355c470 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:45.036226 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889182-0d8d-43cb-b162-fb8e9ffafbd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:45.036869 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889182-0d8d-43cb-b162-fb8e9ffafbd2 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:45.037152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889182-0d8d-43cb-b162-fb8e9ffafbd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:45.037426 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889182-0d8d-43cb-b162-fb8e9ffafbd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:45.046426 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43889182-0d8d-43cb-b162-fb8e9ffafbd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:45.047858 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43889182-0d8d-43cb-b162-fb8e9ffafbd2 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:45.057619 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1121/2212] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:45.475017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177fbf3-1487-45a1-aaa0-47ecddb8f18a None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:45.476658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d177fbf3-1487-45a1-aaa0-47ecddb8f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:45.490855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177fbf3-1487-45a1-aaa0-47ecddb8f18a None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:45.495732 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602b29d-1c93-4f9b-a37e-91aaf5251d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:45.496751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602b29d-1c93-4f9b-a37e-91aaf5251d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:45.497113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602b29d-1c93-4f9b-a37e-91aaf5251d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:45.498010 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602b29d-1c93-4f9b-a37e-91aaf5251d4e admin admin] PATH_INFO: `/v3/projects/eb5a2ad6b216427d8c44af04ada64a6e` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:45.502472 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602b29d-1c93-4f9b-a37e-91aaf5251d4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb5a2ad6b216427d8c44af04ada64a6e)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:45.502472 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602b29d-1c93-4f9b-a37e-91aaf5251d4e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:45.639022 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4602b29d-1c93-4f9b-a37e-91aaf5251d4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb5a2ad6b216427d8c44af04ada64a6e', 'request_id': 'req-4602b29d-1c93-4f9b-a37e-91aaf5251d4e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:45.743705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4602b29d-1c93-4f9b-a37e-91aaf5251d4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb5a2ad6b216427d8c44af04ada64a6e', 'request_id': 'req-4602b29d-1c93-4f9b-a37e-91aaf5251d4e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:45.754482 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4602b29d-1c93-4f9b-a37e-91aaf5251d4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb5a2ad6b216427d8c44af04ada64a6e', 'request_id': 'req-4602b29d-1c93-4f9b-a37e-91aaf5251d4e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:45.767307 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4602b29d-1c93-4f9b-a37e-91aaf5251d4e admin admin] The token cache is being invalidate because project eb5a2ad6b216427d8c44af04ada64a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:00:45.771315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4602b29d-1c93-4f9b-a37e-91aaf5251d4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:45.771315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4602b29d-1c93-4f9b-a37e-91aaf5251d4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:45.771315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1092/2213] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:00:45 2022] DELETE /identity/v3/projects/eb5a2ad6b216427d8c44af04ada64a6e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:45.774828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db0265-46d5-418a-a0df-02085d2e52b3 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:45.775343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db0265-46d5-418a-a0df-02085d2e52b3 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:45.775472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db0265-46d5-418a-a0df-02085d2e52b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:45.793795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-63db0265-46d5-418a-a0df-02085d2e52b3 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:45.800061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-63db0265-46d5-418a-a0df-02085d2e52b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:45.818629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:45.948420 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1122/2214] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:45.955067 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47f8ed-548f-4b7c-bfdc-844a46f53940 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:45.955701 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47f8ed-548f-4b7c-bfdc-844a46f53940 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:45.955808 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47f8ed-548f-4b7c-bfdc-844a46f53940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:45.975913 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-8b47f8ed-548f-4b7c-bfdc-844a46f53940 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:45.977350 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8b47f8ed-548f-4b7c-bfdc-844a46f53940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:45.987780 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1093/2215] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:45.992733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db0265-46d5-418a-a0df-02085d2e52b3 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:46.004604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db0265-46d5-418a-a0df-02085d2e52b3 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:46.009766 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892f12e-d23b-4840-bb4e-d3fb97ae7c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:46.010459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892f12e-d23b-4840-bb4e-d3fb97ae7c40 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:46.010751 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892f12e-d23b-4840-bb4e-d3fb97ae7c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:46.011031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892f12e-d23b-4840-bb4e-d3fb97ae7c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:46.011793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892f12e-d23b-4840-bb4e-d3fb97ae7c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:00:46.012861 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892f12e-d23b-4840-bb4e-d3fb97ae7c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:46.014909 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892f12e-d23b-4840-bb4e-d3fb97ae7c40 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:46.029441 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1123/2216] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:00:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:00:46.033394 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47f8ed-548f-4b7c-bfdc-844a46f53940 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:46.043367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47f8ed-548f-4b7c-bfdc-844a46f53940 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:46.050040 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739a8b6-b4e6-4dcf-8248-6c92c0a8cc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:46.050747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739a8b6-b4e6-4dcf-8248-6c92c0a8cc4a admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:46.051034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739a8b6-b4e6-4dcf-8248-6c92c0a8cc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:46.051319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739a8b6-b4e6-4dcf-8248-6c92c0a8cc4a admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:46.052025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739a8b6-b4e6-4dcf-8248-6c92c0a8cc4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:46.054266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739a8b6-b4e6-4dcf-8248-6c92c0a8cc4a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:46.321695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1094/2217] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:00:46 2022] POST /identity/v3/projects => generated 364 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:00:46.326224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892f12e-d23b-4840-bb4e-d3fb97ae7c40 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:46.337743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892f12e-d23b-4840-bb4e-d3fb97ae7c40 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:46.396577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb7341-b746-47f3-b3dd-af5ac8406c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:46.397280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb7341-b746-47f3-b3dd-af5ac8406c9f admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:46.397565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb7341-b746-47f3-b3dd-af5ac8406c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:46.397844 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb7341-b746-47f3-b3dd-af5ac8406c9f admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:46.398583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb7341-b746-47f3-b3dd-af5ac8406c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:46.400570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb7341-b746-47f3-b3dd-af5ac8406c9f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:46.509921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1124/2218] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:00:46 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:00:46.515421 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739a8b6-b4e6-4dcf-8248-6c92c0a8cc4a admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:46.532929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739a8b6-b4e6-4dcf-8248-6c92c0a8cc4a admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:46.537848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07b7b6-4b7a-4753-8b57-b62982c23ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:46.541383 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b7b6-4b7a-4753-8b57-b62982c23ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:46.541383 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b7b6-4b7a-4753-8b57-b62982c23ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:46.541383 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b7b6-4b7a-4753-8b57-b62982c23ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:46.541383 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07b7b6-4b7a-4753-8b57-b62982c23ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:46.541771 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07b7b6-4b7a-4753-8b57-b62982c23ae7 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:46.559311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1095/2219] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:00:46 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:46.563006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb7341-b746-47f3-b3dd-af5ac8406c9f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:46.578291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb7341-b746-47f3-b3dd-af5ac8406c9f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:46.580658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49517aac-3e7a-481d-8cd5-e8f5c374869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:46.581386 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49517aac-3e7a-481d-8cd5-e8f5c374869f admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:46.581656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49517aac-3e7a-481d-8cd5-e8f5c374869f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:46.583223 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49517aac-3e7a-481d-8cd5-e8f5c374869f admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:46.583832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49517aac-3e7a-481d-8cd5-e8f5c374869f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:46.585355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49517aac-3e7a-481d-8cd5-e8f5c374869f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:46.596925 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1125/2220] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:00:46 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:46.601195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07b7b6-4b7a-4753-8b57-b62982c23ae7 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:46.611624 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07b7b6-4b7a-4753-8b57-b62982c23ae7 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:46.616290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b692950-2d54-4d31-830e-872cef21464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:46.617234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b692950-2d54-4d31-830e-872cef21464e admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:46.617457 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b692950-2d54-4d31-830e-872cef21464e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:46.617739 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b692950-2d54-4d31-830e-872cef21464e admin admin] PATH_INFO: `/v3/projects/798925cd73b748bfa02e42c91770bb3d/users/350fe1b787d340a4a044471784daebaa/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:46.636080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b692950-2d54-4d31-830e-872cef21464e admin admin] RBAC: Authorizing `identity:create_grant(project_id=798925cd73b748bfa02e42c91770bb3d, user_id=350fe1b787d340a4a044471784daebaa, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:46.639582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b692950-2d54-4d31-830e-872cef21464e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:46.772656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1096/2221] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:00:46 2022] PUT /identity/v3/projects/798925cd73b748bfa02e42c91770bb3d/users/350fe1b787d340a4a044471784daebaa/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:46.783400 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa0f84-032f-4278-ace7-ebb0b50053b3 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:46.783942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa0f84-032f-4278-ace7-ebb0b50053b3 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:46.783942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa0f84-032f-4278-ace7-ebb0b50053b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:46.814987 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-b3fa0f84-032f-4278-ace7-ebb0b50053b3 None None] MFA Rules not processed for user `350fe1b787d340a4a044471784daebaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:46.816282 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b3fa0f84-032f-4278-ace7-ebb0b50053b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:46.898483 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1126/2222] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:00:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:46.910134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b692950-2d54-4d31-830e-872cef21464e admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:46.912170 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1b692950-2d54-4d31-830e-872cef21464e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:46.939111 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:46.977288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b692950-2d54-4d31-830e-872cef21464e admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:46.981488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d91e8-7713-4876-9b6e-3b854c779e01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:46.982566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d91e8-7713-4876-9b6e-3b854c779e01 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:46.982821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d91e8-7713-4876-9b6e-3b854c779e01 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:46.983104 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d91e8-7713-4876-9b6e-3b854c779e01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:46.993632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d91e8-7713-4876-9b6e-3b854c779e01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:46.996051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d91e8-7713-4876-9b6e-3b854c779e01 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:47.011630 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1097/2223] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:00:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:56.892562 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:57.388524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=17 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:02.987683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa0f84-032f-4278-ace7-ebb0b50053b3 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:02.989704 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b3fa0f84-032f-4278-ace7-ebb0b50053b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:03.063775 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa0f84-032f-4278-ace7-ebb0b50053b3 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:03.068877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b4d5f-6086-49d8-8346-eed0eaaa4289 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:03.069542 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b4d5f-6086-49d8-8346-eed0eaaa4289 service placement] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:03.069827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b4d5f-6086-49d8-8346-eed0eaaa4289 service placement] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:03.070105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b4d5f-6086-49d8-8346-eed0eaaa4289 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:03.071988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a54b4d5f-6086-49d8-8346-eed0eaaa4289 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:03.084874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b4d5f-6086-49d8-8346-eed0eaaa4289 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:03.086507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b4d5f-6086-49d8-8346-eed0eaaa4289 service placement] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:03.097613 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1127/2224] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:01:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:05.133526 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d91e8-7713-4876-9b6e-3b854c779e01 service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:05.135544 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-099d91e8-7713-4876-9b6e-3b854c779e01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:05.203790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d91e8-7713-4876-9b6e-3b854c779e01 service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:05.209172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23b797-cb0f-444d-84ef-087b44221991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:05.210067 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23b797-cb0f-444d-84ef-087b44221991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:05.210390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23b797-cb0f-444d-84ef-087b44221991 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:05.210678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23b797-cb0f-444d-84ef-087b44221991 admin admin] PATH_INFO: `/v3/users/6fbc89e17fb34ba6b7c67f226e54b557` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:05.211920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23b797-cb0f-444d-84ef-087b44221991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fbc89e17fb34ba6b7c67f226e54b557)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:05.213867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23b797-cb0f-444d-84ef-087b44221991 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:05.430500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fd23b797-cb0f-444d-84ef-087b44221991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fbc89e17fb34ba6b7c67f226e54b557'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:05.431161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fd23b797-cb0f-444d-84ef-087b44221991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fbc89e17fb34ba6b7c67f226e54b557'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:05.431793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fd23b797-cb0f-444d-84ef-087b44221991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fbc89e17fb34ba6b7c67f226e54b557'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:05.554346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fd23b797-cb0f-444d-84ef-087b44221991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fbc89e17fb34ba6b7c67f226e54b557'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:05.567146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fd23b797-cb0f-444d-84ef-087b44221991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fbc89e17fb34ba6b7c67f226e54b557'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:05.579278 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1098/2225] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:01:05 2022] DELETE /identity/v3/users/6fbc89e17fb34ba6b7c67f226e54b557 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:05.583969 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3219a1-f655-4058-8634-cfe3775737ca None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:05.584425 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3219a1-f655-4058-8634-cfe3775737ca None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:05.584519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3219a1-f655-4058-8634-cfe3775737ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:05.602579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-cf3219a1-f655-4058-8634-cfe3775737ca None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:05.603752 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-cf3219a1-f655-4058-8634-cfe3775737ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:05.659528 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1128/2226] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:05.669102 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23b797-cb0f-444d-84ef-087b44221991 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:05.671170 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-fd23b797-cb0f-444d-84ef-087b44221991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:05.729439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23b797-cb0f-444d-84ef-087b44221991 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:05.733591 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee844893-05e8-4cb2-b832-6d76cc1f579a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:05.734236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee844893-05e8-4cb2-b832-6d76cc1f579a service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:05.734551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee844893-05e8-4cb2-b832-6d76cc1f579a service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:05.734834 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee844893-05e8-4cb2-b832-6d76cc1f579a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:05.743838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee844893-05e8-4cb2-b832-6d76cc1f579a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:05.745265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee844893-05e8-4cb2-b832-6d76cc1f579a service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:05.754806 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1099/2227] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:01:06.242629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3219a1-f655-4058-8634-cfe3775737ca None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:06.244021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-cf3219a1-f655-4058-8634-cfe3775737ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:06.257281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3219a1-f655-4058-8634-cfe3775737ca None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:06.262311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60974f7e-13e4-492f-9cc6-fb27f54fb449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:06.263266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60974f7e-13e4-492f-9cc6-fb27f54fb449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:06.263573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60974f7e-13e4-492f-9cc6-fb27f54fb449 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:06.263857 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60974f7e-13e4-492f-9cc6-fb27f54fb449 admin admin] PATH_INFO: `/v3/projects/7d68e5b2a9da4a0682932cb5298dff8e` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:06.265737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60974f7e-13e4-492f-9cc6-fb27f54fb449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d68e5b2a9da4a0682932cb5298dff8e)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:06.267080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60974f7e-13e4-492f-9cc6-fb27f54fb449 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:06.383413 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-60974f7e-13e4-492f-9cc6-fb27f54fb449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d68e5b2a9da4a0682932cb5298dff8e', 'request_id': 'req-60974f7e-13e4-492f-9cc6-fb27f54fb449'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:06.497170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-60974f7e-13e4-492f-9cc6-fb27f54fb449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d68e5b2a9da4a0682932cb5298dff8e', 'request_id': 'req-60974f7e-13e4-492f-9cc6-fb27f54fb449'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:06.504062 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-60974f7e-13e4-492f-9cc6-fb27f54fb449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d68e5b2a9da4a0682932cb5298dff8e', 'request_id': 'req-60974f7e-13e4-492f-9cc6-fb27f54fb449'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:06.515196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-60974f7e-13e4-492f-9cc6-fb27f54fb449 admin admin] The token cache is being invalidate because project 7d68e5b2a9da4a0682932cb5298dff8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:06.515487 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-60974f7e-13e4-492f-9cc6-fb27f54fb449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:06.516193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-60974f7e-13e4-492f-9cc6-fb27f54fb449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:06.517799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1129/2228] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:01:06 2022] DELETE /identity/v3/projects/7d68e5b2a9da4a0682932cb5298dff8e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:06.523137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb779ac-c870-4b07-bdc7-c8444d9c07d7 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:06.523589 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb779ac-c870-4b07-bdc7-c8444d9c07d7 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:06.523697 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb779ac-c870-4b07-bdc7-c8444d9c07d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:06.542564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-dbb779ac-c870-4b07-bdc7-c8444d9c07d7 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:06.543775 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-dbb779ac-c870-4b07-bdc7-c8444d9c07d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:06.561500 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:06.612210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1100/2229] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:06.619533 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934792-47a1-41aa-9911-262e8908cb9e None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:06.620004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934792-47a1-41aa-9911-262e8908cb9e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:06.620099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934792-47a1-41aa-9911-262e8908cb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:06.639229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-a1934792-47a1-41aa-9911-262e8908cb9e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:06.640445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a1934792-47a1-41aa-9911-262e8908cb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:06.648814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1130/2230] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:06.655090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb779ac-c870-4b07-bdc7-c8444d9c07d7 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:06.665023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb779ac-c870-4b07-bdc7-c8444d9c07d7 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:06.670424 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca73f3c-2b6b-4f91-949e-6aca9b79eda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:06.671097 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca73f3c-2b6b-4f91-949e-6aca9b79eda0 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:06.677713 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca73f3c-2b6b-4f91-949e-6aca9b79eda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:06.677713 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca73f3c-2b6b-4f91-949e-6aca9b79eda0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:06.677713 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca73f3c-2b6b-4f91-949e-6aca9b79eda0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:01:06.677713 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca73f3c-2b6b-4f91-949e-6aca9b79eda0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:06.677713 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca73f3c-2b6b-4f91-949e-6aca9b79eda0 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:06.685862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1101/2231] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:01:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:01:06.690193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1934792-47a1-41aa-9911-262e8908cb9e None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:06.699527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1934792-47a1-41aa-9911-262e8908cb9e None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:06.704776 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb90713-9540-45cb-b2b0-80e0f398bf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:06.705439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb90713-9540-45cb-b2b0-80e0f398bf8f admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:06.705723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb90713-9540-45cb-b2b0-80e0f398bf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:06.706033 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb90713-9540-45cb-b2b0-80e0f398bf8f admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:06.709494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb90713-9540-45cb-b2b0-80e0f398bf8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:06.709494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb90713-9540-45cb-b2b0-80e0f398bf8f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:06.712322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:06.844040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1131/2232] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:01:06 2022] POST /identity/v3/projects => generated 376 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:06.848539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca73f3c-2b6b-4f91-949e-6aca9b79eda0 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:06.861752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca73f3c-2b6b-4f91-949e-6aca9b79eda0 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:06.923505 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc873bc-1834-4f7e-b075-c37d3d421acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:06.924305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc873bc-1834-4f7e-b075-c37d3d421acc admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:06.924684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc873bc-1834-4f7e-b075-c37d3d421acc admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:06.925060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc873bc-1834-4f7e-b075-c37d3d421acc admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:06.925884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc873bc-1834-4f7e-b075-c37d3d421acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:06.928042 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc873bc-1834-4f7e-b075-c37d3d421acc admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:07.104562 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1102/2233] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:01:06 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:07.108637 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb90713-9540-45cb-b2b0-80e0f398bf8f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:07.119803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb90713-9540-45cb-b2b0-80e0f398bf8f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:07.139490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da50700-5a17-4f60-be4b-033da6cf862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:07.140299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da50700-5a17-4f60-be4b-033da6cf862d admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:07.141355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da50700-5a17-4f60-be4b-033da6cf862d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:07.142041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da50700-5a17-4f60-be4b-033da6cf862d admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:07.142842 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da50700-5a17-4f60-be4b-033da6cf862d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:07.144472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da50700-5a17-4f60-be4b-033da6cf862d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:07.157471 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1132/2234] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:01:07 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:07.161601 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc873bc-1834-4f7e-b075-c37d3d421acc admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:07.173350 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc873bc-1834-4f7e-b075-c37d3d421acc admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:07.178895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276df17-f8d4-419a-848e-aca7005ea8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:07.180538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276df17-f8d4-419a-848e-aca7005ea8ae admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:07.180538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276df17-f8d4-419a-848e-aca7005ea8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:07.180929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276df17-f8d4-419a-848e-aca7005ea8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:07.182699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276df17-f8d4-419a-848e-aca7005ea8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:07.185419 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276df17-f8d4-419a-848e-aca7005ea8ae admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:07.206973 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1103/2235] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:01:07 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:07.220173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da50700-5a17-4f60-be4b-033da6cf862d admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:07.230091 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da50700-5a17-4f60-be4b-033da6cf862d admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:07.235577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601610b-cb63-4ee6-b933-933b8b29fd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:07.236503 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601610b-cb63-4ee6-b933-933b8b29fd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:07.236788 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601610b-cb63-4ee6-b933-933b8b29fd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:07.237066 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601610b-cb63-4ee6-b933-933b8b29fd08 admin admin] PATH_INFO: `/v3/projects/1f20441b47e543658eb83a90ae8afe85/users/5b098fd3d19842769540817a17a2867e/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:07.253881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601610b-cb63-4ee6-b933-933b8b29fd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f20441b47e543658eb83a90ae8afe85, user_id=5b098fd3d19842769540817a17a2867e, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:07.256531 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601610b-cb63-4ee6-b933-933b8b29fd08 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:07.388923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1133/2236] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:01:07 2022] PUT /identity/v3/projects/1f20441b47e543658eb83a90ae8afe85/users/5b098fd3d19842769540817a17a2867e/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:07.400151 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaadac6-bc1d-46a3-9f5a-d01c0d902ee5 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:07.400450 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaadac6-bc1d-46a3-9f5a-d01c0d902ee5 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:07.400762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaadac6-bc1d-46a3-9f5a-d01c0d902ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:07.428590 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-caaadac6-bc1d-46a3-9f5a-d01c0d902ee5 None None] MFA Rules not processed for user `5b098fd3d19842769540817a17a2867e`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:07.429785 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-caaadac6-bc1d-46a3-9f5a-d01c0d902ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:07.495808 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1104/2237] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:01:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:07.508177 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601610b-cb63-4ee6-b933-933b8b29fd08 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:07.509959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b601610b-cb63-4ee6-b933-933b8b29fd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:07.570225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601610b-cb63-4ee6-b933-933b8b29fd08 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:07.573975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4b68d-bdb3-4c6b-974f-e952c5ec8673 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:07.574664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4b68d-bdb3-4c6b-974f-e952c5ec8673 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:07.574951 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4b68d-bdb3-4c6b-974f-e952c5ec8673 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:07.575230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4b68d-bdb3-4c6b-974f-e952c5ec8673 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:07.584269 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4b68d-bdb3-4c6b-974f-e952c5ec8673 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:07.585724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4b68d-bdb3-4c6b-974f-e952c5ec8673 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:07.595365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1134/2238] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:01:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:17.171889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55630e-d7b1-4fe6-a38e-f03c84f5ecf9 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:17.172490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55630e-d7b1-4fe6-a38e-f03c84f5ecf9 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:17.172490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55630e-d7b1-4fe6-a38e-f03c84f5ecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:17.191545 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-2b55630e-d7b1-4fe6-a38e-f03c84f5ecf9 None None] MFA Rules not processed for user `530b2b1951644755afd1432381cf37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:17.193010 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2b55630e-d7b1-4fe6-a38e-f03c84f5ecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:17.219242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:17.263566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1105/2239] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:01:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:01:17.628622 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:19.315806 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4b68d-bdb3-4c6b-974f-e952c5ec8673 service cinder] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:19.383137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4b68d-bdb3-4c6b-974f-e952c5ec8673 service cinder] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:19.389772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16abb3-ea16-4b71-87e2-d2c986eda533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:19.390830 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16abb3-ea16-4b71-87e2-d2c986eda533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:19.391038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16abb3-ea16-4b71-87e2-d2c986eda533 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:19.391318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16abb3-ea16-4b71-87e2-d2c986eda533 admin admin] PATH_INFO: `/v3/users/5b098fd3d19842769540817a17a2867e` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:19.392713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16abb3-ea16-4b71-87e2-d2c986eda533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b098fd3d19842769540817a17a2867e)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:19.394796 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16abb3-ea16-4b71-87e2-d2c986eda533 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:19.626614 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0a16abb3-ea16-4b71-87e2-d2c986eda533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b098fd3d19842769540817a17a2867e'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:19.627204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0a16abb3-ea16-4b71-87e2-d2c986eda533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b098fd3d19842769540817a17a2867e'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:19.640193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0a16abb3-ea16-4b71-87e2-d2c986eda533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b098fd3d19842769540817a17a2867e'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:19.725055 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0a16abb3-ea16-4b71-87e2-d2c986eda533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b098fd3d19842769540817a17a2867e'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:19.733325 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0a16abb3-ea16-4b71-87e2-d2c986eda533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b098fd3d19842769540817a17a2867e'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:19.739450 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1135/2240] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:01:19 2022] DELETE /identity/v3/users/5b098fd3d19842769540817a17a2867e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:19.744536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c22f7-b9bb-4fab-9b53-3915486093e5 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:19.744536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c22f7-b9bb-4fab-9b53-3915486093e5 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:19.744536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c22f7-b9bb-4fab-9b53-3915486093e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:19.762145 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-cc1c22f7-b9bb-4fab-9b53-3915486093e5 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:19.763393 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-cc1c22f7-b9bb-4fab-9b53-3915486093e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:19.823438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1106/2241] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:19.833485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16abb3-ea16-4b71-87e2-d2c986eda533 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:19.834923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0a16abb3-ea16-4b71-87e2-d2c986eda533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:19.891959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16abb3-ea16-4b71-87e2-d2c986eda533 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:19.901083 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b892a76-1f0b-489a-acf6-c9ec9267493d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:19.901761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892a76-1f0b-489a-acf6-c9ec9267493d service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:19.902028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892a76-1f0b-489a-acf6-c9ec9267493d service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:19.902301 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892a76-1f0b-489a-acf6-c9ec9267493d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:19.913815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b892a76-1f0b-489a-acf6-c9ec9267493d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:19.915375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b892a76-1f0b-489a-acf6-c9ec9267493d service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:19.926500 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1136/2242] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:20.392646 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c22f7-b9bb-4fab-9b53-3915486093e5 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:20.394184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-cc1c22f7-b9bb-4fab-9b53-3915486093e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:20.407374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c22f7-b9bb-4fab-9b53-3915486093e5 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:20.412138 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5ec11-6d06-45f0-9a42-cf126a165819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:20.413015 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5ec11-6d06-45f0-9a42-cf126a165819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:20.413292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5ec11-6d06-45f0-9a42-cf126a165819 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:20.413734 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5ec11-6d06-45f0-9a42-cf126a165819 admin admin] PATH_INFO: `/v3/projects/1f20441b47e543658eb83a90ae8afe85` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:20.415313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5ec11-6d06-45f0-9a42-cf126a165819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f20441b47e543658eb83a90ae8afe85)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:20.418038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5ec11-6d06-45f0-9a42-cf126a165819 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:20.520089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-16d5ec11-6d06-45f0-9a42-cf126a165819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f20441b47e543658eb83a90ae8afe85', 'request_id': 'req-16d5ec11-6d06-45f0-9a42-cf126a165819'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:20.599648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-16d5ec11-6d06-45f0-9a42-cf126a165819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f20441b47e543658eb83a90ae8afe85', 'request_id': 'req-16d5ec11-6d06-45f0-9a42-cf126a165819'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:20.608601 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-16d5ec11-6d06-45f0-9a42-cf126a165819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f20441b47e543658eb83a90ae8afe85', 'request_id': 'req-16d5ec11-6d06-45f0-9a42-cf126a165819'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:20.623828 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-16d5ec11-6d06-45f0-9a42-cf126a165819 admin admin] The token cache is being invalidate because project 1f20441b47e543658eb83a90ae8afe85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:20.627146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-16d5ec11-6d06-45f0-9a42-cf126a165819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:20.627146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-16d5ec11-6d06-45f0-9a42-cf126a165819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:20.627146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1107/2243] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:01:20 2022] DELETE /identity/v3/projects/1f20441b47e543658eb83a90ae8afe85 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:20.631931 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706fdca-9555-4410-808b-c4355334404e None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:20.632393 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706fdca-9555-4410-808b-c4355334404e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:20.632753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706fdca-9555-4410-808b-c4355334404e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:20.655230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-6706fdca-9555-4410-808b-c4355334404e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:20.656556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6706fdca-9555-4410-808b-c4355334404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:20.674826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:20.718907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1137/2244] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:20.726851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5d9f-b6db-46d6-beac-f96cba761323 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:20.730296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5d9f-b6db-46d6-beac-f96cba761323 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:20.730296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5d9f-b6db-46d6-beac-f96cba761323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:20.756870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-537e5d9f-b6db-46d6-beac-f96cba761323 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:20.758068 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-537e5d9f-b6db-46d6-beac-f96cba761323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:20.767556 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1108/2245] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:20.771813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706fdca-9555-4410-808b-c4355334404e None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:20.782307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706fdca-9555-4410-808b-c4355334404e None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:20.787011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef015c-f3a0-4dc1-9d08-a3d9ea5129a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:20.787677 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef015c-f3a0-4dc1-9d08-a3d9ea5129a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:20.787966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef015c-f3a0-4dc1-9d08-a3d9ea5129a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:20.788242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef015c-f3a0-4dc1-9d08-a3d9ea5129a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:20.788963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef015c-f3a0-4dc1-9d08-a3d9ea5129a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:01:20.789272 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef015c-f3a0-4dc1-9d08-a3d9ea5129a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:20.790880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef015c-f3a0-4dc1-9d08-a3d9ea5129a9 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:20.803493 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1138/2246] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:01:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:01:20.808027 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e5d9f-b6db-46d6-beac-f96cba761323 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:20.817841 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e5d9f-b6db-46d6-beac-f96cba761323 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:20.828004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c434d75-ce4a-4895-a575-930825c727e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:20.828004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c434d75-ce4a-4895-a575-930825c727e7 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:20.828004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c434d75-ce4a-4895-a575-930825c727e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:20.828004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c434d75-ce4a-4895-a575-930825c727e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:20.828386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c434d75-ce4a-4895-a575-930825c727e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:20.828386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c434d75-ce4a-4895-a575-930825c727e7 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:20.915742 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1109/2247] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:01:20 2022] POST /identity/v3/projects => generated 386 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:20.920512 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef015c-f3a0-4dc1-9d08-a3d9ea5129a9 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:20.930380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef015c-f3a0-4dc1-9d08-a3d9ea5129a9 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:20.985162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f021a17-5134-41ae-86c4-b5cbdc74e678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:20.985862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f021a17-5134-41ae-86c4-b5cbdc74e678 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:20.986151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f021a17-5134-41ae-86c4-b5cbdc74e678 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:20.986465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f021a17-5134-41ae-86c4-b5cbdc74e678 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:20.987151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f021a17-5134-41ae-86c4-b5cbdc74e678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:20.989076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f021a17-5134-41ae-86c4-b5cbdc74e678 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:21.115056 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1139/2248] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:01:20 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:21.121528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c434d75-ce4a-4895-a575-930825c727e7 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:21.132547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c434d75-ce4a-4895-a575-930825c727e7 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:21.137226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853d3bb-9a74-4238-a5c5-0abf6e7c5192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:21.137961 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d3bb-9a74-4238-a5c5-0abf6e7c5192 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:21.138213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d3bb-9a74-4238-a5c5-0abf6e7c5192 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:21.138580 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d3bb-9a74-4238-a5c5-0abf6e7c5192 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:21.139311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853d3bb-9a74-4238-a5c5-0abf6e7c5192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:21.140964 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853d3bb-9a74-4238-a5c5-0abf6e7c5192 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:21.151476 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1110/2249] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:01:21 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:01:21.155760 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f021a17-5134-41ae-86c4-b5cbdc74e678 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:21.165955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f021a17-5134-41ae-86c4-b5cbdc74e678 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:21.171429 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2dd84-7615-4613-8102-04f96d39c387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:21.176086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2dd84-7615-4613-8102-04f96d39c387 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:21.176086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2dd84-7615-4613-8102-04f96d39c387 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:21.176086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2dd84-7615-4613-8102-04f96d39c387 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:21.176086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2dd84-7615-4613-8102-04f96d39c387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:21.176086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2dd84-7615-4613-8102-04f96d39c387 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:21.186548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1140/2250] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:01:21 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:21.190717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853d3bb-9a74-4238-a5c5-0abf6e7c5192 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:21.205354 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853d3bb-9a74-4238-a5c5-0abf6e7c5192 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:21.209143 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad3fff-c35c-4126-9a36-2bd52e05fc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:21.210154 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad3fff-c35c-4126-9a36-2bd52e05fc8f admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:21.210679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad3fff-c35c-4126-9a36-2bd52e05fc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:21.210974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad3fff-c35c-4126-9a36-2bd52e05fc8f admin admin] PATH_INFO: `/v3/projects/76b90ab9616d4182b5a9265b2be80883/users/e49a18e5d9da4c54b06a38a7603029cc/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:21.213449 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:21.228099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad3fff-c35c-4126-9a36-2bd52e05fc8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b90ab9616d4182b5a9265b2be80883, user_id=e49a18e5d9da4c54b06a38a7603029cc, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:21.234087 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad3fff-c35c-4126-9a36-2bd52e05fc8f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:21.331323 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1111/2251] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:01:21 2022] PUT /identity/v3/projects/76b90ab9616d4182b5a9265b2be80883/users/e49a18e5d9da4c54b06a38a7603029cc/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:21.342545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462232c-745b-48c8-bb4d-f1602786d10e None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:21.342837 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462232c-745b-48c8-bb4d-f1602786d10e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:21.343117 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462232c-745b-48c8-bb4d-f1602786d10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:21.371435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-5462232c-745b-48c8-bb4d-f1602786d10e None None] MFA Rules not processed for user `e49a18e5d9da4c54b06a38a7603029cc`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:21.372747 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5462232c-745b-48c8-bb4d-f1602786d10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:21.449376 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1141/2252] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:01:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:21.467087 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad3fff-c35c-4126-9a36-2bd52e05fc8f admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:21.468865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-88ad3fff-c35c-4126-9a36-2bd52e05fc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:21.545950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad3fff-c35c-4126-9a36-2bd52e05fc8f admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:21.549762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530df448-1eb6-411b-bbd5-d8d114404db0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:21.553214 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530df448-1eb6-411b-bbd5-d8d114404db0 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:21.553214 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530df448-1eb6-411b-bbd5-d8d114404db0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:21.553214 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530df448-1eb6-411b-bbd5-d8d114404db0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:21.562793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530df448-1eb6-411b-bbd5-d8d114404db0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:21.564918 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530df448-1eb6-411b-bbd5-d8d114404db0 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:21.574371 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1112/2253] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:01:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:26.107733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462232c-745b-48c8-bb4d-f1602786d10e None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:26.147006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:26.203744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462232c-745b-48c8-bb4d-f1602786d10e None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:26.209634 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f5aad-7774-4e38-8f71-6b31cafd0506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:26.210554 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f5aad-7774-4e38-8f71-6b31cafd0506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:26.210842 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f5aad-7774-4e38-8f71-6b31cafd0506 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:26.212338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f5aad-7774-4e38-8f71-6b31cafd0506 admin admin] PATH_INFO: `/v3/users/e49a18e5d9da4c54b06a38a7603029cc` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:26.212338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f5aad-7774-4e38-8f71-6b31cafd0506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49a18e5d9da4c54b06a38a7603029cc)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:26.214284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f5aad-7774-4e38-8f71-6b31cafd0506 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:26.369249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0f2f5aad-7774-4e38-8f71-6b31cafd0506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49a18e5d9da4c54b06a38a7603029cc'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:26.369899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0f2f5aad-7774-4e38-8f71-6b31cafd0506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49a18e5d9da4c54b06a38a7603029cc'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:26.382344 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0f2f5aad-7774-4e38-8f71-6b31cafd0506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49a18e5d9da4c54b06a38a7603029cc'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:26.435357 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0f2f5aad-7774-4e38-8f71-6b31cafd0506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49a18e5d9da4c54b06a38a7603029cc'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:26.444147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0f2f5aad-7774-4e38-8f71-6b31cafd0506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49a18e5d9da4c54b06a38a7603029cc'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:26.451130 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1142/2254] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:01:26 2022] DELETE /identity/v3/users/e49a18e5d9da4c54b06a38a7603029cc => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:26.455979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2192b0-b3c3-4871-8b50-027b9ecd19f7 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:26.456514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2192b0-b3c3-4871-8b50-027b9ecd19f7 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:26.456674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2192b0-b3c3-4871-8b50-027b9ecd19f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:26.475121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-3d2192b0-b3c3-4871-8b50-027b9ecd19f7 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:26.476440 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-3d2192b0-b3c3-4871-8b50-027b9ecd19f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:26.541543 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1113/2255] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:01:26.552004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f5aad-7774-4e38-8f71-6b31cafd0506 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:26.553412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0f2f5aad-7774-4e38-8f71-6b31cafd0506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:26.612722 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f5aad-7774-4e38-8f71-6b31cafd0506 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:26.616429 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeac179-cc80-4fba-be08-87d8c6b69db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:26.617072 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeac179-cc80-4fba-be08-87d8c6b69db4 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:26.617359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeac179-cc80-4fba-be08-87d8c6b69db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:26.617638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeac179-cc80-4fba-be08-87d8c6b69db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:26.627932 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeac179-cc80-4fba-be08-87d8c6b69db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:26.629355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeac179-cc80-4fba-be08-87d8c6b69db4 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:26.640803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1143/2256] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:27.234058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2192b0-b3c3-4871-8b50-027b9ecd19f7 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:27.235759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-3d2192b0-b3c3-4871-8b50-027b9ecd19f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:27.252047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2192b0-b3c3-4871-8b50-027b9ecd19f7 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:27.257291 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:27.258262 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:27.258586 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:27.258877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934 admin admin] PATH_INFO: `/v3/projects/76b90ab9616d4182b5a9265b2be80883` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:27.262448 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b90ab9616d4182b5a9265b2be80883)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:27.264896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:27.505239 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b90ab9616d4182b5a9265b2be80883', 'request_id': 'req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:27.633696 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b90ab9616d4182b5a9265b2be80883', 'request_id': 'req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:27.641441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b90ab9616d4182b5a9265b2be80883', 'request_id': 'req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:27.653457 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934 admin admin] The token cache is being invalidate because project 76b90ab9616d4182b5a9265b2be80883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:27.676643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:27.676643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:27.676643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1114/2257] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:01:27 2022] DELETE /identity/v3/projects/76b90ab9616d4182b5a9265b2be80883 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:01:36.635768 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:37.440604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeac179-cc80-4fba-be08-87d8c6b69db4 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:37.443977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-2eeac179-cc80-4fba-be08-87d8c6b69db4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:37.459297 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeac179-cc80-4fba-be08-87d8c6b69db4 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:37.517381 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d8896-df22-449f-8c20-065f085ec934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:37.518039 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d8896-df22-449f-8c20-065f085ec934 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:37.518344 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d8896-df22-449f-8c20-065f085ec934 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:37.518634 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d8896-df22-449f-8c20-065f085ec934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:37.520440 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0d2d8896-df22-449f-8c20-065f085ec934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:37.601751 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d8896-df22-449f-8c20-065f085ec934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:37.603227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d8896-df22-449f-8c20-065f085ec934 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:37.613580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1144/2258] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:01:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:37.649038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:46.277652 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:46.279953 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:46.292197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032b6d-cbfb-4b29-9bec-779f7c7c8934 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:46.296967 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fe8fb-8430-40de-b6f7-c44d73160984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:46.297625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fe8fb-8430-40de-b6f7-c44d73160984 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:46.297912 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fe8fb-8430-40de-b6f7-c44d73160984 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:46.298194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fe8fb-8430-40de-b6f7-c44d73160984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:46.311199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9b4fe8fb-8430-40de-b6f7-c44d73160984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:46.391109 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fe8fb-8430-40de-b6f7-c44d73160984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:46.392609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fe8fb-8430-40de-b6f7-c44d73160984 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:46.402729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1115/2259] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:01:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:47.609045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=50 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:56.397971 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=30 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:08.221629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d8896-df22-449f-8c20-065f085ec934 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:08.223082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0d2d8896-df22-449f-8c20-065f085ec934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:08.289860 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d8896-df22-449f-8c20-065f085ec934 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:08.295467 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684d746-c24d-4ad6-8144-d589461fc32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:08.296343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684d746-c24d-4ad6-8144-d589461fc32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:08.296625 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684d746-c24d-4ad6-8144-d589461fc32f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:08.296899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684d746-c24d-4ad6-8144-d589461fc32f admin admin] PATH_INFO: `/v3/users/350fe1b787d340a4a044471784daebaa` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:08.298112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684d746-c24d-4ad6-8144-d589461fc32f admin admin] RBAC: Authorizing `identity:delete_user(user_id=350fe1b787d340a4a044471784daebaa)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:08.300120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684d746-c24d-4ad6-8144-d589461fc32f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:08.562096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0684d746-c24d-4ad6-8144-d589461fc32f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350fe1b787d340a4a044471784daebaa'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:08.562835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0684d746-c24d-4ad6-8144-d589461fc32f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350fe1b787d340a4a044471784daebaa'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:08.575490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0684d746-c24d-4ad6-8144-d589461fc32f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350fe1b787d340a4a044471784daebaa'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:08.650185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0684d746-c24d-4ad6-8144-d589461fc32f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350fe1b787d340a4a044471784daebaa'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:08.658872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0684d746-c24d-4ad6-8144-d589461fc32f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350fe1b787d340a4a044471784daebaa'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:08.665251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1145/2260] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:02:08 2022] DELETE /identity/v3/users/350fe1b787d340a4a044471784daebaa => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:08.670452 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8cfe9-0725-4752-a5f4-a60efd5405e5 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:08.670955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8cfe9-0725-4752-a5f4-a60efd5405e5 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:08.671049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8cfe9-0725-4752-a5f4-a60efd5405e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:08.688335 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-18d8cfe9-0725-4752-a5f4-a60efd5405e5 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:08.689551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-18d8cfe9-0725-4752-a5f4-a60efd5405e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:08.752334 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1116/2261] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:08.762187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684d746-c24d-4ad6-8144-d589461fc32f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:08.763693 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0684d746-c24d-4ad6-8144-d589461fc32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:08.834430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684d746-c24d-4ad6-8144-d589461fc32f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:08.838083 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea2e70-1b0d-4e1d-b448-84709a0c702d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:08.838878 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea2e70-1b0d-4e1d-b448-84709a0c702d service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:08.839167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea2e70-1b0d-4e1d-b448-84709a0c702d service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:08.839450 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea2e70-1b0d-4e1d-b448-84709a0c702d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:08.850904 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea2e70-1b0d-4e1d-b448-84709a0c702d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:08.852349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea2e70-1b0d-4e1d-b448-84709a0c702d service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:08.863859 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1146/2262] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:09.332204 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8cfe9-0725-4752-a5f4-a60efd5405e5 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:09.333902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-18d8cfe9-0725-4752-a5f4-a60efd5405e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:09.346622 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8cfe9-0725-4752-a5f4-a60efd5405e5 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:09.351536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d61b4-9e7d-47f1-a928-ff6fae8a7493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:09.358647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d61b4-9e7d-47f1-a928-ff6fae8a7493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:09.358647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d61b4-9e7d-47f1-a928-ff6fae8a7493 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:09.358647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d61b4-9e7d-47f1-a928-ff6fae8a7493 admin admin] PATH_INFO: `/v3/projects/798925cd73b748bfa02e42c91770bb3d` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:09.358647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d61b4-9e7d-47f1-a928-ff6fae8a7493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=798925cd73b748bfa02e42c91770bb3d)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:09.358647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d61b4-9e7d-47f1-a928-ff6fae8a7493 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:09.479370 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ed4d61b4-9e7d-47f1-a928-ff6fae8a7493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '798925cd73b748bfa02e42c91770bb3d', 'request_id': 'req-ed4d61b4-9e7d-47f1-a928-ff6fae8a7493'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:09.610064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ed4d61b4-9e7d-47f1-a928-ff6fae8a7493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '798925cd73b748bfa02e42c91770bb3d', 'request_id': 'req-ed4d61b4-9e7d-47f1-a928-ff6fae8a7493'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:09.616910 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ed4d61b4-9e7d-47f1-a928-ff6fae8a7493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '798925cd73b748bfa02e42c91770bb3d', 'request_id': 'req-ed4d61b4-9e7d-47f1-a928-ff6fae8a7493'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:09.628349 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ed4d61b4-9e7d-47f1-a928-ff6fae8a7493 admin admin] The token cache is being invalidate because project 798925cd73b748bfa02e42c91770bb3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:09.632352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ed4d61b4-9e7d-47f1-a928-ff6fae8a7493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:09.632352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-ed4d61b4-9e7d-47f1-a928-ff6fae8a7493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:09.632352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1117/2263] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:02:09 2022] DELETE /identity/v3/projects/798925cd73b748bfa02e42c91770bb3d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:09.635884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba66ca-bbf7-46ab-9c6b-700188c71d4c None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:09.636363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba66ca-bbf7-46ab-9c6b-700188c71d4c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:09.636655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba66ca-bbf7-46ab-9c6b-700188c71d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:09.655054 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-c4ba66ca-bbf7-46ab-9c6b-700188c71d4c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:09.656265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c4ba66ca-bbf7-46ab-9c6b-700188c71d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:09.673926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:09.718736 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1147/2264] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:09.727256 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492981d-b7b4-413b-b09c-db799b580256 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:09.727757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492981d-b7b4-413b-b09c-db799b580256 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:09.727860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492981d-b7b4-413b-b09c-db799b580256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:09.747079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-9492981d-b7b4-413b-b09c-db799b580256 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:09.748282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9492981d-b7b4-413b-b09c-db799b580256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:09.756293 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1118/2265] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:09.765517 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba66ca-bbf7-46ab-9c6b-700188c71d4c None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:09.775368 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba66ca-bbf7-46ab-9c6b-700188c71d4c None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:09.781321 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45041f5-a685-4ba2-8c2b-646c122e1ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:09.782236 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45041f5-a685-4ba2-8c2b-646c122e1ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:09.782585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45041f5-a685-4ba2-8c2b-646c122e1ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:09.783249 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45041f5-a685-4ba2-8c2b-646c122e1ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:09.784138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45041f5-a685-4ba2-8c2b-646c122e1ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:09.784455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45041f5-a685-4ba2-8c2b-646c122e1ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:09.786062 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45041f5-a685-4ba2-8c2b-646c122e1ac1 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:09.798199 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1148/2266] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:02:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:09.802613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492981d-b7b4-413b-b09c-db799b580256 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:09.812074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492981d-b7b4-413b-b09c-db799b580256 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:09.816746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c9942-9f0f-41c0-ac82-c992f7e2333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:09.817407 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c9942-9f0f-41c0-ac82-c992f7e2333f admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:09.817692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c9942-9f0f-41c0-ac82-c992f7e2333f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:09.817968 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c9942-9f0f-41c0-ac82-c992f7e2333f admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:09.818704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c9942-9f0f-41c0-ac82-c992f7e2333f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:09.820660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c9942-9f0f-41c0-ac82-c992f7e2333f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:09.926811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1119/2267] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:02:09 2022] POST /identity/v3/projects => generated 372 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:09.930969 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45041f5-a685-4ba2-8c2b-646c122e1ac1 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:09.942251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45041f5-a685-4ba2-8c2b-646c122e1ac1 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:10.002747 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190086d-556e-40c7-b922-c49a22b33071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:10.003525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190086d-556e-40c7-b922-c49a22b33071 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:10.003811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190086d-556e-40c7-b922-c49a22b33071 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:10.004095 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190086d-556e-40c7-b922-c49a22b33071 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:10.004804 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190086d-556e-40c7-b922-c49a22b33071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:10.006789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190086d-556e-40c7-b922-c49a22b33071 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:10.108548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1149/2268] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:02:09 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:02:10.112974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c9942-9f0f-41c0-ac82-c992f7e2333f admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:10.123719 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c9942-9f0f-41c0-ac82-c992f7e2333f admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:10.128475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347580e-574a-461e-8920-8b13a6443f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:10.129142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347580e-574a-461e-8920-8b13a6443f30 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:10.132848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347580e-574a-461e-8920-8b13a6443f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:10.132848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347580e-574a-461e-8920-8b13a6443f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:10.132848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347580e-574a-461e-8920-8b13a6443f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:10.132848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347580e-574a-461e-8920-8b13a6443f30 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:10.142922 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1120/2269] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:02:10 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:10.147099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190086d-556e-40c7-b922-c49a22b33071 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:10.158663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190086d-556e-40c7-b922-c49a22b33071 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:10.163798 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437b689-e5d8-4026-a682-74dfd36e37ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:10.164477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437b689-e5d8-4026-a682-74dfd36e37ec admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:10.164766 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437b689-e5d8-4026-a682-74dfd36e37ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:10.165091 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437b689-e5d8-4026-a682-74dfd36e37ec admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:10.165777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437b689-e5d8-4026-a682-74dfd36e37ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:10.167426 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437b689-e5d8-4026-a682-74dfd36e37ec admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:10.182205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1150/2270] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:02:10 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:10.183513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347580e-574a-461e-8920-8b13a6443f30 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:10.195954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347580e-574a-461e-8920-8b13a6443f30 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:10.201355 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ac79a-3c0c-4091-8af4-6c832be9506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:10.202396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ac79a-3c0c-4091-8af4-6c832be9506e admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:10.202723 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ac79a-3c0c-4091-8af4-6c832be9506e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:10.203005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ac79a-3c0c-4091-8af4-6c832be9506e admin admin] PATH_INFO: `/v3/projects/e129cb32a9574de0a6be0f05be04215a/users/9648a9c3e6ff4e7e8e77d3a7b0c7b8e8/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:10.221238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ac79a-3c0c-4091-8af4-6c832be9506e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e129cb32a9574de0a6be0f05be04215a, user_id=9648a9c3e6ff4e7e8e77d3a7b0c7b8e8, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:10.226429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ac79a-3c0c-4091-8af4-6c832be9506e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:10.370962 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1121/2271] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:02:10 2022] PUT /identity/v3/projects/e129cb32a9574de0a6be0f05be04215a/users/9648a9c3e6ff4e7e8e77d3a7b0c7b8e8/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:10.381187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b37886-2f6e-4f39-9bed-8ed254a0b0c5 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:10.381494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b37886-2f6e-4f39-9bed-8ed254a0b0c5 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:10.381783 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b37886-2f6e-4f39-9bed-8ed254a0b0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:10.408737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-26b37886-2f6e-4f39-9bed-8ed254a0b0c5 None None] MFA Rules not processed for user `9648a9c3e6ff4e7e8e77d3a7b0c7b8e8`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:10.409968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-26b37886-2f6e-4f39-9bed-8ed254a0b0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:10.474705 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1151/2272] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:02:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:10.486476 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ac79a-3c0c-4091-8af4-6c832be9506e admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:10.488275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-6a0ac79a-3c0c-4091-8af4-6c832be9506e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:10.510737 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:10.547571 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ac79a-3c0c-4091-8af4-6c832be9506e admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:10.551242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf596f-0ecd-4531-9080-4b5428e0f062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:10.551907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf596f-0ecd-4531-9080-4b5428e0f062 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:10.552201 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf596f-0ecd-4531-9080-4b5428e0f062 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:10.552513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf596f-0ecd-4531-9080-4b5428e0f062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:10.561646 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf596f-0ecd-4531-9080-4b5428e0f062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:10.563149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf596f-0ecd-4531-9080-4b5428e0f062 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:10.572353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1122/2273] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:02:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:10.598313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b37886-2f6e-4f39-9bed-8ed254a0b0c5 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:10.617736 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:10.662062 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b37886-2f6e-4f39-9bed-8ed254a0b0c5 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:10.667301 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb199c56-45bf-471f-8cf8-943672508624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:10.668197 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb199c56-45bf-471f-8cf8-943672508624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:10.668483 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb199c56-45bf-471f-8cf8-943672508624 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:10.668760 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb199c56-45bf-471f-8cf8-943672508624 admin admin] PATH_INFO: `/v3/users/9648a9c3e6ff4e7e8e77d3a7b0c7b8e8` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:10.669989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb199c56-45bf-471f-8cf8-943672508624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9648a9c3e6ff4e7e8e77d3a7b0c7b8e8)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:10.672104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb199c56-45bf-471f-8cf8-943672508624 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:10.835234 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-eb199c56-45bf-471f-8cf8-943672508624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9648a9c3e6ff4e7e8e77d3a7b0c7b8e8'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:10.835912 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-eb199c56-45bf-471f-8cf8-943672508624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9648a9c3e6ff4e7e8e77d3a7b0c7b8e8'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:10.848494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-eb199c56-45bf-471f-8cf8-943672508624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9648a9c3e6ff4e7e8e77d3a7b0c7b8e8'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:10.941727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-eb199c56-45bf-471f-8cf8-943672508624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9648a9c3e6ff4e7e8e77d3a7b0c7b8e8'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:10.949342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-eb199c56-45bf-471f-8cf8-943672508624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9648a9c3e6ff4e7e8e77d3a7b0c7b8e8'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:10.955478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1152/2274] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:02:10 2022] DELETE /identity/v3/users/9648a9c3e6ff4e7e8e77d3a7b0c7b8e8 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:10.960398 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba3d58-48c7-4289-9174-618377a38fe2 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:10.960928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba3d58-48c7-4289-9174-618377a38fe2 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:10.961049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba3d58-48c7-4289-9174-618377a38fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:10.978731 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-19ba3d58-48c7-4289-9174-618377a38fe2 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:10.980041 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-19ba3d58-48c7-4289-9174-618377a38fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:11.041377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1123/2275] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:11.052714 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb199c56-45bf-471f-8cf8-943672508624 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:11.054256 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-eb199c56-45bf-471f-8cf8-943672508624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:11.114105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb199c56-45bf-471f-8cf8-943672508624 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:11.117940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339f9b9-8448-451b-9e7e-e5fd52f0baa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:11.118718 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339f9b9-8448-451b-9e7e-e5fd52f0baa1 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:11.119018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339f9b9-8448-451b-9e7e-e5fd52f0baa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:11.119356 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339f9b9-8448-451b-9e7e-e5fd52f0baa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:11.130678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339f9b9-8448-451b-9e7e-e5fd52f0baa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:11.132123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339f9b9-8448-451b-9e7e-e5fd52f0baa1 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:11.143172 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1153/2276] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:11.637932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba3d58-48c7-4289-9174-618377a38fe2 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:11.639624 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-19ba3d58-48c7-4289-9174-618377a38fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:11.651766 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba3d58-48c7-4289-9174-618377a38fe2 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:11.657024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1c7c4-c5f9-4ebe-9e28-eb52ac2e823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:11.657931 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c7c4-c5f9-4ebe-9e28-eb52ac2e823a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:11.658220 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c7c4-c5f9-4ebe-9e28-eb52ac2e823a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:11.658590 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c7c4-c5f9-4ebe-9e28-eb52ac2e823a admin admin] PATH_INFO: `/v3/projects/e129cb32a9574de0a6be0f05be04215a` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:11.659944 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1c7c4-c5f9-4ebe-9e28-eb52ac2e823a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e129cb32a9574de0a6be0f05be04215a)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:11.661905 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1c7c4-c5f9-4ebe-9e28-eb52ac2e823a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:11.772959 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d3d1c7c4-c5f9-4ebe-9e28-eb52ac2e823a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e129cb32a9574de0a6be0f05be04215a', 'request_id': 'req-d3d1c7c4-c5f9-4ebe-9e28-eb52ac2e823a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:11.861383 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d3d1c7c4-c5f9-4ebe-9e28-eb52ac2e823a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e129cb32a9574de0a6be0f05be04215a', 'request_id': 'req-d3d1c7c4-c5f9-4ebe-9e28-eb52ac2e823a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:11.868407 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d3d1c7c4-c5f9-4ebe-9e28-eb52ac2e823a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e129cb32a9574de0a6be0f05be04215a', 'request_id': 'req-d3d1c7c4-c5f9-4ebe-9e28-eb52ac2e823a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:11.879810 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d3d1c7c4-c5f9-4ebe-9e28-eb52ac2e823a admin admin] The token cache is being invalidate because project e129cb32a9574de0a6be0f05be04215a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:11.880111 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d3d1c7c4-c5f9-4ebe-9e28-eb52ac2e823a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:11.880786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d3d1c7c4-c5f9-4ebe-9e28-eb52ac2e823a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:11.882586 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1124/2277] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:02:11 2022] DELETE /identity/v3/projects/e129cb32a9574de0a6be0f05be04215a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:11.888009 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523490-446a-4bce-8953-35ece901ceb2 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:11.888502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523490-446a-4bce-8953-35ece901ceb2 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:11.888722 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523490-446a-4bce-8953-35ece901ceb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:11.907072 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-fd523490-446a-4bce-8953-35ece901ceb2 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:11.908310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-fd523490-446a-4bce-8953-35ece901ceb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:11.946604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:11.979858 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1154/2278] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:11.982297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5009ae8-5593-40b1-9641-9c928d3f22c8 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:11.982827 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5009ae8-5593-40b1-9641-9c928d3f22c8 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:11.982927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5009ae8-5593-40b1-9641-9c928d3f22c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:12.002264 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-a5009ae8-5593-40b1-9641-9c928d3f22c8 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:12.003512 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a5009ae8-5593-40b1-9641-9c928d3f22c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:12.013085 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1125/2279] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:12.017560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd523490-446a-4bce-8953-35ece901ceb2 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:12.028943 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd523490-446a-4bce-8953-35ece901ceb2 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:12.033767 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123bafe-bf9f-4233-a40b-ba0ef740faae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:12.034402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123bafe-bf9f-4233-a40b-ba0ef740faae admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:12.034698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123bafe-bf9f-4233-a40b-ba0ef740faae admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:12.034975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123bafe-bf9f-4233-a40b-ba0ef740faae admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:12.035746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123bafe-bf9f-4233-a40b-ba0ef740faae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:12.036058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123bafe-bf9f-4233-a40b-ba0ef740faae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:12.037687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123bafe-bf9f-4233-a40b-ba0ef740faae admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:12.051200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1155/2280] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:02:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:12.055977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5009ae8-5593-40b1-9641-9c928d3f22c8 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:12.066132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5009ae8-5593-40b1-9641-9c928d3f22c8 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:12.071311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28dcdda-86f5-422b-bb70-f12fd92f03c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:12.073536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dcdda-86f5-422b-bb70-f12fd92f03c6 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:12.073536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dcdda-86f5-422b-bb70-f12fd92f03c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:12.073536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dcdda-86f5-422b-bb70-f12fd92f03c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:12.073536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28dcdda-86f5-422b-bb70-f12fd92f03c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:12.075396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28dcdda-86f5-422b-bb70-f12fd92f03c6 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:12.156078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1126/2281] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:02:12 2022] POST /identity/v3/projects => generated 374 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:12.160262 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123bafe-bf9f-4233-a40b-ba0ef740faae admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:12.171727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123bafe-bf9f-4233-a40b-ba0ef740faae admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:12.235565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05054fe3-1a4d-4027-8db5-585502856230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:12.236244 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05054fe3-1a4d-4027-8db5-585502856230 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:12.236525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05054fe3-1a4d-4027-8db5-585502856230 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:12.236797 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05054fe3-1a4d-4027-8db5-585502856230 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:12.237497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05054fe3-1a4d-4027-8db5-585502856230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:12.241674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05054fe3-1a4d-4027-8db5-585502856230 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:12.319190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1156/2282] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:02:12 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:12.323343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28dcdda-86f5-422b-bb70-f12fd92f03c6 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:12.334572 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28dcdda-86f5-422b-bb70-f12fd92f03c6 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:12.339343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8749d2-af8d-42c0-af43-5344964b11bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:12.341091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8749d2-af8d-42c0-af43-5344964b11bc admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:12.341382 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8749d2-af8d-42c0-af43-5344964b11bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:12.341668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8749d2-af8d-42c0-af43-5344964b11bc admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:12.342539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8749d2-af8d-42c0-af43-5344964b11bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:12.344162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8749d2-af8d-42c0-af43-5344964b11bc admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:12.355000 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1127/2283] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:02:12 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:12.359588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05054fe3-1a4d-4027-8db5-585502856230 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:12.369700 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05054fe3-1a4d-4027-8db5-585502856230 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:12.375137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ee307-f891-4669-84d3-57d56c4ca835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:12.375818 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ee307-f891-4669-84d3-57d56c4ca835 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:12.376147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ee307-f891-4669-84d3-57d56c4ca835 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:12.376432 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ee307-f891-4669-84d3-57d56c4ca835 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:12.377191 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ee307-f891-4669-84d3-57d56c4ca835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:12.378891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ee307-f891-4669-84d3-57d56c4ca835 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:12.390233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1157/2284] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:02:12 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:12.394416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8749d2-af8d-42c0-af43-5344964b11bc admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:12.405124 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8749d2-af8d-42c0-af43-5344964b11bc admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:12.409854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b04d8-ef24-4357-bf09-1f732a06bd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:12.410774 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b04d8-ef24-4357-bf09-1f732a06bd7d admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:12.411070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b04d8-ef24-4357-bf09-1f732a06bd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:12.411352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b04d8-ef24-4357-bf09-1f732a06bd7d admin admin] PATH_INFO: `/v3/projects/a70a17aef5134c73bbc7ac4da3f54639/users/021c0021978f451183c05967e82d5059/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:12.413668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:12.428786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b04d8-ef24-4357-bf09-1f732a06bd7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70a17aef5134c73bbc7ac4da3f54639, user_id=021c0021978f451183c05967e82d5059, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:12.431614 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b04d8-ef24-4357-bf09-1f732a06bd7d admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:12.513478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1128/2285] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:02:12 2022] PUT /identity/v3/projects/a70a17aef5134c73bbc7ac4da3f54639/users/021c0021978f451183c05967e82d5059/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:12.534646 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee8f22-7e32-4052-9e68-5c2d8ccee004 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:12.534937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee8f22-7e32-4052-9e68-5c2d8ccee004 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:12.535216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee8f22-7e32-4052-9e68-5c2d8ccee004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:12.564125 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-55ee8f22-7e32-4052-9e68-5c2d8ccee004 None None] MFA Rules not processed for user `021c0021978f451183c05967e82d5059`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:12.565351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-55ee8f22-7e32-4052-9e68-5c2d8ccee004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:12.633567 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1158/2286] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:02:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:12.644935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b04d8-ef24-4357-bf09-1f732a06bd7d admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:12.646722 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5d7b04d8-ef24-4357-bf09-1f732a06bd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:12.706423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b04d8-ef24-4357-bf09-1f732a06bd7d admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:12.710746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4943ac1-8bbf-4887-b71b-1c63a7e930b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:12.711430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4943ac1-8bbf-4887-b71b-1c63a7e930b4 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:12.711746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4943ac1-8bbf-4887-b71b-1c63a7e930b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:12.711991 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4943ac1-8bbf-4887-b71b-1c63a7e930b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:12.725324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4943ac1-8bbf-4887-b71b-1c63a7e930b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:12.726851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4943ac1-8bbf-4887-b71b-1c63a7e930b4 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:12.737650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1129/2287] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:02:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:15.475260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7425da0-9063-4b25-b7b2-fda3120ee0a2 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:15.475770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7425da0-9063-4b25-b7b2-fda3120ee0a2 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:15.475872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7425da0-9063-4b25-b7b2-fda3120ee0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:15.494088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-c7425da0-9063-4b25-b7b2-fda3120ee0a2 None None] MFA Rules not processed for user `021c0021978f451183c05967e82d5059`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:15.495493 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c7425da0-9063-4b25-b7b2-fda3120ee0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:15.502746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1159/2288] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:02:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:22.732937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:24.548050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e83370-79d7-41f5-a969-60a58bd666d2 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.551149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e83370-79d7-41f5-a969-60a58bd666d2 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.551149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e83370-79d7-41f5-a969-60a58bd666d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.566872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-29e83370-79d7-41f5-a969-60a58bd666d2 None None] MFA Rules not processed for user `a3ccb15b11de4cfea727f0aa453f6e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:24.568125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-29e83370-79d7-41f5-a969-60a58bd666d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:24.623569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1130/2289] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:02:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:25.488711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:34.616318 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=25 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:43.577274 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b4f60-ff05-4d0a-a5e3-12423b6ad9d7 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:43.586381 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b4f60-ff05-4d0a-a5e3-12423b6ad9d7 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:43.586381 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b4f60-ff05-4d0a-a5e3-12423b6ad9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:43.596435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-673b4f60-ff05-4d0a-a5e3-12423b6ad9d7 None None] MFA Rules not processed for user `289cb250e20344d28bd5fd17255d5896`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:43.597569 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-673b4f60-ff05-4d0a-a5e3-12423b6ad9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:43.652981 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1160/2290] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:02:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:47.762949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0a85-291e-4e87-a982-6dc2c91fedcd None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:47.763486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0a85-291e-4e87-a982-6dc2c91fedcd None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:47.763567 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0a85-291e-4e87-a982-6dc2c91fedcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:47.782749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-30af0a85-291e-4e87-a982-6dc2c91fedcd None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:47.783999 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-30af0a85-291e-4e87-a982-6dc2c91fedcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:47.843262 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1131/2291] 10.222.0.112 () {58 vars in 1014 bytes} [Thu May 26 17:02:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:47.888328 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b4f60-ff05-4d0a-a5e3-12423b6ad9d7 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:47.892721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-673b4f60-ff05-4d0a-a5e3-12423b6ad9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:47.973467 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b4f60-ff05-4d0a-a5e3-12423b6ad9d7 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:47.983820 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c11ec0-f2a5-4b9a-b76d-2faf8fbc7fb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:47.984678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c11ec0-f2a5-4b9a-b76d-2faf8fbc7fb0 service swift] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:47.984974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c11ec0-f2a5-4b9a-b76d-2faf8fbc7fb0 service swift] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:47.985256 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c11ec0-f2a5-4b9a-b76d-2faf8fbc7fb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:47.994644 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c11ec0-f2a5-4b9a-b76d-2faf8fbc7fb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:47.996276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c11ec0-f2a5-4b9a-b76d-2faf8fbc7fb0 service swift] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:48.005170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1161/2292] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 17:02:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:02:49.172843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916f058-8889-4802-9966-a6887a090cb1 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:49.173524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916f058-8889-4802-9966-a6887a090cb1 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:49.173524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916f058-8889-4802-9966-a6887a090cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:49.194756 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-4916f058-8889-4802-9966-a6887a090cb1 None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:49.196251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4916f058-8889-4802-9966-a6887a090cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:49.208521 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1132/2293] 10.222.0.112 () {58 vars in 972 bytes} [Thu May 26 17:02:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:49.222490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c11ec0-f2a5-4b9a-b76d-2faf8fbc7fb0 service swift] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:49.237839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c11ec0-f2a5-4b9a-b76d-2faf8fbc7fb0 service swift] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:49.245775 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ea8c-f11d-45d6-8a18-9dc983a4832c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:49.246827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ea8c-f11d-45d6-8a18-9dc983a4832c service swift] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:49.247315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ea8c-f11d-45d6-8a18-9dc983a4832c service swift] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:49.248234 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ea8c-f11d-45d6-8a18-9dc983a4832c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:49.263871 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76ea8c-f11d-45d6-8a18-9dc983a4832c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:49.267777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76ea8c-f11d-45d6-8a18-9dc983a4832c service swift] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:49.277786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1162/2294] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 17:02:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:02:50.393292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446bb3e-0e3e-4cbf-b7b2-a2e16ee5f4e4 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.393791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446bb3e-0e3e-4cbf-b7b2-a2e16ee5f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.393893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446bb3e-0e3e-4cbf-b7b2-a2e16ee5f4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.412679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-d446bb3e-0e3e-4cbf-b7b2-a2e16ee5f4e4 None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:50.413911 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d446bb3e-0e3e-4cbf-b7b2-a2e16ee5f4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:50.421100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1133/2295] 10.222.0.112 () {58 vars in 1014 bytes} [Thu May 26 17:02:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:50.433499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ea8c-f11d-45d6-8a18-9dc983a4832c service swift] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.443968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ea8c-f11d-45d6-8a18-9dc983a4832c service swift] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.448937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b258f-239c-44c8-8088-a9e89ced82e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.449618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b258f-239c-44c8-8088-a9e89ced82e8 service swift] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.449894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b258f-239c-44c8-8088-a9e89ced82e8 service swift] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.450169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b258f-239c-44c8-8088-a9e89ced82e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.459407 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b258f-239c-44c8-8088-a9e89ced82e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.461051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b258f-239c-44c8-8088-a9e89ced82e8 service swift] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.472204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1163/2296] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 17:02:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:02:51.113438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf585a6-85c8-48b4-8b44-1d4f6930c6bf None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:51.113731 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf585a6-85c8-48b4-8b44-1d4f6930c6bf None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:51.114013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf585a6-85c8-48b4-8b44-1d4f6930c6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:51.131950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-8cf585a6-85c8-48b4-8b44-1d4f6930c6bf None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:51.133070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8cf585a6-85c8-48b4-8b44-1d4f6930c6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:51.140745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1134/2297] 10.222.0.112 () {58 vars in 972 bytes} [Thu May 26 17:02:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:51.152799 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b258f-239c-44c8-8088-a9e89ced82e8 service swift] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:51.163930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b258f-239c-44c8-8088-a9e89ced82e8 service swift] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:51.168888 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e8349-4da7-4828-89dc-c3de7c687972 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:51.169517 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e8349-4da7-4828-89dc-c3de7c687972 service swift] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:51.169803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e8349-4da7-4828-89dc-c3de7c687972 service swift] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:51.170083 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e8349-4da7-4828-89dc-c3de7c687972 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:51.178300 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e8349-4da7-4828-89dc-c3de7c687972 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:51.179893 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e8349-4da7-4828-89dc-c3de7c687972 service swift] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:51.188502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1164/2298] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 17:02:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:02:52.577888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf585a6-85c8-48b4-8b44-1d4f6930c6bf None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:52.579621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8cf585a6-85c8-48b4-8b44-1d4f6930c6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:52.649949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf585a6-85c8-48b4-8b44-1d4f6930c6bf None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:52.653700 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce7470-960c-4320-a947-69c7dcfe046a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:52.659386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce7470-960c-4320-a947-69c7dcfe046a service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:52.659386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce7470-960c-4320-a947-69c7dcfe046a service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:52.659386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce7470-960c-4320-a947-69c7dcfe046a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:52.659386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-81ce7470-960c-4320-a947-69c7dcfe046a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:52.746818 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce7470-960c-4320-a947-69c7dcfe046a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:52.748270 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce7470-960c-4320-a947-69c7dcfe046a service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:52.760384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1135/2299] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:02:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:54.074237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e8349-4da7-4828-89dc-c3de7c687972 service swift] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:54.171867 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:54.180256 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e8349-4da7-4828-89dc-c3de7c687972 service swift] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:54.185664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44675d9-c750-4bc2-9e20-7b04818a187f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:54.187172 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44675d9-c750-4bc2-9e20-7b04818a187f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:54.187465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44675d9-c750-4bc2-9e20-7b04818a187f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:54.187752 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44675d9-c750-4bc2-9e20-7b04818a187f admin admin] PATH_INFO: `/v3/users/021c0021978f451183c05967e82d5059` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:54.190010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44675d9-c750-4bc2-9e20-7b04818a187f admin admin] RBAC: Authorizing `identity:delete_user(user_id=021c0021978f451183c05967e82d5059)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:54.193427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44675d9-c750-4bc2-9e20-7b04818a187f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:54.433314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e44675d9-c750-4bc2-9e20-7b04818a187f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '021c0021978f451183c05967e82d5059'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.434141 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e44675d9-c750-4bc2-9e20-7b04818a187f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '021c0021978f451183c05967e82d5059'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.451590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e44675d9-c750-4bc2-9e20-7b04818a187f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '021c0021978f451183c05967e82d5059'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.529308 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e44675d9-c750-4bc2-9e20-7b04818a187f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '021c0021978f451183c05967e82d5059'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.538702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e44675d9-c750-4bc2-9e20-7b04818a187f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '021c0021978f451183c05967e82d5059'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.545227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1165/2300] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:02:54 2022] DELETE /identity/v3/users/021c0021978f451183c05967e82d5059 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:54.551025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f9279-d7bb-49c2-a216-50a5b3bb43f3 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:54.551520 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f9279-d7bb-49c2-a216-50a5b3bb43f3 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:54.551780 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f9279-d7bb-49c2-a216-50a5b3bb43f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:54.570547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-768f9279-d7bb-49c2-a216-50a5b3bb43f3 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:54.571814 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-768f9279-d7bb-49c2-a216-50a5b3bb43f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:54.593831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:54.636236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1136/2301] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:54.646082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44675d9-c750-4bc2-9e20-7b04818a187f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:54.647572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e44675d9-c750-4bc2-9e20-7b04818a187f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:54.715914 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44675d9-c750-4bc2-9e20-7b04818a187f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:54.719822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4406a-2381-429b-8f45-2d4f3dbe704d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:54.720498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4406a-2381-429b-8f45-2d4f3dbe704d service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:54.720805 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4406a-2381-429b-8f45-2d4f3dbe704d service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:54.721110 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4406a-2381-429b-8f45-2d4f3dbe704d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:54.731473 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4406a-2381-429b-8f45-2d4f3dbe704d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:54.732916 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4406a-2381-429b-8f45-2d4f3dbe704d service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:54.744114 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1166/2302] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:02:55.051606 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f9279-d7bb-49c2-a216-50a5b3bb43f3 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:55.053172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-768f9279-d7bb-49c2-a216-50a5b3bb43f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:55.065964 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f9279-d7bb-49c2-a216-50a5b3bb43f3 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:55.070240 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52508ae5-ce55-4333-a1dd-0c0824255c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:55.074037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52508ae5-ce55-4333-a1dd-0c0824255c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.074037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52508ae5-ce55-4333-a1dd-0c0824255c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.074037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52508ae5-ce55-4333-a1dd-0c0824255c24 admin admin] PATH_INFO: `/v3/projects/a70a17aef5134c73bbc7ac4da3f54639` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.085496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52508ae5-ce55-4333-a1dd-0c0824255c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a70a17aef5134c73bbc7ac4da3f54639)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:55.087520 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52508ae5-ce55-4333-a1dd-0c0824255c24 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:55.235005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-52508ae5-ce55-4333-a1dd-0c0824255c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a70a17aef5134c73bbc7ac4da3f54639', 'request_id': 'req-52508ae5-ce55-4333-a1dd-0c0824255c24'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:55.359672 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-52508ae5-ce55-4333-a1dd-0c0824255c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a70a17aef5134c73bbc7ac4da3f54639', 'request_id': 'req-52508ae5-ce55-4333-a1dd-0c0824255c24'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:55.377745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-52508ae5-ce55-4333-a1dd-0c0824255c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a70a17aef5134c73bbc7ac4da3f54639', 'request_id': 'req-52508ae5-ce55-4333-a1dd-0c0824255c24'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:55.388161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-52508ae5-ce55-4333-a1dd-0c0824255c24 admin admin] The token cache is being invalidate because project a70a17aef5134c73bbc7ac4da3f54639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:55.388479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-52508ae5-ce55-4333-a1dd-0c0824255c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:55.389294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-52508ae5-ce55-4333-a1dd-0c0824255c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:55.391188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1137/2303] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:02:55 2022] DELETE /identity/v3/projects/a70a17aef5134c73bbc7ac4da3f54639 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:56.541289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4406a-2381-429b-8f45-2d4f3dbe704d service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:56.542763 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a8b4406a-2381-429b-8f45-2d4f3dbe704d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:56.619445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4406a-2381-429b-8f45-2d4f3dbe704d service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:56.632615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:56.693271 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c19621-599e-4c35-8fa3-d00a52ac07c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:56.693939 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c19621-599e-4c35-8fa3-d00a52ac07c4 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:56.694248 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c19621-599e-4c35-8fa3-d00a52ac07c4 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:56.694571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c19621-599e-4c35-8fa3-d00a52ac07c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:56.696444 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-11c19621-599e-4c35-8fa3-d00a52ac07c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:56.764205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c19621-599e-4c35-8fa3-d00a52ac07c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:56.765817 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c19621-599e-4c35-8fa3-d00a52ac07c4 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:56.777551 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1167/2304] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:02:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:56.847950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52508ae5-ce55-4333-a1dd-0c0824255c24 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:56.850293 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-52508ae5-ce55-4333-a1dd-0c0824255c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:56.919947 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52508ae5-ce55-4333-a1dd-0c0824255c24 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:56.924271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6b1ff-24e1-4929-9542-9e946cbbcfc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:56.930050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b1ff-24e1-4929-9542-9e946cbbcfc6 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:56.930050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b1ff-24e1-4929-9542-9e946cbbcfc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:56.930050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b1ff-24e1-4929-9542-9e946cbbcfc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:56.930050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-49a6b1ff-24e1-4929-9542-9e946cbbcfc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:56.943232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6b1ff-24e1-4929-9542-9e946cbbcfc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:56.945581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6b1ff-24e1-4929-9542-9e946cbbcfc6 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:56.959987 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1138/2305] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:02:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:02.150499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c19621-599e-4c35-8fa3-d00a52ac07c4 service nova] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:02.151892 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-11c19621-599e-4c35-8fa3-d00a52ac07c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:02.166535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c19621-599e-4c35-8fa3-d00a52ac07c4 service nova] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:02.172014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50e11e-d98b-4bcd-8cf1-813312bf7414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:02.172655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50e11e-d98b-4bcd-8cf1-813312bf7414 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:02.172980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50e11e-d98b-4bcd-8cf1-813312bf7414 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:02.173258 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50e11e-d98b-4bcd-8cf1-813312bf7414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:02.175025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-cb50e11e-d98b-4bcd-8cf1-813312bf7414 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:02.234480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50e11e-d98b-4bcd-8cf1-813312bf7414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:02.236152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50e11e-d98b-4bcd-8cf1-813312bf7414 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:02.245377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1168/2306] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:03:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:05.210315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6b1ff-24e1-4929-9542-9e946cbbcfc6 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:05.221739 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6b1ff-24e1-4929-9542-9e946cbbcfc6 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:05.227249 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6bd23-d40c-4151-b459-be474122eeee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:05.227922 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6bd23-d40c-4151-b459-be474122eeee service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:05.228212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6bd23-d40c-4151-b459-be474122eeee service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:05.228488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6bd23-d40c-4151-b459-be474122eeee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:05.230218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-56d6bd23-d40c-4151-b459-be474122eeee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:05.282918 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:05.292755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6bd23-d40c-4151-b459-be474122eeee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:05.294454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6bd23-d40c-4151-b459-be474122eeee service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:05.304131 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1139/2307] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:03:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:12.241024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=77 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:15.488407 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=4 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:20.532466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b05132-5ff9-4471-beaf-e99d9b332d27 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:20.533620 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b05132-5ff9-4471-beaf-e99d9b332d27 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:20.533757 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b05132-5ff9-4471-beaf-e99d9b332d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:20.553008 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-d3b05132-5ff9-4471-beaf-e99d9b332d27 None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:20.554245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d3b05132-5ff9-4471-beaf-e99d9b332d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:20.618127 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1169/2308] 10.222.0.112 () {58 vars in 1014 bytes} [Thu May 26 17:03:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:20.630508 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6bd23-d40c-4151-b459-be474122eeee service nova] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:20.632132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-56d6bd23-d40c-4151-b459-be474122eeee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:20.718140 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6bd23-d40c-4151-b459-be474122eeee service nova] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:20.724215 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ecc25-96bb-4292-b1f0-50c6c38fb23a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:20.724898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ecc25-96bb-4292-b1f0-50c6c38fb23a service swift] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:20.725187 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ecc25-96bb-4292-b1f0-50c6c38fb23a service swift] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:20.725469 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ecc25-96bb-4292-b1f0-50c6c38fb23a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:20.734861 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ecc25-96bb-4292-b1f0-50c6c38fb23a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:20.738475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ecc25-96bb-4292-b1f0-50c6c38fb23a service swift] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:20.747697 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1140/2309] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 17:03:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:03:30.610103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=25 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:30.744087 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=32 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:34.910842 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b05132-5ff9-4471-beaf-e99d9b332d27 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:34.912412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d3b05132-5ff9-4471-beaf-e99d9b332d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:34.924865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b05132-5ff9-4471-beaf-e99d9b332d27 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:34.928661 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a9f4b-a7c9-4344-874c-2599ecec2bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:34.929319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a9f4b-a7c9-4344-874c-2599ecec2bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:34.929604 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a9f4b-a7c9-4344-874c-2599ecec2bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:34.929878 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a9f4b-a7c9-4344-874c-2599ecec2bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:34.931743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-963a9f4b-a7c9-4344-874c-2599ecec2bd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:34.942457 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a9f4b-a7c9-4344-874c-2599ecec2bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:34.943941 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a9f4b-a7c9-4344-874c-2599ecec2bd5 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:34.952672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1170/2310] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:03:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:03:44.865114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b726366-d46d-4e47-8c88-002a0db5ef41 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:44.865114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b726366-d46d-4e47-8c88-002a0db5ef41 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:44.865114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b726366-d46d-4e47-8c88-002a0db5ef41 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:44.866488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1141/2311] 10.222.0.112 () {54 vars in 926 bytes} [Thu May 26 17:03:44 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:03:44.880183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28824fe6-b4d0-41a4-a580-67b8a3ca5166 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:44.880751 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28824fe6-b4d0-41a4-a580-67b8a3ca5166 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:44.880966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28824fe6-b4d0-41a4-a580-67b8a3ca5166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:44.938531 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-28824fe6-b4d0-41a4-a580-67b8a3ca5166 None None] MFA Rules not processed for user `5f2ec4c76f8f4d858bce53f30cc198fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:44.942898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-28824fe6-b4d0-41a4-a580-67b8a3ca5166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:44.954829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1171/2312] 10.222.0.112 () {58 vars in 1023 bytes} [Thu May 26 17:03:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:03:44.967701 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b726366-d46d-4e47-8c88-002a0db5ef41 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:44.969674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2b726366-d46d-4e47-8c88-002a0db5ef41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:45.034664 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b726366-d46d-4e47-8c88-002a0db5ef41 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:45.038403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db7980-c9eb-4810-8271-1367f3158221 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf32c811ead4fd0b69c83890a56509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:45.039061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db7980-c9eb-4810-8271-1367f3158221 service glance] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:45.039352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db7980-c9eb-4810-8271-1367f3158221 service glance] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:45.039637 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db7980-c9eb-4810-8271-1367f3158221 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:45.050845 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db7980-c9eb-4810-8271-1367f3158221 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:45.052322 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db7980-c9eb-4810-8271-1367f3158221 service glance] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:45.063160 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1142/2313] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:03:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:45.290308 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ed9f4-7f5f-4619-9911-3ee5f73374be None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:45.290643 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ed9f4-7f5f-4619-9911-3ee5f73374be None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:45.290928 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ed9f4-7f5f-4619-9911-3ee5f73374be None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:45.292357 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1172/2314] 10.222.0.112 () {54 vars in 926 bytes} [Thu May 26 17:03:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:03:45.297332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a76be-cc55-4aad-8339-1bcdeda1a517 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:45.297629 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a76be-cc55-4aad-8339-1bcdeda1a517 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:45.297914 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a76be-cc55-4aad-8339-1bcdeda1a517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:45.317380 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-178a76be-cc55-4aad-8339-1bcdeda1a517 None None] MFA Rules not processed for user `0288901db0244eab9a737af460ce1bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:45.318632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-178a76be-cc55-4aad-8339-1bcdeda1a517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:45.325325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1143/2315] 10.222.0.112 () {58 vars in 1023 bytes} [Thu May 26 17:03:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:45.338453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ed9f4-7f5f-4619-9911-3ee5f73374be None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:45.349895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ed9f4-7f5f-4619-9911-3ee5f73374be None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:45.353410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b34963-ce0a-4323-b51a-5baea0104346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:45.354047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34963-ce0a-4323-b51a-5baea0104346 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:45.354348 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34963-ce0a-4323-b51a-5baea0104346 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:45.354692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34963-ce0a-4323-b51a-5baea0104346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:45.362450 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b34963-ce0a-4323-b51a-5baea0104346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:45.371117 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b34963-ce0a-4323-b51a-5baea0104346 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:45.371684 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1173/2316] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:03:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:03:45.452814 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c5846-bafc-45d5-8e9c-a47d7756e6a6 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:45.453106 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c5846-bafc-45d5-8e9c-a47d7756e6a6 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:45.453388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c5846-bafc-45d5-8e9c-a47d7756e6a6 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:45.455176 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1144/2317] 10.222.0.112 () {54 vars in 926 bytes} [Thu May 26 17:03:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:03:45.460772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca123e42-00bd-4da9-8bbb-63965c1aba99 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:45.461066 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca123e42-00bd-4da9-8bbb-63965c1aba99 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:45.461342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca123e42-00bd-4da9-8bbb-63965c1aba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:45.480407 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-ca123e42-00bd-4da9-8bbb-63965c1aba99 None None] MFA Rules not processed for user `5f2ec4c76f8f4d858bce53f30cc198fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:45.481595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ca123e42-00bd-4da9-8bbb-63965c1aba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:45.491859 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1174/2318] 10.222.0.112 () {58 vars in 1023 bytes} [Thu May 26 17:03:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:45.502503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c5846-bafc-45d5-8e9c-a47d7756e6a6 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:45.513659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c5846-bafc-45d5-8e9c-a47d7756e6a6 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:45.517386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cceb99-b1c4-4bb9-8cdb-7155846eb66e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:45.518241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cceb99-b1c4-4bb9-8cdb-7155846eb66e service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:45.518578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cceb99-b1c4-4bb9-8cdb-7155846eb66e service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:45.518860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cceb99-b1c4-4bb9-8cdb-7155846eb66e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:45.529083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cceb99-b1c4-4bb9-8cdb-7155846eb66e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:45.530553 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cceb99-b1c4-4bb9-8cdb-7155846eb66e service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:45.542649 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1145/2319] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:03:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:45.608745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca123e42-00bd-4da9-8bbb-63965c1aba99 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:45.610107 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ca123e42-00bd-4da9-8bbb-63965c1aba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:45.676872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca123e42-00bd-4da9-8bbb-63965c1aba99 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:45.681931 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14186333-6891-437b-83a7-e93c1f446a52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:45.682606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14186333-6891-437b-83a7-e93c1f446a52 service placement] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:45.682888 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14186333-6891-437b-83a7-e93c1f446a52 service placement] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:45.683162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14186333-6891-437b-83a7-e93c1f446a52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:45.684898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-14186333-6891-437b-83a7-e93c1f446a52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:45.696424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14186333-6891-437b-83a7-e93c1f446a52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:45.697978 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14186333-6891-437b-83a7-e93c1f446a52 service placement] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:45.708359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1175/2320] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:03:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:51.120089 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7aeb8b-8788-4887-8319-070c6300254f None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:51.120593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7aeb8b-8788-4887-8319-070c6300254f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:51.120690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7aeb8b-8788-4887-8319-070c6300254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:51.139162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-7c7aeb8b-8788-4887-8319-070c6300254f None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:51.140338 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7c7aeb8b-8788-4887-8319-070c6300254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:51.148178 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1146/2321] 10.222.0.112 () {58 vars in 1014 bytes} [Thu May 26 17:03:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:51.169620 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14186333-6891-437b-83a7-e93c1f446a52 service placement] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:51.181805 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14186333-6891-437b-83a7-e93c1f446a52 service placement] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:51.187837 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77d8a1-5dc4-41e0-a671-11a3508a9152 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:51.189516 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77d8a1-5dc4-41e0-a671-11a3508a9152 service swift] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:51.190081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77d8a1-5dc4-41e0-a671-11a3508a9152 service swift] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:51.190661 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77d8a1-5dc4-41e0-a671-11a3508a9152 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:51.203848 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77d8a1-5dc4-41e0-a671-11a3508a9152 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:51.205424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77d8a1-5dc4-41e0-a671-11a3508a9152 service swift] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:51.213954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1176/2322] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 17:03:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:04:01.133695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=38 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:01.210629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=62 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:29.728924 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7aeb8b-8788-4887-8319-070c6300254f None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:29.743031 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7aeb8b-8788-4887-8319-070c6300254f None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:29.748689 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fda9d-c366-4a70-b91c-c5949b676961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:29.749464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fda9d-c366-4a70-b91c-c5949b676961 service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:29.749820 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fda9d-c366-4a70-b91c-c5949b676961 service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:29.750167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fda9d-c366-4a70-b91c-c5949b676961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:29.752111 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-e02fda9d-c366-4a70-b91c-c5949b676961 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:29.765040 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fda9d-c366-4a70-b91c-c5949b676961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:29.766804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fda9d-c366-4a70-b91c-c5949b676961 service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:29.778224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1147/2323] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:04:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:35.986710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6c1b2-46dc-4f1b-8c93-6639c69ace18 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:35.987269 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6c1b2-46dc-4f1b-8c93-6639c69ace18 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:35.987269 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6c1b2-46dc-4f1b-8c93-6639c69ace18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:36.006157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-5fe6c1b2-46dc-4f1b-8c93-6639c69ace18 None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:36.007473 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5fe6c1b2-46dc-4f1b-8c93-6639c69ace18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:36.014884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1177/2324] 10.222.0.112 () {58 vars in 972 bytes} [Thu May 26 17:04:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:36.027516 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fda9d-c366-4a70-b91c-c5949b676961 service nova] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:36.039030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fda9d-c366-4a70-b91c-c5949b676961 service nova] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:36.044097 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c5d72-a99e-40ee-9cab-b3ca93af8276 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:36.044745 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c5d72-a99e-40ee-9cab-b3ca93af8276 service swift] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:36.045066 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c5d72-a99e-40ee-9cab-b3ca93af8276 service swift] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:36.045330 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c5d72-a99e-40ee-9cab-b3ca93af8276 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:36.055057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c5d72-a99e-40ee-9cab-b3ca93af8276 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:36.056665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c5d72-a99e-40ee-9cab-b3ca93af8276 service swift] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:36.066497 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1148/2325] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 17:04:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 17:04:46.000647 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:46.061862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=12 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:13.944687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6c1b2-46dc-4f1b-8c93-6639c69ace18 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:13.949872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5fe6c1b2-46dc-4f1b-8c93-6639c69ace18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:13.962822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6c1b2-46dc-4f1b-8c93-6639c69ace18 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:13.969530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b19030-e076-4ba5-9725-179c13277906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:13.970181 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b19030-e076-4ba5-9725-179c13277906 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:13.970505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b19030-e076-4ba5-9725-179c13277906 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:13.970810 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b19030-e076-4ba5-9725-179c13277906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:13.972552 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-35b19030-e076-4ba5-9725-179c13277906 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:14.035850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b19030-e076-4ba5-9725-179c13277906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:14.037377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b19030-e076-4ba5-9725-179c13277906 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:14.047333 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1178/2326] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:05:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:14.759889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c5d72-a99e-40ee-9cab-b3ca93af8276 service swift] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:14.771564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c5d72-a99e-40ee-9cab-b3ca93af8276 service swift] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:14.775208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5420c-69bb-4360-b164-7f1f2c9a21c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:14.775853 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5420c-69bb-4360-b164-7f1f2c9a21c6 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:14.776136 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5420c-69bb-4360-b164-7f1f2c9a21c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:14.776416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5420c-69bb-4360-b164-7f1f2c9a21c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:14.778777 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-55d5420c-69bb-4360-b164-7f1f2c9a21c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:14.838043 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5420c-69bb-4360-b164-7f1f2c9a21c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:14.839532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5420c-69bb-4360-b164-7f1f2c9a21c6 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:14.849110 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1149/2327] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:05:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:16.072449 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b19030-e076-4ba5-9725-179c13277906 service nova] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:16.086132 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b19030-e076-4ba5-9725-179c13277906 service nova] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:16.092542 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0516b-63d3-4a06-a4d0-1389568585a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:16.093359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0516b-63d3-4a06-a4d0-1389568585a7 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:16.093716 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0516b-63d3-4a06-a4d0-1389568585a7 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:16.094061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0516b-63d3-4a06-a4d0-1389568585a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:16.096151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6ee0516b-63d3-4a06-a4d0-1389568585a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:16.110680 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0516b-63d3-4a06-a4d0-1389568585a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:16.112577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0516b-63d3-4a06-a4d0-1389568585a7 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:16.125483 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1179/2328] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:05:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:18.679094 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a233fe-9039-47a3-a58d-51bb9ac90e0e None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:18.679638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a233fe-9039-47a3-a58d-51bb9ac90e0e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:18.679638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a233fe-9039-47a3-a58d-51bb9ac90e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:18.698069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-c1a233fe-9039-47a3-a58d-51bb9ac90e0e None None] MFA Rules not processed for user `530b2b1951644755afd1432381cf37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:18.699335 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-c1a233fe-9039-47a3-a58d-51bb9ac90e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:18.706904 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1150/2329] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:05:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:19.024358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0516b-63d3-4a06-a4d0-1389568585a7 service nova] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:19.034186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0516b-63d3-4a06-a4d0-1389568585a7 service nova] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:19.038361 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3203b4-7d65-4e11-9044-4c27222f1eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:19.039161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3203b4-7d65-4e11-9044-4c27222f1eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:19.039611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3203b4-7d65-4e11-9044-4c27222f1eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:19.040035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3203b4-7d65-4e11-9044-4c27222f1eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:19.042121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6c3203b4-7d65-4e11-9044-4c27222f1eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:19.052636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3203b4-7d65-4e11-9044-4c27222f1eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:19.054077 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3203b4-7d65-4e11-9044-4c27222f1eb4 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:19.063356 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1180/2330] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:05:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:05:28.692530 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=31 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:29.059363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=40 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:48.087947 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a233fe-9039-47a3-a58d-51bb9ac90e0e None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:48.100758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a233fe-9039-47a3-a58d-51bb9ac90e0e None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:48.107062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb9d1a-579b-4053-a244-54bb3fa377ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:48.107703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb9d1a-579b-4053-a244-54bb3fa377ab service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:48.107994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb9d1a-579b-4053-a244-54bb3fa377ab service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:48.108279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb9d1a-579b-4053-a244-54bb3fa377ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:48.110037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9eeb9d1a-579b-4053-a244-54bb3fa377ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:48.169397 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb9d1a-579b-4053-a244-54bb3fa377ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:48.171019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb9d1a-579b-4053-a244-54bb3fa377ab service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:48.179896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1151/2331] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:05:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:48.997255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3203b4-7d65-4e11-9044-4c27222f1eb4 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:49.026108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3203b4-7d65-4e11-9044-4c27222f1eb4 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:49.038266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccaa3e-c958-491a-a1d5-77a003090558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:49.039302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccaa3e-c958-491a-a1d5-77a003090558 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:49.039839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccaa3e-c958-491a-a1d5-77a003090558 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:49.041662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccaa3e-c958-491a-a1d5-77a003090558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:49.044229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8eccaa3e-c958-491a-a1d5-77a003090558 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:49.060257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccaa3e-c958-491a-a1d5-77a003090558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:49.062231 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccaa3e-c958-491a-a1d5-77a003090558 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:49.075570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1181/2332] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:05:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:05:54.023470 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120cf4c-87bc-46a8-abbe-d293216b4547 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:54.023997 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120cf4c-87bc-46a8-abbe-d293216b4547 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:54.024124 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120cf4c-87bc-46a8-abbe-d293216b4547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:54.044530 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-3120cf4c-87bc-46a8-abbe-d293216b4547 None None] MFA Rules not processed for user `a3ccb15b11de4cfea727f0aa453f6e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:54.045755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-3120cf4c-87bc-46a8-abbe-d293216b4547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:54.053624 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1152/2333] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:05:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:59.069665 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=6 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:59.530378 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8918d-5798-48be-b243-376fbba29881 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:59.530676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8918d-5798-48be-b243-376fbba29881 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:59.530958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8918d-5798-48be-b243-376fbba29881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:59.552342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-3ad8918d-5798-48be-b243-376fbba29881 None None] MFA Rules not processed for user `289cb250e20344d28bd5fd17255d5896`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:59.553641 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-3ad8918d-5798-48be-b243-376fbba29881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:59.561592 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1182/2334] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:05:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:04.038728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=31 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:05.305996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120cf4c-87bc-46a8-abbe-d293216b4547 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:05.318708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120cf4c-87bc-46a8-abbe-d293216b4547 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:05.324092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66f7b8-0eb8-40a5-9c3d-ae62c04e03b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:05.324749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66f7b8-0eb8-40a5-9c3d-ae62c04e03b3 service placement] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:05.325053 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66f7b8-0eb8-40a5-9c3d-ae62c04e03b3 service placement] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:05.325313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66f7b8-0eb8-40a5-9c3d-ae62c04e03b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:05.327099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-df66f7b8-0eb8-40a5-9c3d-ae62c04e03b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:05.339495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66f7b8-0eb8-40a5-9c3d-ae62c04e03b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:05.341116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66f7b8-0eb8-40a5-9c3d-ae62c04e03b3 service placement] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:05.351493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1153/2335] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:06:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:09.125318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551e455-6b84-47c7-9293-4498845f34e1 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:09.130100 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551e455-6b84-47c7-9293-4498845f34e1 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:09.130100 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551e455-6b84-47c7-9293-4498845f34e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:09.149371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e551e455-6b84-47c7-9293-4498845f34e1 None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:09.152975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e551e455-6b84-47c7-9293-4498845f34e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:09.163427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1183/2336] 10.222.0.112 () {58 vars in 972 bytes} [Thu May 26 17:06:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:09.293908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66f7b8-0eb8-40a5-9c3d-ae62c04e03b3 service placement] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:09.305580 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66f7b8-0eb8-40a5-9c3d-ae62c04e03b3 service placement] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:09.311650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7124fbf-7102-43ef-acbc-0a66dc26300f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:09.312320 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7124fbf-7102-43ef-acbc-0a66dc26300f service swift] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:09.312683 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7124fbf-7102-43ef-acbc-0a66dc26300f service swift] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:09.312977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7124fbf-7102-43ef-acbc-0a66dc26300f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:09.321931 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7124fbf-7102-43ef-acbc-0a66dc26300f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:09.324280 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7124fbf-7102-43ef-acbc-0a66dc26300f service swift] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:09.333383 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1154/2337] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 17:06:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 17:06:10.888815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551e455-6b84-47c7-9293-4498845f34e1 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:10.898187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551e455-6b84-47c7-9293-4498845f34e1 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:10.902576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536eefcb-a869-4e83-bc65-dca3bc6c12b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:10.903220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536eefcb-a869-4e83-bc65-dca3bc6c12b3 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:10.903508 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536eefcb-a869-4e83-bc65-dca3bc6c12b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:10.903791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536eefcb-a869-4e83-bc65-dca3bc6c12b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:10.905692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-536eefcb-a869-4e83-bc65-dca3bc6c12b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:10.968901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536eefcb-a869-4e83-bc65-dca3bc6c12b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:10.970340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536eefcb-a869-4e83-bc65-dca3bc6c12b3 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:10.980297 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1184/2338] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:14.925589 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7124fbf-7102-43ef-acbc-0a66dc26300f service swift] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:14.938605 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7124fbf-7102-43ef-acbc-0a66dc26300f service swift] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:14.944369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22640a5-5c78-46be-948d-4a7153a15c30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:14.945182 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22640a5-5c78-46be-948d-4a7153a15c30 service placement] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:14.945565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22640a5-5c78-46be-948d-4a7153a15c30 service placement] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:14.945946 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22640a5-5c78-46be-948d-4a7153a15c30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:14.948689 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f22640a5-5c78-46be-948d-4a7153a15c30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:14.962313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22640a5-5c78-46be-948d-4a7153a15c30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:14.964813 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22640a5-5c78-46be-948d-4a7153a15c30 service placement] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:14.975852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1155/2339] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:06:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:19.106866 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aae2e3-4eb9-4aad-bc7f-527f73ab594c None None] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:19.107374 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aae2e3-4eb9-4aad-bc7f-527f73ab594c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:19.107496 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aae2e3-4eb9-4aad-bc7f-527f73ab594c None None] PATH_INFO: `/` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:19.108913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1185/2340] 10.222.0.112 () {54 vars in 926 bytes} [Thu May 26 17:06:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:06:19.119634 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77e71b-894d-4db3-b098-ea6c6855780e None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:19.120266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77e71b-894d-4db3-b098-ea6c6855780e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:19.120789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77e71b-894d-4db3-b098-ea6c6855780e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:19.140351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-aa77e71b-894d-4db3-b098-ea6c6855780e None None] MFA Rules not processed for user `b415e7fca03e4602b3d711436d47f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:19.143957 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-aa77e71b-894d-4db3-b098-ea6c6855780e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:19.151107 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1156/2341] 10.222.0.112 () {58 vars in 1023 bytes} [Thu May 26 17:06:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:19.175294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aae2e3-4eb9-4aad-bc7f-527f73ab594c None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:19.190797 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aae2e3-4eb9-4aad-bc7f-527f73ab594c None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:19.196410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28764bcd-c19a-4deb-80aa-2611ae4e5b4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:19.197800 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28764bcd-c19a-4deb-80aa-2611ae4e5b4a service placement] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:19.198189 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28764bcd-c19a-4deb-80aa-2611ae4e5b4a service placement] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:19.198607 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28764bcd-c19a-4deb-80aa-2611ae4e5b4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:19.210365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28764bcd-c19a-4deb-80aa-2611ae4e5b4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:19.211925 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28764bcd-c19a-4deb-80aa-2611ae4e5b4a service placement] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:19.222742 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1186/2342] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:06:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:19.270055 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77e71b-894d-4db3-b098-ea6c6855780e None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:19.271530 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-aa77e71b-894d-4db3-b098-ea6c6855780e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:19.286065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77e71b-894d-4db3-b098-ea6c6855780e None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:19.293846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce28d30-4b19-47a6-948c-711dfe8fec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:19.295261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce28d30-4b19-47a6-948c-711dfe8fec21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:19.295547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce28d30-4b19-47a6-948c-711dfe8fec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:19.295827 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce28d30-4b19-47a6-948c-711dfe8fec21 admin admin] PATH_INFO: `/v3/users/1f3a90c131984e8f8ab7b63679b39adc` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:19.297094 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce28d30-4b19-47a6-948c-711dfe8fec21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3a90c131984e8f8ab7b63679b39adc)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:19.299177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce28d30-4b19-47a6-948c-711dfe8fec21 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:19.519483 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1ce28d30-4b19-47a6-948c-711dfe8fec21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3a90c131984e8f8ab7b63679b39adc'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:19.520130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1ce28d30-4b19-47a6-948c-711dfe8fec21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3a90c131984e8f8ab7b63679b39adc'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:19.520728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1ce28d30-4b19-47a6-948c-711dfe8fec21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3a90c131984e8f8ab7b63679b39adc'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:19.578176 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1ce28d30-4b19-47a6-948c-711dfe8fec21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3a90c131984e8f8ab7b63679b39adc'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:19.591803 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1ce28d30-4b19-47a6-948c-711dfe8fec21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3a90c131984e8f8ab7b63679b39adc'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:19.604912 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1157/2343] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:06:19 2022] DELETE /identity/v3/users/1f3a90c131984e8f8ab7b63679b39adc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:19.862098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28764bcd-c19a-4deb-80aa-2611ae4e5b4a service placement] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:19.881745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28764bcd-c19a-4deb-80aa-2611ae4e5b4a service placement] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:19.945957 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130a3a7-cd9b-4be7-943f-eae3a58372be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:19.946978 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130a3a7-cd9b-4be7-943f-eae3a58372be admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:19.947261 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130a3a7-cd9b-4be7-943f-eae3a58372be admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:19.947548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130a3a7-cd9b-4be7-943f-eae3a58372be admin admin] PATH_INFO: `/v3/projects/3684109c25814f2dadd52c7f00d5e025` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:19.953215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130a3a7-cd9b-4be7-943f-eae3a58372be admin admin] RBAC: Authorizing `identity:delete_project(project_id=3684109c25814f2dadd52c7f00d5e025)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:19.953215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130a3a7-cd9b-4be7-943f-eae3a58372be admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:20.060537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3130a3a7-cd9b-4be7-943f-eae3a58372be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3684109c25814f2dadd52c7f00d5e025', 'request_id': 'req-3130a3a7-cd9b-4be7-943f-eae3a58372be'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:20.145338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3130a3a7-cd9b-4be7-943f-eae3a58372be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3684109c25814f2dadd52c7f00d5e025', 'request_id': 'req-3130a3a7-cd9b-4be7-943f-eae3a58372be'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:20.153167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3130a3a7-cd9b-4be7-943f-eae3a58372be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3684109c25814f2dadd52c7f00d5e025', 'request_id': 'req-3130a3a7-cd9b-4be7-943f-eae3a58372be'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:20.160762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:20.165655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3130a3a7-cd9b-4be7-943f-eae3a58372be admin admin] The token cache is being invalidate because project 3684109c25814f2dadd52c7f00d5e025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:20.166108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3130a3a7-cd9b-4be7-943f-eae3a58372be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:20.167198 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3130a3a7-cd9b-4be7-943f-eae3a58372be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:20.168831 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1187/2344] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:06:19 2022] DELETE /identity/v3/projects/3684109c25814f2dadd52c7f00d5e025 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:20.172794 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce28d30-4b19-47a6-948c-711dfe8fec21 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:20.174218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1ce28d30-4b19-47a6-948c-711dfe8fec21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:20.187425 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce28d30-4b19-47a6-948c-711dfe8fec21 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:20.251406 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f11d4-bfe1-497e-a99e-e83dc8bc9767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:20.252295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f11d4-bfe1-497e-a99e-e83dc8bc9767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:20.252585 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f11d4-bfe1-497e-a99e-e83dc8bc9767 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:20.252866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f11d4-bfe1-497e-a99e-e83dc8bc9767 admin admin] PATH_INFO: `/v3/users/6b1b2ee56e634f6ca79dc20be730b30b` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:20.254068 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f11d4-bfe1-497e-a99e-e83dc8bc9767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b1b2ee56e634f6ca79dc20be730b30b)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:20.256044 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f11d4-bfe1-497e-a99e-e83dc8bc9767 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:20.444379 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:20.547813 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-305f11d4-bfe1-497e-a99e-e83dc8bc9767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b1b2ee56e634f6ca79dc20be730b30b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:20.548501 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-305f11d4-bfe1-497e-a99e-e83dc8bc9767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b1b2ee56e634f6ca79dc20be730b30b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:20.549228 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-305f11d4-bfe1-497e-a99e-e83dc8bc9767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b1b2ee56e634f6ca79dc20be730b30b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:20.625580 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-305f11d4-bfe1-497e-a99e-e83dc8bc9767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b1b2ee56e634f6ca79dc20be730b30b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:20.641541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-305f11d4-bfe1-497e-a99e-e83dc8bc9767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b1b2ee56e634f6ca79dc20be730b30b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:20.657803 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1158/2345] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:06:20 2022] DELETE /identity/v3/users/6b1b2ee56e634f6ca79dc20be730b30b => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:20.981514 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130a3a7-cd9b-4be7-943f-eae3a58372be admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:20.983295 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-3130a3a7-cd9b-4be7-943f-eae3a58372be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:21.003636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130a3a7-cd9b-4be7-943f-eae3a58372be admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:21.067299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac18000-e99b-4a58-8abd-1bf0e767884b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:21.068170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac18000-e99b-4a58-8abd-1bf0e767884b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:21.068455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac18000-e99b-4a58-8abd-1bf0e767884b admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:21.068731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac18000-e99b-4a58-8abd-1bf0e767884b admin admin] PATH_INFO: `/v3/projects/6cf4694175fb4161a4f42273a11d75c2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:21.069919 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac18000-e99b-4a58-8abd-1bf0e767884b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf4694175fb4161a4f42273a11d75c2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:21.072540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac18000-e99b-4a58-8abd-1bf0e767884b admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:21.170246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-cac18000-e99b-4a58-8abd-1bf0e767884b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf4694175fb4161a4f42273a11d75c2', 'request_id': 'req-cac18000-e99b-4a58-8abd-1bf0e767884b'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:21.248003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-cac18000-e99b-4a58-8abd-1bf0e767884b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf4694175fb4161a4f42273a11d75c2', 'request_id': 'req-cac18000-e99b-4a58-8abd-1bf0e767884b'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:21.255668 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-cac18000-e99b-4a58-8abd-1bf0e767884b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf4694175fb4161a4f42273a11d75c2', 'request_id': 'req-cac18000-e99b-4a58-8abd-1bf0e767884b'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:21.268718 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-cac18000-e99b-4a58-8abd-1bf0e767884b admin admin] The token cache is being invalidate because project 6cf4694175fb4161a4f42273a11d75c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:21.269108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-cac18000-e99b-4a58-8abd-1bf0e767884b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:21.269838 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-cac18000-e99b-4a58-8abd-1bf0e767884b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:21.275328 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1188/2346] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:06:20 2022] DELETE /identity/v3/projects/6cf4694175fb4161a4f42273a11d75c2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:21.277765 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a7ef-3a2d-422a-8888-365a17b29b73 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:21.278278 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a7ef-3a2d-422a-8888-365a17b29b73 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:21.279123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a7ef-3a2d-422a-8888-365a17b29b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:21.305209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-1c74a7ef-3a2d-422a-8888-365a17b29b73 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:21.306873 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1c74a7ef-3a2d-422a-8888-365a17b29b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:21.370895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1159/2347] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:21.385031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ac479-f93e-49b2-accc-8112737c13fb None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:21.385358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ac479-f93e-49b2-accc-8112737c13fb None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:21.385730 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ac479-f93e-49b2-accc-8112737c13fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:21.404184 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-1f6ac479-f93e-49b2-accc-8112737c13fb None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:21.405403 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1f6ac479-f93e-49b2-accc-8112737c13fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:21.413781 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1189/2348] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:21.418402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a7ef-3a2d-422a-8888-365a17b29b73 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:21.428899 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a7ef-3a2d-422a-8888-365a17b29b73 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:21.434358 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd91da-aee6-492d-89be-6b5262b5e499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:21.435037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd91da-aee6-492d-89be-6b5262b5e499 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:21.435325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd91da-aee6-492d-89be-6b5262b5e499 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:21.435607 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd91da-aee6-492d-89be-6b5262b5e499 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:21.436335 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd91da-aee6-492d-89be-6b5262b5e499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:06:21.436645 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd91da-aee6-492d-89be-6b5262b5e499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:21.438260 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd91da-aee6-492d-89be-6b5262b5e499 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:21.451063 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1160/2349] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:06:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:06:21.465890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ac479-f93e-49b2-accc-8112737c13fb None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:21.476503 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ac479-f93e-49b2-accc-8112737c13fb None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:21.482552 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727e291-3a5f-45e1-a4af-39238000ea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:21.483234 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727e291-3a5f-45e1-a4af-39238000ea3e admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:21.483524 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727e291-3a5f-45e1-a4af-39238000ea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:21.483800 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727e291-3a5f-45e1-a4af-39238000ea3e admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:21.484499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727e291-3a5f-45e1-a4af-39238000ea3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:21.486442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727e291-3a5f-45e1-a4af-39238000ea3e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:21.627647 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1190/2350] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:06:21 2022] POST /identity/v3/projects => generated 374 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:21.631750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd91da-aee6-492d-89be-6b5262b5e499 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:21.642927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd91da-aee6-492d-89be-6b5262b5e499 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:21.706874 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2c8c9-77df-4789-a3eb-8f1c6459b172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:21.707560 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c8c9-77df-4789-a3eb-8f1c6459b172 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:21.707850 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c8c9-77df-4789-a3eb-8f1c6459b172 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:21.708138 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c8c9-77df-4789-a3eb-8f1c6459b172 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:21.708845 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2c8c9-77df-4789-a3eb-8f1c6459b172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:21.710936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2c8c9-77df-4789-a3eb-8f1c6459b172 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:21.803288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1161/2351] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:06:21 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:21.808448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727e291-3a5f-45e1-a4af-39238000ea3e admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:21.818832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727e291-3a5f-45e1-a4af-39238000ea3e admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:21.824764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939a512-5420-4f76-aa52-c3e64d989271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:21.827004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939a512-5420-4f76-aa52-c3e64d989271 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:21.827004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939a512-5420-4f76-aa52-c3e64d989271 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:21.827004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939a512-5420-4f76-aa52-c3e64d989271 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:21.827004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939a512-5420-4f76-aa52-c3e64d989271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:21.828305 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939a512-5420-4f76-aa52-c3e64d989271 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:21.839390 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1191/2352] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:06:21 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:06:21.843390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2c8c9-77df-4789-a3eb-8f1c6459b172 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:21.853946 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2c8c9-77df-4789-a3eb-8f1c6459b172 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:21.858638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b91331-1c47-409b-a413-d020f7a12405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:21.859296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b91331-1c47-409b-a413-d020f7a12405 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:21.859587 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b91331-1c47-409b-a413-d020f7a12405 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:21.859864 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b91331-1c47-409b-a413-d020f7a12405 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:21.860583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b91331-1c47-409b-a413-d020f7a12405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:21.862265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b91331-1c47-409b-a413-d020f7a12405 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:21.873064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1162/2353] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:06:21 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:21.876958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939a512-5420-4f76-aa52-c3e64d989271 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:21.887795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939a512-5420-4f76-aa52-c3e64d989271 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:21.892493 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751e762-06f5-459f-9340-9b546dc00e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:21.893430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751e762-06f5-459f-9340-9b546dc00e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:21.893665 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751e762-06f5-459f-9340-9b546dc00e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:21.893943 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751e762-06f5-459f-9340-9b546dc00e7b admin admin] PATH_INFO: `/v3/projects/ac969ae313524a28b6635d82db310f97/users/caebb88017f94b25bbbac26be1218bc3/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:21.909408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751e762-06f5-459f-9340-9b546dc00e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac969ae313524a28b6635d82db310f97, user_id=caebb88017f94b25bbbac26be1218bc3, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:21.912098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751e762-06f5-459f-9340-9b546dc00e7b admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:22.002920 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1192/2354] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:06:21 2022] PUT /identity/v3/projects/ac969ae313524a28b6635d82db310f97/users/caebb88017f94b25bbbac26be1218bc3/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:06:22.008048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78469d6a-cb02-4770-9d36-2cd39196459d None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:22.008342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78469d6a-cb02-4770-9d36-2cd39196459d None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:22.008624 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78469d6a-cb02-4770-9d36-2cd39196459d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:22.027368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-78469d6a-cb02-4770-9d36-2cd39196459d None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:22.028578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-78469d6a-cb02-4770-9d36-2cd39196459d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:22.033846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:22.088659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1163/2355] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:22.098294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751e762-06f5-459f-9340-9b546dc00e7b admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:22.100164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7751e762-06f5-459f-9340-9b546dc00e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:22.120102 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:22.158648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751e762-06f5-459f-9340-9b546dc00e7b admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:22.162211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcbce9-cf06-440b-abaf-76d1e9971aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:22.162892 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcbce9-cf06-440b-abaf-76d1e9971aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:22.163179 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcbce9-cf06-440b-abaf-76d1e9971aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:22.163460 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcbce9-cf06-440b-abaf-76d1e9971aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:22.173355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcbce9-cf06-440b-abaf-76d1e9971aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:22.174838 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcbce9-cf06-440b-abaf-76d1e9971aa4 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:22.184876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1193/2356] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:29.554213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4f675-8447-42d0-b2c8-16b7215681a8 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:29.554759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4f675-8447-42d0-b2c8-16b7215681a8 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:29.554995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4f675-8447-42d0-b2c8-16b7215681a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:29.583834 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-96e4f675-8447-42d0-b2c8-16b7215681a8 None None] MFA Rules not processed for user `caebb88017f94b25bbbac26be1218bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:29.585065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-96e4f675-8447-42d0-b2c8-16b7215681a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:29.678482 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1164/2357] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:06:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:29.679474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcbce9-cf06-440b-abaf-76d1e9971aa4 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:29.689466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcbce9-cf06-440b-abaf-76d1e9971aa4 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:29.694415 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa703c9-46ff-4b03-9646-37e5569d8df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:29.694980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa703c9-46ff-4b03-9646-37e5569d8df1 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:29.695670 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa703c9-46ff-4b03-9646-37e5569d8df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:29.695979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa703c9-46ff-4b03-9646-37e5569d8df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:29.696947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa703c9-46ff-4b03-9646-37e5569d8df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:29.699081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa703c9-46ff-4b03-9646-37e5569d8df1 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:29.833004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1194/2358] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:06:29 2022] POST /identity/v3/projects => generated 372 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:29.843438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4f675-8447-42d0-b2c8-16b7215681a8 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:29.856073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4f675-8447-42d0-b2c8-16b7215681a8 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:29.923457 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4253ec-ef6a-4e3d-a7c2-df4f444fb757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:29.924151 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4253ec-ef6a-4e3d-a7c2-df4f444fb757 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:29.924446 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4253ec-ef6a-4e3d-a7c2-df4f444fb757 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:29.924720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4253ec-ef6a-4e3d-a7c2-df4f444fb757 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:29.925414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4253ec-ef6a-4e3d-a7c2-df4f444fb757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:29.927594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4253ec-ef6a-4e3d-a7c2-df4f444fb757 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:30.066195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1165/2359] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:06:29 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:30.068035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa703c9-46ff-4b03-9646-37e5569d8df1 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:30.080650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa703c9-46ff-4b03-9646-37e5569d8df1 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:30.087534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3ca43-697c-496a-9dcb-877355e0d0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:30.087534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3ca43-697c-496a-9dcb-877355e0d0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:30.088398 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3ca43-697c-496a-9dcb-877355e0d0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:30.088745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3ca43-697c-496a-9dcb-877355e0d0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:30.089553 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3ca43-697c-496a-9dcb-877355e0d0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:30.091354 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3ca43-697c-496a-9dcb-877355e0d0a5 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:30.103316 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1195/2360] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:06:30 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:30.107544 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4253ec-ef6a-4e3d-a7c2-df4f444fb757 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:30.119582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4253ec-ef6a-4e3d-a7c2-df4f444fb757 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:30.124552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965030e-8979-4b96-a0eb-c60c6d57f649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:30.125560 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965030e-8979-4b96-a0eb-c60c6d57f649 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:30.125961 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965030e-8979-4b96-a0eb-c60c6d57f649 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:30.126341 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965030e-8979-4b96-a0eb-c60c6d57f649 admin admin] PATH_INFO: `/v3/projects/e37ac11ecdf1411a843beab041b60409/users/ac696abfab6943cb9efbf7bdd385d010/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:30.143250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965030e-8979-4b96-a0eb-c60c6d57f649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37ac11ecdf1411a843beab041b60409, user_id=ac696abfab6943cb9efbf7bdd385d010, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:30.146202 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965030e-8979-4b96-a0eb-c60c6d57f649 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:30.279884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1166/2361] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:06:30 2022] PUT /identity/v3/projects/e37ac11ecdf1411a843beab041b60409/users/ac696abfab6943cb9efbf7bdd385d010/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:30.283584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3ca43-697c-496a-9dcb-877355e0d0a5 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:30.294363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3ca43-697c-496a-9dcb-877355e0d0a5 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:30.365512 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31180a-7459-471c-a0da-21219fb2f4cc None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:30.365812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31180a-7459-471c-a0da-21219fb2f4cc None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:30.366100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31180a-7459-471c-a0da-21219fb2f4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:30.380680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:30.382458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3724601-8bef-49aa-a477-7b7feafe899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:30.388403 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724601-8bef-49aa-a477-7b7feafe899b admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:30.388876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724601-8bef-49aa-a477-7b7feafe899b admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:30.389296 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724601-8bef-49aa-a477-7b7feafe899b admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:30.390930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3724601-8bef-49aa-a477-7b7feafe899b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:30.391080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-df31180a-7459-471c-a0da-21219fb2f4cc None None] MFA Rules not processed for user `9e09f6a92f064ec78231fa06782bafda`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:30.391975 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-df31180a-7459-471c-a0da-21219fb2f4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:30.392501 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3724601-8bef-49aa-a477-7b7feafe899b admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:30.407636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1196/2362] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:06:30 2022] GET /identity/v3/roles => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:06:30.408832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3724601-8bef-49aa-a477-7b7feafe899b admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:30.421018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3724601-8bef-49aa-a477-7b7feafe899b admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:30.428271 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eef19-7a10-4c3c-83bd-4d0ac56a774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:30.430005 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eef19-7a10-4c3c-83bd-4d0ac56a774c admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:30.432383 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eef19-7a10-4c3c-83bd-4d0ac56a774c admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:30.432704 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eef19-7a10-4c3c-83bd-4d0ac56a774c admin admin] PATH_INFO: `/v3/projects/e37ac11ecdf1411a843beab041b60409/users/ac696abfab6943cb9efbf7bdd385d010/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:30.435640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eef19-7a10-4c3c-83bd-4d0ac56a774c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37ac11ecdf1411a843beab041b60409, user_id=ac696abfab6943cb9efbf7bdd385d010, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:30.440512 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eef19-7a10-4c3c-83bd-4d0ac56a774c admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:30.458436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1197/2363] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:06:30 2022] PUT /identity/v3/projects/e37ac11ecdf1411a843beab041b60409/users/ac696abfab6943cb9efbf7bdd385d010/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:30.469752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1167/2364] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:06:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:37.231686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b582d-5d43-46f8-939e-06b46ba911ec None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:37.232266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b582d-5d43-46f8-939e-06b46ba911ec None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:37.232266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b582d-5d43-46f8-939e-06b46ba911ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:37.316529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-321b582d-5d43-46f8-939e-06b46ba911ec None None] MFA Rules not processed for user `ac696abfab6943cb9efbf7bdd385d010`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:37.317047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-321b582d-5d43-46f8-939e-06b46ba911ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:37.406980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:37.419053 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1198/2365] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:06:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:37.434899 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31180a-7459-471c-a0da-21219fb2f4cc None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:37.437004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-df31180a-7459-471c-a0da-21219fb2f4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:37.655621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31180a-7459-471c-a0da-21219fb2f4cc None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:37.759977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cac39-42cd-43a3-afbe-dfd09fd37de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:37.760659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cac39-42cd-43a3-afbe-dfd09fd37de8 service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:37.760948 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cac39-42cd-43a3-afbe-dfd09fd37de8 service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:37.761231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cac39-42cd-43a3-afbe-dfd09fd37de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:37.816481 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:37.831890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cac39-42cd-43a3-afbe-dfd09fd37de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:37.834678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cac39-42cd-43a3-afbe-dfd09fd37de8 service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:37.854544 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1168/2366] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:06:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:41.152859 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c625a9-c019-4eee-b79f-28e9d7c56e00 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:41.153395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c625a9-c019-4eee-b79f-28e9d7c56e00 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:41.153395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c625a9-c019-4eee-b79f-28e9d7c56e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:41.176535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-51c625a9-c019-4eee-b79f-28e9d7c56e00 None None] MFA Rules not processed for user `caebb88017f94b25bbbac26be1218bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:41.176535 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-51c625a9-c019-4eee-b79f-28e9d7c56e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:41.181146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1199/2367] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:06:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:48.110482 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=6 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:51.166070 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=6 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:12.787466 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cac39-42cd-43a3-afbe-dfd09fd37de8 service nova] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:12.842994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cac39-42cd-43a3-afbe-dfd09fd37de8 service nova] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:12.846623 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94055e4f-fe26-41c8-a509-fbbccc519ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:12.847270 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94055e4f-fe26-41c8-a509-fbbccc519ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:12.847552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94055e4f-fe26-41c8-a509-fbbccc519ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:12.847830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94055e4f-fe26-41c8-a509-fbbccc519ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:12.849686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-94055e4f-fe26-41c8-a509-fbbccc519ae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:12.860333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94055e4f-fe26-41c8-a509-fbbccc519ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:12.901378 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94055e4f-fe26-41c8-a509-fbbccc519ae9 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:12.901378 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1169/2368] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:07:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:07:22.866307 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=26 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:33.682392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b592f-ca5b-40b1-b591-67d1dfce8434 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:33.683024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b592f-ca5b-40b1-b591-67d1dfce8434 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:33.683024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b592f-ca5b-40b1-b591-67d1dfce8434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:33.700759 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-df3b592f-ca5b-40b1-b591-67d1dfce8434 None None] MFA Rules not processed for user `8207acca876a4af5ac75dd4283916763`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:33.702078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-df3b592f-ca5b-40b1-b591-67d1dfce8434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:33.757891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1200/2369] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:07:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:37.279204 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94055e4f-fe26-41c8-a509-fbbccc519ae9 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:37.280655 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-94055e4f-fe26-41c8-a509-fbbccc519ae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:37.291440 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94055e4f-fe26-41c8-a509-fbbccc519ae9 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:37.295094 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bb1c0-9dac-4d71-b623-a378160a0ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:37.295732 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bb1c0-9dac-4d71-b623-a378160a0ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:37.296014 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bb1c0-9dac-4d71-b623-a378160a0ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:37.296290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bb1c0-9dac-4d71-b623-a378160a0ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:37.305484 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bb1c0-9dac-4d71-b623-a378160a0ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:37.306975 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bb1c0-9dac-4d71-b623-a378160a0ed3 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:37.316758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1170/2370] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:07:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:07:43.750814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=25 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:47.312300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=6 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:52.813891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b592f-ca5b-40b1-b591-67d1dfce8434 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:52.824054 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b592f-ca5b-40b1-b591-67d1dfce8434 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:52.828016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2246c-f28e-470b-bb6f-3ea1adc1e552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:52.828666 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2246c-f28e-470b-bb6f-3ea1adc1e552 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:52.828950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2246c-f28e-470b-bb6f-3ea1adc1e552 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:52.829227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2246c-f28e-470b-bb6f-3ea1adc1e552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:52.831142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d4b2246c-f28e-470b-bb6f-3ea1adc1e552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:52.845738 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2246c-f28e-470b-bb6f-3ea1adc1e552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:52.847126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2246c-f28e-470b-bb6f-3ea1adc1e552 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:52.861353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1201/2371] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:07:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:07:56.833901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bb1c0-9dac-4d71-b623-a378160a0ed3 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:56.842693 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bb1c0-9dac-4d71-b623-a378160a0ed3 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:56.846261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69db55-1ab2-491f-8ee7-1b630d1de472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:56.846942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69db55-1ab2-491f-8ee7-1b630d1de472 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:56.847232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69db55-1ab2-491f-8ee7-1b630d1de472 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:56.847515 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69db55-1ab2-491f-8ee7-1b630d1de472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:56.850557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2f69db55-1ab2-491f-8ee7-1b630d1de472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:56.868180 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69db55-1ab2-491f-8ee7-1b630d1de472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:56.868180 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69db55-1ab2-491f-8ee7-1b630d1de472 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:56.878715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1171/2372] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:07:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:02.854611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=6 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:06.658406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2246c-f28e-470b-bb6f-3ea1adc1e552 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:06.667954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2246c-f28e-470b-bb6f-3ea1adc1e552 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:06.671640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d5159-3494-4cdb-b9db-d9e8fc141978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:06.672273 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d5159-3494-4cdb-b9db-d9e8fc141978 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:06.672561 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d5159-3494-4cdb-b9db-d9e8fc141978 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:06.672839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d5159-3494-4cdb-b9db-d9e8fc141978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:06.674645 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-562d5159-3494-4cdb-b9db-d9e8fc141978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:06.738138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d5159-3494-4cdb-b9db-d9e8fc141978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:06.740259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d5159-3494-4cdb-b9db-d9e8fc141978 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:06.750098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1202/2373] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:06.873658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=6 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:10.531350 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69db55-1ab2-491f-8ee7-1b630d1de472 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:10.532807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2f69db55-1ab2-491f-8ee7-1b630d1de472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:10.547748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69db55-1ab2-491f-8ee7-1b630d1de472 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:10.552919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c867f5-fe68-4c02-8b94-49419b4b9ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:10.553799 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c867f5-fe68-4c02-8b94-49419b4b9ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:10.554084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c867f5-fe68-4c02-8b94-49419b4b9ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:10.554388 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c867f5-fe68-4c02-8b94-49419b4b9ac4 admin admin] PATH_INFO: `/v3/users/a3ccb15b11de4cfea727f0aa453f6e2b` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:10.555572 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c867f5-fe68-4c02-8b94-49419b4b9ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ccb15b11de4cfea727f0aa453f6e2b)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:10.557492 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c867f5-fe68-4c02-8b94-49419b4b9ac4 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:10.743258 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-31c867f5-fe68-4c02-8b94-49419b4b9ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ccb15b11de4cfea727f0aa453f6e2b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:10.743916 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-31c867f5-fe68-4c02-8b94-49419b4b9ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ccb15b11de4cfea727f0aa453f6e2b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:10.744519 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-31c867f5-fe68-4c02-8b94-49419b4b9ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ccb15b11de4cfea727f0aa453f6e2b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:10.803719 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-31c867f5-fe68-4c02-8b94-49419b4b9ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ccb15b11de4cfea727f0aa453f6e2b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:10.816213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-31c867f5-fe68-4c02-8b94-49419b4b9ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ccb15b11de4cfea727f0aa453f6e2b'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:10.829379 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1172/2374] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:08:10 2022] DELETE /identity/v3/users/a3ccb15b11de4cfea727f0aa453f6e2b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:11.086519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d5159-3494-4cdb-b9db-d9e8fc141978 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:11.098119 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d5159-3494-4cdb-b9db-d9e8fc141978 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:11.154602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bb03a-ea4d-4767-b013-0d729c210e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:11.155458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bb03a-ea4d-4767-b013-0d729c210e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:11.155738 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bb03a-ea4d-4767-b013-0d729c210e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:11.156011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bb03a-ea4d-4767-b013-0d729c210e33 admin admin] PATH_INFO: `/v3/projects/d84da619d6f042ed8ccf92259d52e180` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:11.157187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bb03a-ea4d-4767-b013-0d729c210e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84da619d6f042ed8ccf92259d52e180)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:11.159122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bb03a-ea4d-4767-b013-0d729c210e33 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:11.262981 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8d8bb03a-ea4d-4767-b013-0d729c210e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84da619d6f042ed8ccf92259d52e180', 'request_id': 'req-8d8bb03a-ea4d-4767-b013-0d729c210e33'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:11.427731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8d8bb03a-ea4d-4767-b013-0d729c210e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84da619d6f042ed8ccf92259d52e180', 'request_id': 'req-8d8bb03a-ea4d-4767-b013-0d729c210e33'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:11.434618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8d8bb03a-ea4d-4767-b013-0d729c210e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84da619d6f042ed8ccf92259d52e180', 'request_id': 'req-8d8bb03a-ea4d-4767-b013-0d729c210e33'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:11.445596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8d8bb03a-ea4d-4767-b013-0d729c210e33 admin admin] The token cache is being invalidate because project d84da619d6f042ed8ccf92259d52e180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:08:11.445883 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8d8bb03a-ea4d-4767-b013-0d729c210e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:11.446560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8d8bb03a-ea4d-4767-b013-0d729c210e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:11.448126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1203/2375] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:08:11 2022] DELETE /identity/v3/projects/d84da619d6f042ed8ccf92259d52e180 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:11.453520 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebab967-9e02-47e7-bc17-ae9bbf69f892 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:11.453847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebab967-9e02-47e7-bc17-ae9bbf69f892 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:11.454133 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebab967-9e02-47e7-bc17-ae9bbf69f892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:11.473329 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-8ebab967-9e02-47e7-bc17-ae9bbf69f892 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:11.474597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8ebab967-9e02-47e7-bc17-ae9bbf69f892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:11.534972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1173/2376] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:11.543939 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad91925-0720-4a4c-b20c-872a559a873e None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:11.544248 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad91925-0720-4a4c-b20c-872a559a873e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:11.549288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad91925-0720-4a4c-b20c-872a559a873e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:11.564283 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-9ad91925-0720-4a4c-b20c-872a559a873e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:11.565491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-9ad91925-0720-4a4c-b20c-872a559a873e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:11.574634 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1204/2377] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:11.579351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebab967-9e02-47e7-bc17-ae9bbf69f892 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:11.589728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebab967-9e02-47e7-bc17-ae9bbf69f892 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:11.594315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabb5a7-1245-44a0-a6ba-b5c0857385ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:11.595000 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabb5a7-1245-44a0-a6ba-b5c0857385ef admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:11.595339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabb5a7-1245-44a0-a6ba-b5c0857385ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:11.595569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabb5a7-1245-44a0-a6ba-b5c0857385ef admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:11.596294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabb5a7-1245-44a0-a6ba-b5c0857385ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:08:11.596634 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabb5a7-1245-44a0-a6ba-b5c0857385ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:11.598951 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabb5a7-1245-44a0-a6ba-b5c0857385ef admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:11.610906 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1174/2378] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:08:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:08:11.616252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad91925-0720-4a4c-b20c-872a559a873e None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:11.626108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad91925-0720-4a4c-b20c-872a559a873e None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:11.631803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973aff01-eb13-4776-b63b-fedb87b7f6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:11.632465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aff01-eb13-4776-b63b-fedb87b7f6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:11.632775 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aff01-eb13-4776-b63b-fedb87b7f6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:11.633091 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aff01-eb13-4776-b63b-fedb87b7f6c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:11.633785 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973aff01-eb13-4776-b63b-fedb87b7f6c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:11.635737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973aff01-eb13-4776-b63b-fedb87b7f6c3 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:11.652029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:11.792751 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1205/2379] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:08:11 2022] POST /identity/v3/projects => generated 406 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:08:11.797008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabb5a7-1245-44a0-a6ba-b5c0857385ef admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:11.808294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabb5a7-1245-44a0-a6ba-b5c0857385ef admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:11.867043 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ef6d5-cbbe-4bc0-b1f2-6d3e7c405079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:11.867668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ef6d5-cbbe-4bc0-b1f2-6d3e7c405079 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:11.867959 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ef6d5-cbbe-4bc0-b1f2-6d3e7c405079 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:11.868247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ef6d5-cbbe-4bc0-b1f2-6d3e7c405079 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:11.868934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ef6d5-cbbe-4bc0-b1f2-6d3e7c405079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:11.870909 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ef6d5-cbbe-4bc0-b1f2-6d3e7c405079 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:11.877794 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:12.027377 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1175/2380] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:08:11 2022] POST /identity/v3/users => generated 304 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:08:12.032461 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973aff01-eb13-4776-b63b-fedb87b7f6c3 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:12.043437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973aff01-eb13-4776-b63b-fedb87b7f6c3 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:12.048281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af0812-54ee-47b2-80ed-57e12932b9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:12.048939 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af0812-54ee-47b2-80ed-57e12932b9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:12.049225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af0812-54ee-47b2-80ed-57e12932b9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:12.049509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af0812-54ee-47b2-80ed-57e12932b9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:12.050230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af0812-54ee-47b2-80ed-57e12932b9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:12.052457 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af0812-54ee-47b2-80ed-57e12932b9b4 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:12.063176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1206/2381] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:12 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:12.067087 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ef6d5-cbbe-4bc0-b1f2-6d3e7c405079 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:12.077501 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ef6d5-cbbe-4bc0-b1f2-6d3e7c405079 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:12.082270 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0165455-8d43-4343-bebc-8da92a640f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:12.082962 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0165455-8d43-4343-bebc-8da92a640f16 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:12.083250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0165455-8d43-4343-bebc-8da92a640f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:12.083535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0165455-8d43-4343-bebc-8da92a640f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:12.084266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0165455-8d43-4343-bebc-8da92a640f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:12.085923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0165455-8d43-4343-bebc-8da92a640f16 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:12.097146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1176/2382] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:12 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:12.101774 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af0812-54ee-47b2-80ed-57e12932b9b4 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:12.112377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af0812-54ee-47b2-80ed-57e12932b9b4 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:12.117723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bac212-1e87-4c73-bcdd-1b8381399a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:12.118579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bac212-1e87-4c73-bcdd-1b8381399a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:12.118861 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bac212-1e87-4c73-bcdd-1b8381399a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:12.119142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bac212-1e87-4c73-bcdd-1b8381399a41 admin admin] PATH_INFO: `/v3/projects/324572f6613c4da58df792b54fb039a2/users/6d5beee2d9ce456b871f7f1cff532f8d/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:12.133987 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bac212-1e87-4c73-bcdd-1b8381399a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=324572f6613c4da58df792b54fb039a2, user_id=6d5beee2d9ce456b871f7f1cff532f8d, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:12.136837 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bac212-1e87-4c73-bcdd-1b8381399a41 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:12.249304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1207/2383] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:12 2022] PUT /identity/v3/projects/324572f6613c4da58df792b54fb039a2/users/6d5beee2d9ce456b871f7f1cff532f8d/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:08:12.254919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bd2ab-685b-4025-80eb-31e313aefc49 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:12.255213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bd2ab-685b-4025-80eb-31e313aefc49 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:12.255497 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bd2ab-685b-4025-80eb-31e313aefc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:12.274538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-fc3bd2ab-685b-4025-80eb-31e313aefc49 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:12.275748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-fc3bd2ab-685b-4025-80eb-31e313aefc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:12.337770 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1177/2384] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:12.348056 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bac212-1e87-4c73-bcdd-1b8381399a41 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:12.349856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d4bac212-1e87-4c73-bcdd-1b8381399a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:12.406791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bac212-1e87-4c73-bcdd-1b8381399a41 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:12.411023 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce7d55-4976-4423-b341-1e3979cecdb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:12.411680 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce7d55-4976-4423-b341-1e3979cecdb0 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:12.411965 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce7d55-4976-4423-b341-1e3979cecdb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:12.412288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce7d55-4976-4423-b341-1e3979cecdb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:12.423757 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce7d55-4976-4423-b341-1e3979cecdb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:12.425695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce7d55-4976-4423-b341-1e3979cecdb0 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:12.435394 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1208/2385] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:08:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:08:13.747506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219faf04-2ec3-45a3-8bd2-9ff681463787 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:13.748050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219faf04-2ec3-45a3-8bd2-9ff681463787 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:13.748408 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219faf04-2ec3-45a3-8bd2-9ff681463787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:13.777381 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-219faf04-2ec3-45a3-8bd2-9ff681463787 None None] MFA Rules not processed for user `6d5beee2d9ce456b871f7f1cff532f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:13.778626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-219faf04-2ec3-45a3-8bd2-9ff681463787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:13.851286 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1178/2386] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:13 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:13.855754 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce7d55-4976-4423-b341-1e3979cecdb0 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:13.866803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce7d55-4976-4423-b341-1e3979cecdb0 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:13.871367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507cb64-18ac-4b4d-991b-8045bcec283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:13.872019 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507cb64-18ac-4b4d-991b-8045bcec283d admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:13.872306 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507cb64-18ac-4b4d-991b-8045bcec283d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:13.872588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507cb64-18ac-4b4d-991b-8045bcec283d admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:13.873283 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507cb64-18ac-4b4d-991b-8045bcec283d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:13.875256 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507cb64-18ac-4b4d-991b-8045bcec283d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:14.005635 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1209/2387] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:08:13 2022] POST /identity/v3/projects => generated 406 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:08:14.009594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219faf04-2ec3-45a3-8bd2-9ff681463787 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:14.025190 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219faf04-2ec3-45a3-8bd2-9ff681463787 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:14.084565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d94ac-b176-4c6f-af21-2957a406f1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:14.085245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d94ac-b176-4c6f-af21-2957a406f1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:14.085536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d94ac-b176-4c6f-af21-2957a406f1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:14.085823 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d94ac-b176-4c6f-af21-2957a406f1e2 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:14.086565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d94ac-b176-4c6f-af21-2957a406f1e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:14.088497 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d94ac-b176-4c6f-af21-2957a406f1e2 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:14.187583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:14.193808 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1179/2388] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:08:14 2022] POST /identity/v3/users => generated 310 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:08:14.198600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507cb64-18ac-4b4d-991b-8045bcec283d admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:14.210287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507cb64-18ac-4b4d-991b-8045bcec283d admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:14.215559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446ff96-0d84-4cc7-bc3d-3db8e9b9793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:14.216224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446ff96-0d84-4cc7-bc3d-3db8e9b9793f admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:14.216504 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446ff96-0d84-4cc7-bc3d-3db8e9b9793f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:14.216777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446ff96-0d84-4cc7-bc3d-3db8e9b9793f admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:14.217495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446ff96-0d84-4cc7-bc3d-3db8e9b9793f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:14.219188 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446ff96-0d84-4cc7-bc3d-3db8e9b9793f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:14.231575 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1210/2389] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:14 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:14.235772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d94ac-b176-4c6f-af21-2957a406f1e2 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:14.246275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d94ac-b176-4c6f-af21-2957a406f1e2 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:14.251565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a86648-46fd-49d7-9747-80410d23dadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:14.252471 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a86648-46fd-49d7-9747-80410d23dadd admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:14.252757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a86648-46fd-49d7-9747-80410d23dadd admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:14.253034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a86648-46fd-49d7-9747-80410d23dadd admin admin] PATH_INFO: `/v3/projects/0c47b2c3645b44aaa7135f5dd3184862/users/35b5a7f245484fd6a3b00dc8d91a0fc3/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:14.268638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a86648-46fd-49d7-9747-80410d23dadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c47b2c3645b44aaa7135f5dd3184862, user_id=35b5a7f245484fd6a3b00dc8d91a0fc3, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:14.271402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a86648-46fd-49d7-9747-80410d23dadd admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:14.404138 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1180/2390] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:14 2022] PUT /identity/v3/projects/0c47b2c3645b44aaa7135f5dd3184862/users/35b5a7f245484fd6a3b00dc8d91a0fc3/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:14.408155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446ff96-0d84-4cc7-bc3d-3db8e9b9793f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:14.419385 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446ff96-0d84-4cc7-bc3d-3db8e9b9793f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:14.476919 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc7f47-47ed-485a-9221-0a65778eeeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:14.477584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc7f47-47ed-485a-9221-0a65778eeeaf admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:14.477866 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc7f47-47ed-485a-9221-0a65778eeeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:14.478137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc7f47-47ed-485a-9221-0a65778eeeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:14.478885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc7f47-47ed-485a-9221-0a65778eeeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:14.480474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc7f47-47ed-485a-9221-0a65778eeeaf admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:14.490215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1211/2391] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:14 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:14.494413 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a86648-46fd-49d7-9747-80410d23dadd admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:14.504669 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a86648-46fd-49d7-9747-80410d23dadd admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:14.509300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1eb404-42ca-4277-9173-d47fff5aed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:14.510181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1eb404-42ca-4277-9173-d47fff5aed00 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:14.510513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1eb404-42ca-4277-9173-d47fff5aed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:14.510795 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1eb404-42ca-4277-9173-d47fff5aed00 admin admin] PATH_INFO: `/v3/projects/0c47b2c3645b44aaa7135f5dd3184862/users/35b5a7f245484fd6a3b00dc8d91a0fc3/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:14.512761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1eb404-42ca-4277-9173-d47fff5aed00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c47b2c3645b44aaa7135f5dd3184862, user_id=35b5a7f245484fd6a3b00dc8d91a0fc3, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:14.515443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1eb404-42ca-4277-9173-d47fff5aed00 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:14.526188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1181/2392] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:14 2022] PUT /identity/v3/projects/0c47b2c3645b44aaa7135f5dd3184862/users/35b5a7f245484fd6a3b00dc8d91a0fc3/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:15.759197 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66463c-be53-4b27-9f24-90790aa46f8b None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:15.759779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66463c-be53-4b27-9f24-90790aa46f8b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:15.759779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66463c-be53-4b27-9f24-90790aa46f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:15.792807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-0e66463c-be53-4b27-9f24-90790aa46f8b None None] MFA Rules not processed for user `35b5a7f245484fd6a3b00dc8d91a0fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:15.794024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0e66463c-be53-4b27-9f24-90790aa46f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:15.809214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:15.867703 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1212/2393] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:15 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:17.414467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1eb404-42ca-4277-9173-d47fff5aed00 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:17.484018 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1eb404-42ca-4277-9173-d47fff5aed00 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:17.489324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8bd33-f62b-4977-bc7a-0aac43bdf46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:17.490206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8bd33-f62b-4977-bc7a-0aac43bdf46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:17.490521 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8bd33-f62b-4977-bc7a-0aac43bdf46e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:17.490805 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8bd33-f62b-4977-bc7a-0aac43bdf46e admin admin] PATH_INFO: `/v3/users/6d5beee2d9ce456b871f7f1cff532f8d` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:17.492008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8bd33-f62b-4977-bc7a-0aac43bdf46e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d5beee2d9ce456b871f7f1cff532f8d)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:17.493969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8bd33-f62b-4977-bc7a-0aac43bdf46e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:17.651367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-6dc8bd33-f62b-4977-bc7a-0aac43bdf46e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d5beee2d9ce456b871f7f1cff532f8d'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:17.652041 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-6dc8bd33-f62b-4977-bc7a-0aac43bdf46e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d5beee2d9ce456b871f7f1cff532f8d'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:17.652652 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-6dc8bd33-f62b-4977-bc7a-0aac43bdf46e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d5beee2d9ce456b871f7f1cff532f8d'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:17.722011 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-6dc8bd33-f62b-4977-bc7a-0aac43bdf46e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d5beee2d9ce456b871f7f1cff532f8d'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:17.736950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-6dc8bd33-f62b-4977-bc7a-0aac43bdf46e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d5beee2d9ce456b871f7f1cff532f8d'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:17.750801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1182/2394] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:08:17 2022] DELETE /identity/v3/users/6d5beee2d9ce456b871f7f1cff532f8d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:18.028776 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66463c-be53-4b27-9f24-90790aa46f8b None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:18.040814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66463c-be53-4b27-9f24-90790aa46f8b None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:18.101012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936384a1-c02f-49d4-bbfc-cc6ad193122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:18.101927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936384a1-c02f-49d4-bbfc-cc6ad193122d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:18.102215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936384a1-c02f-49d4-bbfc-cc6ad193122d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:18.102538 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936384a1-c02f-49d4-bbfc-cc6ad193122d admin admin] PATH_INFO: `/v3/projects/324572f6613c4da58df792b54fb039a2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:18.103761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936384a1-c02f-49d4-bbfc-cc6ad193122d admin admin] RBAC: Authorizing `identity:delete_project(project_id=324572f6613c4da58df792b54fb039a2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:18.105698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936384a1-c02f-49d4-bbfc-cc6ad193122d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:18.215532 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-936384a1-c02f-49d4-bbfc-cc6ad193122d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '324572f6613c4da58df792b54fb039a2', 'request_id': 'req-936384a1-c02f-49d4-bbfc-cc6ad193122d'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:18.289515 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-936384a1-c02f-49d4-bbfc-cc6ad193122d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '324572f6613c4da58df792b54fb039a2', 'request_id': 'req-936384a1-c02f-49d4-bbfc-cc6ad193122d'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:18.297402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-936384a1-c02f-49d4-bbfc-cc6ad193122d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '324572f6613c4da58df792b54fb039a2', 'request_id': 'req-936384a1-c02f-49d4-bbfc-cc6ad193122d'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:18.309676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-936384a1-c02f-49d4-bbfc-cc6ad193122d admin admin] The token cache is being invalidate because project 324572f6613c4da58df792b54fb039a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:08:18.310040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-936384a1-c02f-49d4-bbfc-cc6ad193122d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:18.310796 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-936384a1-c02f-49d4-bbfc-cc6ad193122d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:18.312525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1213/2395] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:08:18 2022] DELETE /identity/v3/projects/324572f6613c4da58df792b54fb039a2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:18.321271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8bd33-f62b-4977-bc7a-0aac43bdf46e admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:18.321271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-6dc8bd33-f62b-4977-bc7a-0aac43bdf46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:18.333037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8bd33-f62b-4977-bc7a-0aac43bdf46e admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:18.376631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:18.396291 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d29dc-a4dc-4498-8f06-91ed7499eb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:18.397538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d29dc-a4dc-4498-8f06-91ed7499eb58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:18.397832 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d29dc-a4dc-4498-8f06-91ed7499eb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:18.398107 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d29dc-a4dc-4498-8f06-91ed7499eb58 admin admin] PATH_INFO: `/v3/users/35b5a7f245484fd6a3b00dc8d91a0fc3` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:18.399365 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d29dc-a4dc-4498-8f06-91ed7499eb58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b5a7f245484fd6a3b00dc8d91a0fc3)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:18.401304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d29dc-a4dc-4498-8f06-91ed7499eb58 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:18.576030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4f0d29dc-a4dc-4498-8f06-91ed7499eb58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b5a7f245484fd6a3b00dc8d91a0fc3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:18.576783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4f0d29dc-a4dc-4498-8f06-91ed7499eb58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b5a7f245484fd6a3b00dc8d91a0fc3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:18.577559 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4f0d29dc-a4dc-4498-8f06-91ed7499eb58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b5a7f245484fd6a3b00dc8d91a0fc3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:18.632152 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4f0d29dc-a4dc-4498-8f06-91ed7499eb58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b5a7f245484fd6a3b00dc8d91a0fc3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:18.645784 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4f0d29dc-a4dc-4498-8f06-91ed7499eb58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b5a7f245484fd6a3b00dc8d91a0fc3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:18.659386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1183/2396] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:08:18 2022] DELETE /identity/v3/users/35b5a7f245484fd6a3b00dc8d91a0fc3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:08:18.947256 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936384a1-c02f-49d4-bbfc-cc6ad193122d admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:18.948895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-936384a1-c02f-49d4-bbfc-cc6ad193122d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:18.965571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936384a1-c02f-49d4-bbfc-cc6ad193122d admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:19.009269 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:19.025583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37c7ec-211a-4984-b094-90e9b30a6450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:19.028275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37c7ec-211a-4984-b094-90e9b30a6450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:19.028275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37c7ec-211a-4984-b094-90e9b30a6450 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:19.028275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37c7ec-211a-4984-b094-90e9b30a6450 admin admin] PATH_INFO: `/v3/projects/0c47b2c3645b44aaa7135f5dd3184862` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:19.028275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37c7ec-211a-4984-b094-90e9b30a6450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c47b2c3645b44aaa7135f5dd3184862)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:19.030137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37c7ec-211a-4984-b094-90e9b30a6450 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:19.165115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8a37c7ec-211a-4984-b094-90e9b30a6450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c47b2c3645b44aaa7135f5dd3184862', 'request_id': 'req-8a37c7ec-211a-4984-b094-90e9b30a6450'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:19.264740 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8a37c7ec-211a-4984-b094-90e9b30a6450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c47b2c3645b44aaa7135f5dd3184862', 'request_id': 'req-8a37c7ec-211a-4984-b094-90e9b30a6450'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:19.271821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8a37c7ec-211a-4984-b094-90e9b30a6450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c47b2c3645b44aaa7135f5dd3184862', 'request_id': 'req-8a37c7ec-211a-4984-b094-90e9b30a6450'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:19.282292 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8a37c7ec-211a-4984-b094-90e9b30a6450 admin admin] The token cache is being invalidate because project 0c47b2c3645b44aaa7135f5dd3184862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:08:19.282614 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8a37c7ec-211a-4984-b094-90e9b30a6450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:19.283259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8a37c7ec-211a-4984-b094-90e9b30a6450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:19.284959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1214/2397] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:08:18 2022] DELETE /identity/v3/projects/0c47b2c3645b44aaa7135f5dd3184862 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:19.290053 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d4a9d-cc52-4897-8e63-3421dd62e2aa None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:19.292123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d4a9d-cc52-4897-8e63-3421dd62e2aa None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:19.292123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d4a9d-cc52-4897-8e63-3421dd62e2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:19.309547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-4d8d4a9d-cc52-4897-8e63-3421dd62e2aa None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:19.310900 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4d8d4a9d-cc52-4897-8e63-3421dd62e2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:19.372232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1184/2398] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:19.381722 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3130e6-aa06-498e-8d27-1cac38eb85e7 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:19.382017 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3130e6-aa06-498e-8d27-1cac38eb85e7 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:19.382303 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3130e6-aa06-498e-8d27-1cac38eb85e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:19.400949 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-ee3130e6-aa06-498e-8d27-1cac38eb85e7 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:19.402156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ee3130e6-aa06-498e-8d27-1cac38eb85e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:19.410774 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1215/2399] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:19.415154 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d4a9d-cc52-4897-8e63-3421dd62e2aa None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:19.425688 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d4a9d-cc52-4897-8e63-3421dd62e2aa None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:19.430240 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b594d7-21a0-46b3-8cc2-389516180284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:19.430931 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b594d7-21a0-46b3-8cc2-389516180284 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:19.431217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b594d7-21a0-46b3-8cc2-389516180284 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:19.431495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b594d7-21a0-46b3-8cc2-389516180284 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:19.432332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b594d7-21a0-46b3-8cc2-389516180284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:08:19.432645 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b594d7-21a0-46b3-8cc2-389516180284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:19.434245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b594d7-21a0-46b3-8cc2-389516180284 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:19.446414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1185/2400] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:08:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:08:19.450744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3130e6-aa06-498e-8d27-1cac38eb85e7 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:19.460757 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3130e6-aa06-498e-8d27-1cac38eb85e7 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:19.465422 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484ba57-a5e3-430a-b709-726aa12e0052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:19.466076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484ba57-a5e3-430a-b709-726aa12e0052 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:19.466391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484ba57-a5e3-430a-b709-726aa12e0052 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:19.466673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484ba57-a5e3-430a-b709-726aa12e0052 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:19.467366 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484ba57-a5e3-430a-b709-726aa12e0052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:19.469266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484ba57-a5e3-430a-b709-726aa12e0052 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:19.555115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1216/2401] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:08:19 2022] POST /identity/v3/projects => generated 374 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:08:19.559445 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b594d7-21a0-46b3-8cc2-389516180284 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:19.569660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b594d7-21a0-46b3-8cc2-389516180284 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:19.613353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:19.625675 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef8034-4bb3-41ad-a0de-23b6855d75ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:19.626426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef8034-4bb3-41ad-a0de-23b6855d75ad admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:19.629647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef8034-4bb3-41ad-a0de-23b6855d75ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:19.629647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef8034-4bb3-41ad-a0de-23b6855d75ad admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:19.629647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef8034-4bb3-41ad-a0de-23b6855d75ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:19.629968 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef8034-4bb3-41ad-a0de-23b6855d75ad admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:19.729911 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1186/2402] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:08:19 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:08:19.734285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484ba57-a5e3-430a-b709-726aa12e0052 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:19.745539 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484ba57-a5e3-430a-b709-726aa12e0052 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:19.750250 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78929926-c30d-4f98-a922-c63f4da549c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:19.750943 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78929926-c30d-4f98-a922-c63f4da549c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:19.751230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78929926-c30d-4f98-a922-c63f4da549c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:19.751508 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78929926-c30d-4f98-a922-c63f4da549c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:19.752227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78929926-c30d-4f98-a922-c63f4da549c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:19.754262 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78929926-c30d-4f98-a922-c63f4da549c2 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:19.764792 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1217/2403] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:19 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:19.769369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef8034-4bb3-41ad-a0de-23b6855d75ad admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:19.779350 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef8034-4bb3-41ad-a0de-23b6855d75ad admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:19.783965 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a540a8-82e8-43c6-8cd4-316168f8241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:19.785258 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a540a8-82e8-43c6-8cd4-316168f8241f admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:19.785544 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a540a8-82e8-43c6-8cd4-316168f8241f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:19.785821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a540a8-82e8-43c6-8cd4-316168f8241f admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:19.786597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a540a8-82e8-43c6-8cd4-316168f8241f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:19.788201 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a540a8-82e8-43c6-8cd4-316168f8241f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:19.798738 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1187/2404] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:19 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:19.809688 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78929926-c30d-4f98-a922-c63f4da549c2 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:19.820492 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78929926-c30d-4f98-a922-c63f4da549c2 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:19.825509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a1b20-a99f-44e7-8e66-49e8009795ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:19.826486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a1b20-a99f-44e7-8e66-49e8009795ac admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:19.826810 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a1b20-a99f-44e7-8e66-49e8009795ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:19.827382 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a1b20-a99f-44e7-8e66-49e8009795ac admin admin] PATH_INFO: `/v3/projects/4d0d520340684c5a98d3755daf642c12/users/a7a26379554a482e94b45061cf65d4d2/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:19.843558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a1b20-a99f-44e7-8e66-49e8009795ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0d520340684c5a98d3755daf642c12, user_id=a7a26379554a482e94b45061cf65d4d2, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:19.846371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a1b20-a99f-44e7-8e66-49e8009795ac admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:19.935260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1218/2405] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:19 2022] PUT /identity/v3/projects/4d0d520340684c5a98d3755daf642c12/users/a7a26379554a482e94b45061cf65d4d2/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:19.945506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e54350-9ee0-4014-a855-835f5dfc6a48 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:19.945794 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e54350-9ee0-4014-a855-835f5dfc6a48 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:19.946069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e54350-9ee0-4014-a855-835f5dfc6a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:19.975376 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-a7e54350-9ee0-4014-a855-835f5dfc6a48 None None] MFA Rules not processed for user `a7a26379554a482e94b45061cf65d4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:19.977929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a7e54350-9ee0-4014-a855-835f5dfc6a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:20.043817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1188/2406] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:20.048367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a1b20-a99f-44e7-8e66-49e8009795ac admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:20.112965 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a1b20-a99f-44e7-8e66-49e8009795ac admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:20.117994 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebe17c-1ebe-4715-bcb0-ab32b604fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:20.118739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebe17c-1ebe-4715-bcb0-ab32b604fbf0 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:20.119069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebe17c-1ebe-4715-bcb0-ab32b604fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:20.119485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebe17c-1ebe-4715-bcb0-ab32b604fbf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:20.120269 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebe17c-1ebe-4715-bcb0-ab32b604fbf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:20.122264 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebe17c-1ebe-4715-bcb0-ab32b604fbf0 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:20.136758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:20.215107 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1219/2407] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:08:20 2022] POST /identity/v3/projects => generated 374 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:08:20.216255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e54350-9ee0-4014-a855-835f5dfc6a48 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:20.227171 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e54350-9ee0-4014-a855-835f5dfc6a48 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:20.283787 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa941d-95e2-47b6-ac68-35c5639ecbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:20.284517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa941d-95e2-47b6-ac68-35c5639ecbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:20.284811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa941d-95e2-47b6-ac68-35c5639ecbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:20.285093 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa941d-95e2-47b6-ac68-35c5639ecbb8 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:20.285800 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa941d-95e2-47b6-ac68-35c5639ecbb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:20.287772 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa941d-95e2-47b6-ac68-35c5639ecbb8 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:20.387083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1189/2408] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:08:20 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:08:20.391024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebe17c-1ebe-4715-bcb0-ab32b604fbf0 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:20.402011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebe17c-1ebe-4715-bcb0-ab32b604fbf0 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:20.406737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e712ae-7efc-413f-bd24-cdc4fd847f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:20.407393 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e712ae-7efc-413f-bd24-cdc4fd847f01 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:20.407680 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e712ae-7efc-413f-bd24-cdc4fd847f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:20.407965 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e712ae-7efc-413f-bd24-cdc4fd847f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:20.408665 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e712ae-7efc-413f-bd24-cdc4fd847f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:20.410256 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e712ae-7efc-413f-bd24-cdc4fd847f01 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:20.420979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1220/2409] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:20 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:20.425227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa941d-95e2-47b6-ac68-35c5639ecbb8 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:20.435908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa941d-95e2-47b6-ac68-35c5639ecbb8 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:20.441275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1bc42-9913-4262-8312-897f158be2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:20.442342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1bc42-9913-4262-8312-897f158be2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:20.442633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1bc42-9913-4262-8312-897f158be2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:20.442915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1bc42-9913-4262-8312-897f158be2fd admin admin] PATH_INFO: `/v3/projects/0964379af9be407ea2a785223f145120/users/bea7cb86ac10490bb6d0e45435fc2125/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:20.459052 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1bc42-9913-4262-8312-897f158be2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0964379af9be407ea2a785223f145120, user_id=bea7cb86ac10490bb6d0e45435fc2125, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:20.461886 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1bc42-9913-4262-8312-897f158be2fd admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:20.541904 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1190/2410] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:20 2022] PUT /identity/v3/projects/0964379af9be407ea2a785223f145120/users/bea7cb86ac10490bb6d0e45435fc2125/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:20.545887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e712ae-7efc-413f-bd24-cdc4fd847f01 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:20.557251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e712ae-7efc-413f-bd24-cdc4fd847f01 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:20.614225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6c04f-a366-4908-9433-ebd689306415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:20.614924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6c04f-a366-4908-9433-ebd689306415 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:20.615194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6c04f-a366-4908-9433-ebd689306415 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:20.615468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6c04f-a366-4908-9433-ebd689306415 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:20.616188 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6c04f-a366-4908-9433-ebd689306415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:20.617776 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6c04f-a366-4908-9433-ebd689306415 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:20.627611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1221/2411] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:20 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:20.632507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1bc42-9913-4262-8312-897f158be2fd admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:20.642826 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1bc42-9913-4262-8312-897f158be2fd admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:20.648009 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a0950-fa15-4a1b-8f71-b79d613daf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:20.648891 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a0950-fa15-4a1b-8f71-b79d613daf75 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:20.649284 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a0950-fa15-4a1b-8f71-b79d613daf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:20.649571 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a0950-fa15-4a1b-8f71-b79d613daf75 admin admin] PATH_INFO: `/v3/projects/0964379af9be407ea2a785223f145120/users/bea7cb86ac10490bb6d0e45435fc2125/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:20.651616 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a0950-fa15-4a1b-8f71-b79d613daf75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0964379af9be407ea2a785223f145120, user_id=bea7cb86ac10490bb6d0e45435fc2125, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:20.654273 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a0950-fa15-4a1b-8f71-b79d613daf75 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:20.664750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1191/2412] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:20 2022] PUT /identity/v3/projects/0964379af9be407ea2a785223f145120/users/bea7cb86ac10490bb6d0e45435fc2125/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:20.674935 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12d8d6-69e2-4d59-8d14-05459d865e72 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:20.675713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12d8d6-69e2-4d59-8d14-05459d865e72 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:20.676224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12d8d6-69e2-4d59-8d14-05459d865e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:20.705414 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-1e12d8d6-69e2-4d59-8d14-05459d865e72 None None] MFA Rules not processed for user `bea7cb86ac10490bb6d0e45435fc2125`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:20.707137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1e12d8d6-69e2-4d59-8d14-05459d865e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:20.779300 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1222/2413] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:20.792016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a0950-fa15-4a1b-8f71-b79d613daf75 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:20.793681 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b47a0950-fa15-4a1b-8f71-b79d613daf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:20.804249 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:20.856241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a0950-fa15-4a1b-8f71-b79d613daf75 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:20.860014 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42070735-1d6c-4f15-893e-4ea41a9557d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:20.860664 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42070735-1d6c-4f15-893e-4ea41a9557d3 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:20.860950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42070735-1d6c-4f15-893e-4ea41a9557d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:20.861229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42070735-1d6c-4f15-893e-4ea41a9557d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:20.871755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42070735-1d6c-4f15-893e-4ea41a9557d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:20.873120 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42070735-1d6c-4f15-893e-4ea41a9557d3 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:20.883271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1192/2414] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:08:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:22.071091 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12d8d6-69e2-4d59-8d14-05459d865e72 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:22.135311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12d8d6-69e2-4d59-8d14-05459d865e72 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:22.140062 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca554086-6f86-477f-8be3-ddf873adba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:22.140940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca554086-6f86-477f-8be3-ddf873adba7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:22.141228 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca554086-6f86-477f-8be3-ddf873adba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:22.141508 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca554086-6f86-477f-8be3-ddf873adba7b admin admin] PATH_INFO: `/v3/users/a7a26379554a482e94b45061cf65d4d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:22.142724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca554086-6f86-477f-8be3-ddf873adba7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a26379554a482e94b45061cf65d4d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:22.144883 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca554086-6f86-477f-8be3-ddf873adba7b admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:22.149726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:22.353792 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ca554086-6f86-477f-8be3-ddf873adba7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a26379554a482e94b45061cf65d4d2'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:22.354466 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ca554086-6f86-477f-8be3-ddf873adba7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a26379554a482e94b45061cf65d4d2'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:22.367957 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ca554086-6f86-477f-8be3-ddf873adba7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a26379554a482e94b45061cf65d4d2'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:22.432116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ca554086-6f86-477f-8be3-ddf873adba7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a26379554a482e94b45061cf65d4d2'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:22.440028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-ca554086-6f86-477f-8be3-ddf873adba7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a26379554a482e94b45061cf65d4d2'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:22.446432 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1223/2415] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:08:22 2022] DELETE /identity/v3/users/a7a26379554a482e94b45061cf65d4d2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:22.451020 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825f975-2b08-4d3a-b8c0-b1aa42da2241 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:22.451488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825f975-2b08-4d3a-b8c0-b1aa42da2241 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:22.451612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825f975-2b08-4d3a-b8c0-b1aa42da2241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:22.468762 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-9825f975-2b08-4d3a-b8c0-b1aa42da2241 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:22.469945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9825f975-2b08-4d3a-b8c0-b1aa42da2241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:22.531374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1193/2416] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:22.542166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca554086-6f86-477f-8be3-ddf873adba7b admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:22.543632 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ca554086-6f86-477f-8be3-ddf873adba7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:22.601934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca554086-6f86-477f-8be3-ddf873adba7b admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:22.605454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2abdae-3549-40c6-a858-3fb348328432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:22.606098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2abdae-3549-40c6-a858-3fb348328432 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:22.606407 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2abdae-3549-40c6-a858-3fb348328432 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:22.606685 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2abdae-3549-40c6-a858-3fb348328432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:22.616235 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2abdae-3549-40c6-a858-3fb348328432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:22.617649 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2abdae-3549-40c6-a858-3fb348328432 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:22.627012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1224/2417] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:23.039047 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825f975-2b08-4d3a-b8c0-b1aa42da2241 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:23.040546 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9825f975-2b08-4d3a-b8c0-b1aa42da2241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:23.056317 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825f975-2b08-4d3a-b8c0-b1aa42da2241 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:23.057982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0602d6-9765-42fe-8344-bd13e630d0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:23.059008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0602d6-9765-42fe-8344-bd13e630d0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:23.059305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0602d6-9765-42fe-8344-bd13e630d0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:23.059587 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0602d6-9765-42fe-8344-bd13e630d0c2 admin admin] PATH_INFO: `/v3/projects/4d0d520340684c5a98d3755daf642c12` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:23.060822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0602d6-9765-42fe-8344-bd13e630d0c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0d520340684c5a98d3755daf642c12)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:23.063095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0602d6-9765-42fe-8344-bd13e630d0c2 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:23.177263 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9d0602d6-9765-42fe-8344-bd13e630d0c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0d520340684c5a98d3755daf642c12', 'request_id': 'req-9d0602d6-9765-42fe-8344-bd13e630d0c2'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:23.258816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9d0602d6-9765-42fe-8344-bd13e630d0c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0d520340684c5a98d3755daf642c12', 'request_id': 'req-9d0602d6-9765-42fe-8344-bd13e630d0c2'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:23.266069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9d0602d6-9765-42fe-8344-bd13e630d0c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0d520340684c5a98d3755daf642c12', 'request_id': 'req-9d0602d6-9765-42fe-8344-bd13e630d0c2'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:23.277981 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9d0602d6-9765-42fe-8344-bd13e630d0c2 admin admin] The token cache is being invalidate because project 4d0d520340684c5a98d3755daf642c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:08:23.278312 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9d0602d6-9765-42fe-8344-bd13e630d0c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:23.279012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9d0602d6-9765-42fe-8344-bd13e630d0c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:23.280728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1194/2418] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:08:23 2022] DELETE /identity/v3/projects/4d0d520340684c5a98d3755daf642c12 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:23.290570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2abdae-3549-40c6-a858-3fb348328432 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:23.300784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2abdae-3549-40c6-a858-3fb348328432 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:23.358260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286c028-b49c-44c6-9cb5-9fea05ae69cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:23.359153 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286c028-b49c-44c6-9cb5-9fea05ae69cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:23.359431 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286c028-b49c-44c6-9cb5-9fea05ae69cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:23.359704 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286c028-b49c-44c6-9cb5-9fea05ae69cb admin admin] PATH_INFO: `/v3/users/bea7cb86ac10490bb6d0e45435fc2125` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:23.360870 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286c028-b49c-44c6-9cb5-9fea05ae69cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea7cb86ac10490bb6d0e45435fc2125)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:23.363173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286c028-b49c-44c6-9cb5-9fea05ae69cb admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:23.457941 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:23.583922 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-2286c028-b49c-44c6-9cb5-9fea05ae69cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea7cb86ac10490bb6d0e45435fc2125'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:23.584596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-2286c028-b49c-44c6-9cb5-9fea05ae69cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea7cb86ac10490bb6d0e45435fc2125'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:23.596779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-2286c028-b49c-44c6-9cb5-9fea05ae69cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea7cb86ac10490bb6d0e45435fc2125'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:23.666141 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-2286c028-b49c-44c6-9cb5-9fea05ae69cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea7cb86ac10490bb6d0e45435fc2125'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:23.673845 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-2286c028-b49c-44c6-9cb5-9fea05ae69cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea7cb86ac10490bb6d0e45435fc2125'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:23.680883 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1225/2419] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:08:23 2022] DELETE /identity/v3/users/bea7cb86ac10490bb6d0e45435fc2125 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:08:24.141815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0602d6-9765-42fe-8344-bd13e630d0c2 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:24.143335 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9d0602d6-9765-42fe-8344-bd13e630d0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:24.158406 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0602d6-9765-42fe-8344-bd13e630d0c2 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:24.190113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:24.218581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb7d8e-2d65-4d1e-841b-16debe73c480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:24.219455 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb7d8e-2d65-4d1e-841b-16debe73c480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:24.219739 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb7d8e-2d65-4d1e-841b-16debe73c480 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:24.220014 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb7d8e-2d65-4d1e-841b-16debe73c480 admin admin] PATH_INFO: `/v3/projects/0964379af9be407ea2a785223f145120` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:24.221197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb7d8e-2d65-4d1e-841b-16debe73c480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0964379af9be407ea2a785223f145120)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:24.223256 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb7d8e-2d65-4d1e-841b-16debe73c480 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:24.389555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2dbb7d8e-2d65-4d1e-841b-16debe73c480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0964379af9be407ea2a785223f145120', 'request_id': 'req-2dbb7d8e-2d65-4d1e-841b-16debe73c480'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:24.473139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2dbb7d8e-2d65-4d1e-841b-16debe73c480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0964379af9be407ea2a785223f145120', 'request_id': 'req-2dbb7d8e-2d65-4d1e-841b-16debe73c480'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:24.480115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2dbb7d8e-2d65-4d1e-841b-16debe73c480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0964379af9be407ea2a785223f145120', 'request_id': 'req-2dbb7d8e-2d65-4d1e-841b-16debe73c480'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:24.491929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2dbb7d8e-2d65-4d1e-841b-16debe73c480 admin admin] The token cache is being invalidate because project 0964379af9be407ea2a785223f145120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:08:24.492351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2dbb7d8e-2d65-4d1e-841b-16debe73c480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:24.493031 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2dbb7d8e-2d65-4d1e-841b-16debe73c480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:24.494630 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1195/2420] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:08:24 2022] DELETE /identity/v3/projects/0964379af9be407ea2a785223f145120 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:24.499665 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afab2c-ff0a-4412-815f-6ac8cb919480 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:24.500127 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afab2c-ff0a-4412-815f-6ac8cb919480 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:24.500235 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afab2c-ff0a-4412-815f-6ac8cb919480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:24.520033 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e8afab2c-ff0a-4412-815f-6ac8cb919480 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:24.521241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e8afab2c-ff0a-4412-815f-6ac8cb919480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:24.559092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb7d8e-2d65-4d1e-841b-16debe73c480 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:24.562808 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2dbb7d8e-2d65-4d1e-841b-16debe73c480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:24.584615 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1226/2421] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:24.592438 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96242607-3bf3-4d9c-bf1e-0c83af23ab41 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:24.592729 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96242607-3bf3-4d9c-bf1e-0c83af23ab41 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:24.593084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96242607-3bf3-4d9c-bf1e-0c83af23ab41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:24.615315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-96242607-3bf3-4d9c-bf1e-0c83af23ab41 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:24.620175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-96242607-3bf3-4d9c-bf1e-0c83af23ab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:24.624857 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1227/2422] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:08:24.629243 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96242607-3bf3-4d9c-bf1e-0c83af23ab41 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:24.638984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96242607-3bf3-4d9c-bf1e-0c83af23ab41 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:24.641072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb7d8e-2d65-4d1e-841b-16debe73c480 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:24.645563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751173e0-ac41-4ca9-a80f-c26e1a176b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:24.646225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751173e0-ac41-4ca9-a80f-c26e1a176b28 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:24.646934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751173e0-ac41-4ca9-a80f-c26e1a176b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:24.647218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751173e0-ac41-4ca9-a80f-c26e1a176b28 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:24.648817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea373e2-c4cb-484a-a08b-de92713a1bb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:24.649105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751173e0-ac41-4ca9-a80f-c26e1a176b28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:08:24.649224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea373e2-c4cb-484a-a08b-de92713a1bb8 service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:24.649326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751173e0-ac41-4ca9-a80f-c26e1a176b28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:24.649434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea373e2-c4cb-484a-a08b-de92713a1bb8 service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:24.649434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea373e2-c4cb-484a-a08b-de92713a1bb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:24.649924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751173e0-ac41-4ca9-a80f-c26e1a176b28 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:24.650671 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-dea373e2-c4cb-484a-a08b-de92713a1bb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:24.662808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1228/2423] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:08:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:08:24.667372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751173e0-ac41-4ca9-a80f-c26e1a176b28 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:24.678697 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751173e0-ac41-4ca9-a80f-c26e1a176b28 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:24.683787 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17ae34-941b-4946-8bd9-9c4e2c8e28b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:24.684448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17ae34-941b-4946-8bd9-9c4e2c8e28b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:24.684735 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17ae34-941b-4946-8bd9-9c4e2c8e28b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:24.685016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17ae34-941b-4946-8bd9-9c4e2c8e28b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:24.685702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17ae34-941b-4946-8bd9-9c4e2c8e28b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:24.687681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17ae34-941b-4946-8bd9-9c4e2c8e28b8 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:24.721547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:24.740361 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea373e2-c4cb-484a-a08b-de92713a1bb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:24.741995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea373e2-c4cb-484a-a08b-de92713a1bb8 service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:24.760720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1196/2424] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:08:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:24.771530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1229/2425] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:08:24 2022] POST /identity/v3/projects => generated 368 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:08:24.775986 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea373e2-c4cb-484a-a08b-de92713a1bb8 service nova] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:24.787754 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea373e2-c4cb-484a-a08b-de92713a1bb8 service nova] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:24.848183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e0dd0-c3ad-4b0c-9817-bd8302362714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:24.848856 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e0dd0-c3ad-4b0c-9817-bd8302362714 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:24.849143 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e0dd0-c3ad-4b0c-9817-bd8302362714 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:24.849418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e0dd0-c3ad-4b0c-9817-bd8302362714 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:24.850115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e0dd0-c3ad-4b0c-9817-bd8302362714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:24.852259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e0dd0-c3ad-4b0c-9817-bd8302362714 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:24.980666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1197/2426] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:08:24 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:08:24.984825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17ae34-941b-4946-8bd9-9c4e2c8e28b8 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:24.995981 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17ae34-941b-4946-8bd9-9c4e2c8e28b8 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:25.001024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5f1fd-f3e3-4b61-b98c-93d6759d5559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:25.001696 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5f1fd-f3e3-4b61-b98c-93d6759d5559 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:25.001978 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5f1fd-f3e3-4b61-b98c-93d6759d5559 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:25.002358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5f1fd-f3e3-4b61-b98c-93d6759d5559 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:25.003880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5f1fd-f3e3-4b61-b98c-93d6759d5559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:25.005824 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5f1fd-f3e3-4b61-b98c-93d6759d5559 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:25.017278 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1230/2427] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:24 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:25.021368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e0dd0-c3ad-4b0c-9817-bd8302362714 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:25.031659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e0dd0-c3ad-4b0c-9817-bd8302362714 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:25.037641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32dd061-4efc-4d87-8e3a-d14ab37ef5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:25.038515 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dd061-4efc-4d87-8e3a-d14ab37ef5bc admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:25.038905 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dd061-4efc-4d87-8e3a-d14ab37ef5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:25.039285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dd061-4efc-4d87-8e3a-d14ab37ef5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:25.040200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dd061-4efc-4d87-8e3a-d14ab37ef5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:25.042085 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dd061-4efc-4d87-8e3a-d14ab37ef5bc admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:25.055288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1198/2428] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:25 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:25.059789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5f1fd-f3e3-4b61-b98c-93d6759d5559 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:25.071808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5f1fd-f3e3-4b61-b98c-93d6759d5559 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:25.077257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0ef40-ed53-4f8f-8332-6e3005c57d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:25.081930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0ef40-ed53-4f8f-8332-6e3005c57d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:25.081930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0ef40-ed53-4f8f-8332-6e3005c57d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:25.081930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0ef40-ed53-4f8f-8332-6e3005c57d1e admin admin] PATH_INFO: `/v3/projects/611544e9b0224261a0c247e4504ba644/users/8aeae1d70a924fda839fada13bad69e7/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:25.095731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0ef40-ed53-4f8f-8332-6e3005c57d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=611544e9b0224261a0c247e4504ba644, user_id=8aeae1d70a924fda839fada13bad69e7, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:25.099151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0ef40-ed53-4f8f-8332-6e3005c57d1e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:25.204427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1231/2429] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:25 2022] PUT /identity/v3/projects/611544e9b0224261a0c247e4504ba644/users/8aeae1d70a924fda839fada13bad69e7/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:25.215493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeac72-2a25-4986-96df-7f557f52524b None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:25.216002 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeac72-2a25-4986-96df-7f557f52524b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:25.216146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeac72-2a25-4986-96df-7f557f52524b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:25.244046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-90aeac72-2a25-4986-96df-7f557f52524b None None] MFA Rules not processed for user `8aeae1d70a924fda839fada13bad69e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:25.245246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-90aeac72-2a25-4986-96df-7f557f52524b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:25.312095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1199/2430] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:25.318026 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0ef40-ed53-4f8f-8332-6e3005c57d1e admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:25.357160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:25.388769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0ef40-ed53-4f8f-8332-6e3005c57d1e admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:25.393645 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0a53a-f1d7-4743-9a63-9266cda69010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:25.394926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0a53a-f1d7-4743-9a63-9266cda69010 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:25.395215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0a53a-f1d7-4743-9a63-9266cda69010 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:25.395486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0a53a-f1d7-4743-9a63-9266cda69010 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:25.396173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0a53a-f1d7-4743-9a63-9266cda69010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:25.398089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0a53a-f1d7-4743-9a63-9266cda69010 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:25.525114 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1232/2431] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:08:25 2022] POST /identity/v3/projects => generated 368 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:08:25.529102 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeac72-2a25-4986-96df-7f557f52524b None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:25.541361 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeac72-2a25-4986-96df-7f557f52524b None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:25.582244 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:25.601682 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d6bfb-8d4b-4580-835c-c2ecb06ee5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:25.602435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d6bfb-8d4b-4580-835c-c2ecb06ee5ed admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:25.602728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d6bfb-8d4b-4580-835c-c2ecb06ee5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:25.603048 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d6bfb-8d4b-4580-835c-c2ecb06ee5ed admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:25.603756 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d6bfb-8d4b-4580-835c-c2ecb06ee5ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:25.605849 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d6bfb-8d4b-4580-835c-c2ecb06ee5ed admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:25.745119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1200/2432] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:08:25 2022] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:08:25.749482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0a53a-f1d7-4743-9a63-9266cda69010 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:25.759919 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0a53a-f1d7-4743-9a63-9266cda69010 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:25.765196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e850d-5bb6-42c6-8b44-95c0bbbbb39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:25.765862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e850d-5bb6-42c6-8b44-95c0bbbbb39e admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:25.766149 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e850d-5bb6-42c6-8b44-95c0bbbbb39e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:25.766455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e850d-5bb6-42c6-8b44-95c0bbbbb39e admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:25.767179 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e850d-5bb6-42c6-8b44-95c0bbbbb39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:25.771048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e850d-5bb6-42c6-8b44-95c0bbbbb39e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:25.782558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1233/2433] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:25 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:25.787800 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d6bfb-8d4b-4580-835c-c2ecb06ee5ed admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:25.798446 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d6bfb-8d4b-4580-835c-c2ecb06ee5ed admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:25.803679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6aed22-fd7a-4f7e-8820-1f7387bbb1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:25.804641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6aed22-fd7a-4f7e-8820-1f7387bbb1b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:25.804970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6aed22-fd7a-4f7e-8820-1f7387bbb1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:25.805259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6aed22-fd7a-4f7e-8820-1f7387bbb1b7 admin admin] PATH_INFO: `/v3/projects/1a671c7e46794f8ea32a884510df32df/users/8695692f893745ddb2895748726b8188/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:25.823129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6aed22-fd7a-4f7e-8820-1f7387bbb1b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a671c7e46794f8ea32a884510df32df, user_id=8695692f893745ddb2895748726b8188, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:25.826175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6aed22-fd7a-4f7e-8820-1f7387bbb1b7 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:25.923798 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1201/2434] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:25 2022] PUT /identity/v3/projects/1a671c7e46794f8ea32a884510df32df/users/8695692f893745ddb2895748726b8188/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:25.928448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e850d-5bb6-42c6-8b44-95c0bbbbb39e admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:25.939051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e850d-5bb6-42c6-8b44-95c0bbbbb39e admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:25.998483 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdb1e4-5fce-4066-b56e-c95a555d4ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:25.999150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdb1e4-5fce-4066-b56e-c95a555d4ace admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:25.999437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdb1e4-5fce-4066-b56e-c95a555d4ace admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:25.999718 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdb1e4-5fce-4066-b56e-c95a555d4ace admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:26.000438 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdb1e4-5fce-4066-b56e-c95a555d4ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:26.002041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdb1e4-5fce-4066-b56e-c95a555d4ace admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:26.012068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1234/2435] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:25 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:26.016428 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6aed22-fd7a-4f7e-8820-1f7387bbb1b7 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:26.028852 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6aed22-fd7a-4f7e-8820-1f7387bbb1b7 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:26.037658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba4781-545b-48d8-8a18-fd3cdc57b613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:26.037658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba4781-545b-48d8-8a18-fd3cdc57b613 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:26.037658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba4781-545b-48d8-8a18-fd3cdc57b613 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:26.037658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba4781-545b-48d8-8a18-fd3cdc57b613 admin admin] PATH_INFO: `/v3/projects/1a671c7e46794f8ea32a884510df32df/users/8695692f893745ddb2895748726b8188/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:26.038784 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba4781-545b-48d8-8a18-fd3cdc57b613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a671c7e46794f8ea32a884510df32df, user_id=8695692f893745ddb2895748726b8188, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:26.041418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba4781-545b-48d8-8a18-fd3cdc57b613 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:26.051930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1202/2436] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:26 2022] PUT /identity/v3/projects/1a671c7e46794f8ea32a884510df32df/users/8695692f893745ddb2895748726b8188/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:26.063145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f3662-d7ff-4d50-8ac5-890a5d5ef69e None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:26.063439 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f3662-d7ff-4d50-8ac5-890a5d5ef69e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:26.063723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f3662-d7ff-4d50-8ac5-890a5d5ef69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:26.091082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-605f3662-d7ff-4d50-8ac5-890a5d5ef69e None None] MFA Rules not processed for user `8695692f893745ddb2895748726b8188`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:26.092296 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-605f3662-d7ff-4d50-8ac5-890a5d5ef69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:26.160764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1235/2437] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:26.172053 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba4781-545b-48d8-8a18-fd3cdc57b613 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:26.173751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-70ba4781-545b-48d8-8a18-fd3cdc57b613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:26.235568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba4781-545b-48d8-8a18-fd3cdc57b613 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:26.239382 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a7c4e-b241-4fb0-a739-23b5902ebdc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:26.240055 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a7c4e-b241-4fb0-a739-23b5902ebdc9 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:26.240347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a7c4e-b241-4fb0-a739-23b5902ebdc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:26.240624 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a7c4e-b241-4fb0-a739-23b5902ebdc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:26.249955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a7c4e-b241-4fb0-a739-23b5902ebdc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:26.251530 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a7c4e-b241-4fb0-a739-23b5902ebdc9 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:26.261949 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1203/2438] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:08:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:29.649539 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f3662-d7ff-4d50-8ac5-890a5d5ef69e None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:29.676894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:29.713093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f3662-d7ff-4d50-8ac5-890a5d5ef69e None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:29.717538 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbacf6f-8492-438d-b3ff-fd75c4c84473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:29.718438 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbacf6f-8492-438d-b3ff-fd75c4c84473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:29.718719 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbacf6f-8492-438d-b3ff-fd75c4c84473 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:29.719112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbacf6f-8492-438d-b3ff-fd75c4c84473 admin admin] PATH_INFO: `/v3/users/8aeae1d70a924fda839fada13bad69e7` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:29.720294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbacf6f-8492-438d-b3ff-fd75c4c84473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aeae1d70a924fda839fada13bad69e7)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:29.722244 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbacf6f-8492-438d-b3ff-fd75c4c84473 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:30.036130 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8fbacf6f-8492-438d-b3ff-fd75c4c84473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aeae1d70a924fda839fada13bad69e7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:30.036822 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8fbacf6f-8492-438d-b3ff-fd75c4c84473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aeae1d70a924fda839fada13bad69e7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:30.048973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8fbacf6f-8492-438d-b3ff-fd75c4c84473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aeae1d70a924fda839fada13bad69e7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:30.121145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8fbacf6f-8492-438d-b3ff-fd75c4c84473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aeae1d70a924fda839fada13bad69e7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:30.129010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8fbacf6f-8492-438d-b3ff-fd75c4c84473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aeae1d70a924fda839fada13bad69e7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:30.135492 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1236/2439] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:08:29 2022] DELETE /identity/v3/users/8aeae1d70a924fda839fada13bad69e7 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:30.140083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74f087-98b8-45f6-be59-341fc98f7620 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:30.140535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74f087-98b8-45f6-be59-341fc98f7620 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:30.140684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74f087-98b8-45f6-be59-341fc98f7620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:30.158362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-0a74f087-98b8-45f6-be59-341fc98f7620 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:30.159560 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0a74f087-98b8-45f6-be59-341fc98f7620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:30.221705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1204/2440] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:30.231874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbacf6f-8492-438d-b3ff-fd75c4c84473 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:30.233317 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8fbacf6f-8492-438d-b3ff-fd75c4c84473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:30.322967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbacf6f-8492-438d-b3ff-fd75c4c84473 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:30.326593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bc0da-d5bc-4871-bb31-93aeab6dff7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:30.327491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bc0da-d5bc-4871-bb31-93aeab6dff7f service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:30.327776 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bc0da-d5bc-4871-bb31-93aeab6dff7f service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:30.328052 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bc0da-d5bc-4871-bb31-93aeab6dff7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:30.338247 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bc0da-d5bc-4871-bb31-93aeab6dff7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:30.339690 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bc0da-d5bc-4871-bb31-93aeab6dff7f service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:30.350160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1237/2441] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:30.827928 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74f087-98b8-45f6-be59-341fc98f7620 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:30.829428 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0a74f087-98b8-45f6-be59-341fc98f7620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:30.871463 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:30.889123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74f087-98b8-45f6-be59-341fc98f7620 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:30.893715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128806ae-da3f-46b7-b026-97b34328f735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:30.895249 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128806ae-da3f-46b7-b026-97b34328f735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:30.895531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128806ae-da3f-46b7-b026-97b34328f735 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:30.895807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128806ae-da3f-46b7-b026-97b34328f735 admin admin] PATH_INFO: `/v3/projects/611544e9b0224261a0c247e4504ba644` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:30.896984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128806ae-da3f-46b7-b026-97b34328f735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=611544e9b0224261a0c247e4504ba644)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:30.898932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128806ae-da3f-46b7-b026-97b34328f735 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:31.046856 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-128806ae-da3f-46b7-b026-97b34328f735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '611544e9b0224261a0c247e4504ba644', 'request_id': 'req-128806ae-da3f-46b7-b026-97b34328f735'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:31.128513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-128806ae-da3f-46b7-b026-97b34328f735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '611544e9b0224261a0c247e4504ba644', 'request_id': 'req-128806ae-da3f-46b7-b026-97b34328f735'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:31.136133 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-128806ae-da3f-46b7-b026-97b34328f735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '611544e9b0224261a0c247e4504ba644', 'request_id': 'req-128806ae-da3f-46b7-b026-97b34328f735'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:31.147638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-128806ae-da3f-46b7-b026-97b34328f735 admin admin] The token cache is being invalidate because project 611544e9b0224261a0c247e4504ba644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:08:31.148235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-128806ae-da3f-46b7-b026-97b34328f735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:31.148562 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-128806ae-da3f-46b7-b026-97b34328f735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:31.150121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1205/2442] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:08:30 2022] DELETE /identity/v3/projects/611544e9b0224261a0c247e4504ba644 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:31.154197 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bc0da-d5bc-4871-bb31-93aeab6dff7f service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:31.172969 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:31.187971 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bc0da-d5bc-4871-bb31-93aeab6dff7f service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:31.249457 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afc528-8784-474d-8d4e-88bcf3dc02e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:31.250382 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afc528-8784-474d-8d4e-88bcf3dc02e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:31.250700 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afc528-8784-474d-8d4e-88bcf3dc02e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:31.250980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afc528-8784-474d-8d4e-88bcf3dc02e3 admin admin] PATH_INFO: `/v3/users/8695692f893745ddb2895748726b8188` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:31.252246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afc528-8784-474d-8d4e-88bcf3dc02e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8695692f893745ddb2895748726b8188)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:31.254806 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afc528-8784-474d-8d4e-88bcf3dc02e3 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:31.472526 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-68afc528-8784-474d-8d4e-88bcf3dc02e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8695692f893745ddb2895748726b8188'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:31.473197 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-68afc528-8784-474d-8d4e-88bcf3dc02e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8695692f893745ddb2895748726b8188'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:31.485048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-68afc528-8784-474d-8d4e-88bcf3dc02e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8695692f893745ddb2895748726b8188'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:31.585581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-68afc528-8784-474d-8d4e-88bcf3dc02e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8695692f893745ddb2895748726b8188'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:31.593216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-68afc528-8784-474d-8d4e-88bcf3dc02e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8695692f893745ddb2895748726b8188'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:31.599868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1238/2443] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:08:31 2022] DELETE /identity/v3/users/8695692f893745ddb2895748726b8188 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:32.091132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128806ae-da3f-46b7-b026-97b34328f735 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:32.092733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-128806ae-da3f-46b7-b026-97b34328f735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:32.109833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128806ae-da3f-46b7-b026-97b34328f735 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:32.166118 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeaffb6-548b-4202-a86b-39cccd89ee5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:32.167014 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaffb6-548b-4202-a86b-39cccd89ee5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:32.167297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaffb6-548b-4202-a86b-39cccd89ee5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:32.167573 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaffb6-548b-4202-a86b-39cccd89ee5a admin admin] PATH_INFO: `/v3/projects/1a671c7e46794f8ea32a884510df32df` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:32.168761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeaffb6-548b-4202-a86b-39cccd89ee5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a671c7e46794f8ea32a884510df32df)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:32.170711 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeaffb6-548b-4202-a86b-39cccd89ee5a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:32.283641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-adeaffb6-548b-4202-a86b-39cccd89ee5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a671c7e46794f8ea32a884510df32df', 'request_id': 'req-adeaffb6-548b-4202-a86b-39cccd89ee5a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:32.403127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-adeaffb6-548b-4202-a86b-39cccd89ee5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a671c7e46794f8ea32a884510df32df', 'request_id': 'req-adeaffb6-548b-4202-a86b-39cccd89ee5a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:32.410260 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-adeaffb6-548b-4202-a86b-39cccd89ee5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a671c7e46794f8ea32a884510df32df', 'request_id': 'req-adeaffb6-548b-4202-a86b-39cccd89ee5a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:32.420333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-adeaffb6-548b-4202-a86b-39cccd89ee5a admin admin] The token cache is being invalidate because project 1a671c7e46794f8ea32a884510df32df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:08:32.420619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-adeaffb6-548b-4202-a86b-39cccd89ee5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:32.421241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-adeaffb6-548b-4202-a86b-39cccd89ee5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:32.422892 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1206/2444] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:08:32 2022] DELETE /identity/v3/projects/1a671c7e46794f8ea32a884510df32df => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:32.428647 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c4c55-8977-4460-9450-bbce68edf30c None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:32.429162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c4c55-8977-4460-9450-bbce68edf30c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:32.429267 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c4c55-8977-4460-9450-bbce68edf30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:32.457327 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-456c4c55-8977-4460-9450-bbce68edf30c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:32.458555 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-456c4c55-8977-4460-9450-bbce68edf30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:32.519892 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1239/2445] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:32.527731 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b4c4f-a8d0-41f7-823f-1a6e52566275 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:32.528030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b4c4f-a8d0-41f7-823f-1a6e52566275 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:32.528314 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b4c4f-a8d0-41f7-823f-1a6e52566275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:32.535707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:32.546464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-be0b4c4f-a8d0-41f7-823f-1a6e52566275 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:32.549370 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-be0b4c4f-a8d0-41f7-823f-1a6e52566275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:32.556607 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1207/2446] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:32.561280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c4c55-8977-4460-9450-bbce68edf30c None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:32.572084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c4c55-8977-4460-9450-bbce68edf30c None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:32.577120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5accc-c18c-485c-a532-9600d3efc440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:32.577779 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5accc-c18c-485c-a532-9600d3efc440 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:32.578069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5accc-c18c-485c-a532-9600d3efc440 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:32.578380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5accc-c18c-485c-a532-9600d3efc440 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:32.579112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5accc-c18c-485c-a532-9600d3efc440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:08:32.579446 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5accc-c18c-485c-a532-9600d3efc440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:32.581048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5accc-c18c-485c-a532-9600d3efc440 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:32.582731 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:32.593521 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1240/2447] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:08:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:08:32.598130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b4c4f-a8d0-41f7-823f-1a6e52566275 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:32.607331 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b4c4f-a8d0-41f7-823f-1a6e52566275 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:32.612831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d260a4-78bd-4b2d-925a-18759a90c5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:32.614590 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d260a4-78bd-4b2d-925a-18759a90c5fc admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:32.614881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d260a4-78bd-4b2d-925a-18759a90c5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:32.615232 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d260a4-78bd-4b2d-925a-18759a90c5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:32.616003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d260a4-78bd-4b2d-925a-18759a90c5fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:32.617993 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d260a4-78bd-4b2d-925a-18759a90c5fc admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:32.759294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1208/2448] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:08:32 2022] POST /identity/v3/projects => generated 388 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:08:32.763415 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5accc-c18c-485c-a532-9600d3efc440 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:32.773215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5accc-c18c-485c-a532-9600d3efc440 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:32.838242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a48aeb-2cb8-4acd-93fa-358d0caa2b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:32.838930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a48aeb-2cb8-4acd-93fa-358d0caa2b63 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:32.839210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a48aeb-2cb8-4acd-93fa-358d0caa2b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:32.839485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a48aeb-2cb8-4acd-93fa-358d0caa2b63 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:32.840156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a48aeb-2cb8-4acd-93fa-358d0caa2b63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:32.842086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a48aeb-2cb8-4acd-93fa-358d0caa2b63 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:33.002295 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1241/2449] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:08:32 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:08:33.006282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d260a4-78bd-4b2d-925a-18759a90c5fc admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:33.017700 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d260a4-78bd-4b2d-925a-18759a90c5fc admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:33.023056 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a973b2-bbac-4d0e-95dc-e37437b389ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:33.023895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a973b2-bbac-4d0e-95dc-e37437b389ff admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:33.024211 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a973b2-bbac-4d0e-95dc-e37437b389ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:33.024575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a973b2-bbac-4d0e-95dc-e37437b389ff admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:33.025299 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a973b2-bbac-4d0e-95dc-e37437b389ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:33.026950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a973b2-bbac-4d0e-95dc-e37437b389ff admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:33.038664 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1209/2450] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:33 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:33.042746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a48aeb-2cb8-4acd-93fa-358d0caa2b63 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:33.053552 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a48aeb-2cb8-4acd-93fa-358d0caa2b63 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:33.058187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d0504-8654-4f59-aa3f-12bedfc0ed9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:33.058878 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0504-8654-4f59-aa3f-12bedfc0ed9d admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:33.059164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0504-8654-4f59-aa3f-12bedfc0ed9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:33.059468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0504-8654-4f59-aa3f-12bedfc0ed9d admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:33.060185 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d0504-8654-4f59-aa3f-12bedfc0ed9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:33.061770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d0504-8654-4f59-aa3f-12bedfc0ed9d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:33.071668 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1242/2451] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:33 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:33.075728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a973b2-bbac-4d0e-95dc-e37437b389ff admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:33.086014 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a973b2-bbac-4d0e-95dc-e37437b389ff admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:33.090561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef342b-2d4d-476a-9c40-6ee91e023a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:33.091438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef342b-2d4d-476a-9c40-6ee91e023a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:33.091730 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef342b-2d4d-476a-9c40-6ee91e023a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:33.092012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef342b-2d4d-476a-9c40-6ee91e023a63 admin admin] PATH_INFO: `/v3/projects/d1ea2213c3e94952bf6a5e4d40b24110/users/caf00ca91e5e4af2b879c27ca68d8f57/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:33.107060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef342b-2d4d-476a-9c40-6ee91e023a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ea2213c3e94952bf6a5e4d40b24110, user_id=caf00ca91e5e4af2b879c27ca68d8f57, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:33.109724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef342b-2d4d-476a-9c40-6ee91e023a63 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:33.185890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1210/2452] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:33 2022] PUT /identity/v3/projects/d1ea2213c3e94952bf6a5e4d40b24110/users/caf00ca91e5e4af2b879c27ca68d8f57/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:33.196593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492f3b3-95db-4de5-af6f-d9e299091125 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:33.196877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492f3b3-95db-4de5-af6f-d9e299091125 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:33.197155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492f3b3-95db-4de5-af6f-d9e299091125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:33.225821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-3492f3b3-95db-4de5-af6f-d9e299091125 None None] MFA Rules not processed for user `caf00ca91e5e4af2b879c27ca68d8f57`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:33.227059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-3492f3b3-95db-4de5-af6f-d9e299091125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:33.290071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1243/2453] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:33.294704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef342b-2d4d-476a-9c40-6ee91e023a63 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:33.361621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef342b-2d4d-476a-9c40-6ee91e023a63 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:33.366510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223f209-222e-43a0-bc83-d6e732c4dc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:33.367179 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223f209-222e-43a0-bc83-d6e732c4dc8a admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:33.367467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223f209-222e-43a0-bc83-d6e732c4dc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:33.367748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223f209-222e-43a0-bc83-d6e732c4dc8a admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:33.368452 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223f209-222e-43a0-bc83-d6e732c4dc8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:33.370384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223f209-222e-43a0-bc83-d6e732c4dc8a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:33.467106 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1211/2454] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:08:33 2022] POST /identity/v3/projects => generated 388 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:08:33.470884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492f3b3-95db-4de5-af6f-d9e299091125 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:33.483106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492f3b3-95db-4de5-af6f-d9e299091125 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:33.532121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:33.542173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78de635-8444-44cb-9510-c9f9577cf75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:33.542873 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78de635-8444-44cb-9510-c9f9577cf75a admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:33.543159 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78de635-8444-44cb-9510-c9f9577cf75a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:33.543445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78de635-8444-44cb-9510-c9f9577cf75a admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:33.544157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78de635-8444-44cb-9510-c9f9577cf75a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:33.546113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78de635-8444-44cb-9510-c9f9577cf75a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:33.661386 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1244/2455] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:08:33 2022] POST /identity/v3/users => generated 301 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:08:33.667086 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223f209-222e-43a0-bc83-d6e732c4dc8a admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:33.677862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223f209-222e-43a0-bc83-d6e732c4dc8a admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:33.682977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5617b04-997c-4705-951f-473f4fe4754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:33.683714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5617b04-997c-4705-951f-473f4fe4754f admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:33.683990 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5617b04-997c-4705-951f-473f4fe4754f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:33.684272 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5617b04-997c-4705-951f-473f4fe4754f admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:33.685000 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5617b04-997c-4705-951f-473f4fe4754f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:33.686667 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5617b04-997c-4705-951f-473f4fe4754f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:33.700498 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1212/2456] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:33 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:33.706033 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78de635-8444-44cb-9510-c9f9577cf75a admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:33.716834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78de635-8444-44cb-9510-c9f9577cf75a admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:33.721527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a053cd-3d4e-450a-b413-d406e4fe7833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:33.722678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a053cd-3d4e-450a-b413-d406e4fe7833 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:33.722966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a053cd-3d4e-450a-b413-d406e4fe7833 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:33.723251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a053cd-3d4e-450a-b413-d406e4fe7833 admin admin] PATH_INFO: `/v3/projects/2c5b7e6c7be948ec971336216d7aaf1c/users/2a5299f8ed8a40ca86baaa6f69f2a676/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:33.737778 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a053cd-3d4e-450a-b413-d406e4fe7833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5b7e6c7be948ec971336216d7aaf1c, user_id=2a5299f8ed8a40ca86baaa6f69f2a676, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:33.740707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a053cd-3d4e-450a-b413-d406e4fe7833 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:33.838899 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1245/2457] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:33 2022] PUT /identity/v3/projects/2c5b7e6c7be948ec971336216d7aaf1c/users/2a5299f8ed8a40ca86baaa6f69f2a676/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:33.843184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5617b04-997c-4705-951f-473f4fe4754f admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:33.854270 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5617b04-997c-4705-951f-473f4fe4754f admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:33.913516 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77e25e-4253-4bf5-9455-fe7d6dfff994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:33.914592 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77e25e-4253-4bf5-9455-fe7d6dfff994 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:33.915054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77e25e-4253-4bf5-9455-fe7d6dfff994 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:33.915628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77e25e-4253-4bf5-9455-fe7d6dfff994 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:33.916961 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77e25e-4253-4bf5-9455-fe7d6dfff994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:33.919044 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77e25e-4253-4bf5-9455-fe7d6dfff994 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:33.934733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1213/2458] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:33 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:33.935880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a053cd-3d4e-450a-b413-d406e4fe7833 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:33.946533 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a053cd-3d4e-450a-b413-d406e4fe7833 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:33.952347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81614652-e8cd-4d99-b3f4-d992e551a05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:33.953339 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81614652-e8cd-4d99-b3f4-d992e551a05f admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:33.953732 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81614652-e8cd-4d99-b3f4-d992e551a05f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:33.954101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81614652-e8cd-4d99-b3f4-d992e551a05f admin admin] PATH_INFO: `/v3/projects/2c5b7e6c7be948ec971336216d7aaf1c/users/2a5299f8ed8a40ca86baaa6f69f2a676/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:33.956235 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81614652-e8cd-4d99-b3f4-d992e551a05f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5b7e6c7be948ec971336216d7aaf1c, user_id=2a5299f8ed8a40ca86baaa6f69f2a676, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:33.960347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81614652-e8cd-4d99-b3f4-d992e551a05f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:33.971737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1246/2459] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:33 2022] PUT /identity/v3/projects/2c5b7e6c7be948ec971336216d7aaf1c/users/2a5299f8ed8a40ca86baaa6f69f2a676/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:34.000661 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9725c9-a3db-42ed-a6cd-bd1018f24bed None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:34.001111 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9725c9-a3db-42ed-a6cd-bd1018f24bed None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:34.001430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9725c9-a3db-42ed-a6cd-bd1018f24bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:34.022780 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:34.030969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-8f9725c9-a3db-42ed-a6cd-bd1018f24bed None None] MFA Rules not processed for user `2a5299f8ed8a40ca86baaa6f69f2a676`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:34.032257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8f9725c9-a3db-42ed-a6cd-bd1018f24bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:34.115294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1214/2460] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:34.125635 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81614652-e8cd-4d99-b3f4-d992e551a05f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:34.127639 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-81614652-e8cd-4d99-b3f4-d992e551a05f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:34.193304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81614652-e8cd-4d99-b3f4-d992e551a05f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:34.197086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e47309-9bf1-4d01-8e74-536c4475f2bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:34.197735 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e47309-9bf1-4d01-8e74-536c4475f2bc service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:34.198022 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e47309-9bf1-4d01-8e74-536c4475f2bc service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:34.198302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e47309-9bf1-4d01-8e74-536c4475f2bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:34.209224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e47309-9bf1-4d01-8e74-536c4475f2bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:34.210694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e47309-9bf1-4d01-8e74-536c4475f2bc service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:34.220681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1247/2461] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:08:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:34.349966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9725c9-a3db-42ed-a6cd-bd1018f24bed None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:34.425970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9725c9-a3db-42ed-a6cd-bd1018f24bed None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:34.430850 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5119c6b-4a73-4a50-8473-cbeff423fc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:34.431725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5119c6b-4a73-4a50-8473-cbeff423fc34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:34.432007 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5119c6b-4a73-4a50-8473-cbeff423fc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:34.432279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5119c6b-4a73-4a50-8473-cbeff423fc34 admin admin] PATH_INFO: `/v3/users/caf00ca91e5e4af2b879c27ca68d8f57` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:34.433452 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5119c6b-4a73-4a50-8473-cbeff423fc34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf00ca91e5e4af2b879c27ca68d8f57)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:34.435419 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5119c6b-4a73-4a50-8473-cbeff423fc34 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:34.669070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e5119c6b-4a73-4a50-8473-cbeff423fc34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf00ca91e5e4af2b879c27ca68d8f57'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:34.669748 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e5119c6b-4a73-4a50-8473-cbeff423fc34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf00ca91e5e4af2b879c27ca68d8f57'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:34.670395 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e5119c6b-4a73-4a50-8473-cbeff423fc34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf00ca91e5e4af2b879c27ca68d8f57'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:34.790541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e5119c6b-4a73-4a50-8473-cbeff423fc34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf00ca91e5e4af2b879c27ca68d8f57'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:34.803164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-e5119c6b-4a73-4a50-8473-cbeff423fc34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf00ca91e5e4af2b879c27ca68d8f57'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:34.815423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1215/2462] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:08:34 2022] DELETE /identity/v3/users/caf00ca91e5e4af2b879c27ca68d8f57 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:34.821278 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58330a9e-4639-415f-a052-10e46e1abf66 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:34.825699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58330a9e-4639-415f-a052-10e46e1abf66 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:34.825699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58330a9e-4639-415f-a052-10e46e1abf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:34.840348 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-58330a9e-4639-415f-a052-10e46e1abf66 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:34.841596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-58330a9e-4639-415f-a052-10e46e1abf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:34.902237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1248/2463] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:34.916347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5119c6b-4a73-4a50-8473-cbeff423fc34 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:34.917862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-e5119c6b-4a73-4a50-8473-cbeff423fc34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:34.937464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:34.987895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5119c6b-4a73-4a50-8473-cbeff423fc34 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:34.992422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edc99f-8359-463f-b174-fde8390c659a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:34.993106 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edc99f-8359-463f-b174-fde8390c659a service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:34.993452 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edc99f-8359-463f-b174-fde8390c659a service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:34.993891 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edc99f-8359-463f-b174-fde8390c659a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:35.007400 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edc99f-8359-463f-b174-fde8390c659a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:35.010483 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edc99f-8359-463f-b174-fde8390c659a service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:35.026768 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1216/2464] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:35.466752 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58330a9e-4639-415f-a052-10e46e1abf66 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:35.468190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-58330a9e-4639-415f-a052-10e46e1abf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:35.491758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58330a9e-4639-415f-a052-10e46e1abf66 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:35.496515 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74028b31-b5db-496b-8913-72ee09b1948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:35.497377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74028b31-b5db-496b-8913-72ee09b1948b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:35.497662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74028b31-b5db-496b-8913-72ee09b1948b admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:35.497945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74028b31-b5db-496b-8913-72ee09b1948b admin admin] PATH_INFO: `/v3/projects/d1ea2213c3e94952bf6a5e4d40b24110` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:35.499152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74028b31-b5db-496b-8913-72ee09b1948b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ea2213c3e94952bf6a5e4d40b24110)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:35.501093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74028b31-b5db-496b-8913-72ee09b1948b admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:35.617214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:35.632455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-74028b31-b5db-496b-8913-72ee09b1948b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ea2213c3e94952bf6a5e4d40b24110', 'request_id': 'req-74028b31-b5db-496b-8913-72ee09b1948b'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:35.711541 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-74028b31-b5db-496b-8913-72ee09b1948b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ea2213c3e94952bf6a5e4d40b24110', 'request_id': 'req-74028b31-b5db-496b-8913-72ee09b1948b'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:35.718459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-74028b31-b5db-496b-8913-72ee09b1948b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ea2213c3e94952bf6a5e4d40b24110', 'request_id': 'req-74028b31-b5db-496b-8913-72ee09b1948b'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:35.729177 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-74028b31-b5db-496b-8913-72ee09b1948b admin admin] The token cache is being invalidate because project d1ea2213c3e94952bf6a5e4d40b24110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:08:35.729474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-74028b31-b5db-496b-8913-72ee09b1948b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:35.730176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-74028b31-b5db-496b-8913-72ee09b1948b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:35.731789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1249/2465] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:08:35 2022] DELETE /identity/v3/projects/d1ea2213c3e94952bf6a5e4d40b24110 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:08:35.735843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edc99f-8359-463f-b174-fde8390c659a service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:35.756494 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edc99f-8359-463f-b174-fde8390c659a service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:35.811778 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f750d-f89b-4429-b3e0-1b8b90416d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:35.812644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f750d-f89b-4429-b3e0-1b8b90416d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:35.812986 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f750d-f89b-4429-b3e0-1b8b90416d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:35.813197 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f750d-f89b-4429-b3e0-1b8b90416d9b admin admin] PATH_INFO: `/v3/users/2a5299f8ed8a40ca86baaa6f69f2a676` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:35.814418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f750d-f89b-4429-b3e0-1b8b90416d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5299f8ed8a40ca86baaa6f69f2a676)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:35.816958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f750d-f89b-4429-b3e0-1b8b90416d9b admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:36.064215 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2b4f750d-f89b-4429-b3e0-1b8b90416d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5299f8ed8a40ca86baaa6f69f2a676'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:36.064875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2b4f750d-f89b-4429-b3e0-1b8b90416d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5299f8ed8a40ca86baaa6f69f2a676'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:36.065658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2b4f750d-f89b-4429-b3e0-1b8b90416d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5299f8ed8a40ca86baaa6f69f2a676'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:36.155695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2b4f750d-f89b-4429-b3e0-1b8b90416d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5299f8ed8a40ca86baaa6f69f2a676'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:36.168386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-2b4f750d-f89b-4429-b3e0-1b8b90416d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5299f8ed8a40ca86baaa6f69f2a676'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:36.181272 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1217/2466] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:08:35 2022] DELETE /identity/v3/users/2a5299f8ed8a40ca86baaa6f69f2a676 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:36.509577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74028b31-b5db-496b-8913-72ee09b1948b admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:36.513960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-74028b31-b5db-496b-8913-72ee09b1948b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:36.585786 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74028b31-b5db-496b-8913-72ee09b1948b admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:36.638926 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f750d-f89b-4429-b3e0-1b8b90416d9b admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:36.640565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2b4f750d-f89b-4429-b3e0-1b8b90416d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:36.662589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15be9a-a7c0-433c-9f37-7d8ca906dc34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:36.663478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15be9a-a7c0-433c-9f37-7d8ca906dc34 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:36.663920 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15be9a-a7c0-433c-9f37-7d8ca906dc34 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:36.665138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15be9a-a7c0-433c-9f37-7d8ca906dc34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:36.668096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ae15be9a-a7c0-433c-9f37-7d8ca906dc34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:36.670125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:36.718987 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f750d-f89b-4429-b3e0-1b8b90416d9b admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:36.724200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6196bb-33c5-4e0c-bfd0-313366f1d21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:36.725092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6196bb-33c5-4e0c-bfd0-313366f1d21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:36.725473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6196bb-33c5-4e0c-bfd0-313366f1d21a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:36.725717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6196bb-33c5-4e0c-bfd0-313366f1d21a admin admin] PATH_INFO: `/v3/projects/2c5b7e6c7be948ec971336216d7aaf1c` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:36.726951 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6196bb-33c5-4e0c-bfd0-313366f1d21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5b7e6c7be948ec971336216d7aaf1c)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:36.728873 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6196bb-33c5-4e0c-bfd0-313366f1d21a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:36.733498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:36.761334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15be9a-a7c0-433c-9f37-7d8ca906dc34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:36.763005 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15be9a-a7c0-433c-9f37-7d8ca906dc34 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:36.782722 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1250/2467] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:08:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:36.877403 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fb6196bb-33c5-4e0c-bfd0-313366f1d21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5b7e6c7be948ec971336216d7aaf1c', 'request_id': 'req-fb6196bb-33c5-4e0c-bfd0-313366f1d21a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:37.007392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fb6196bb-33c5-4e0c-bfd0-313366f1d21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5b7e6c7be948ec971336216d7aaf1c', 'request_id': 'req-fb6196bb-33c5-4e0c-bfd0-313366f1d21a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:37.014337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fb6196bb-33c5-4e0c-bfd0-313366f1d21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5b7e6c7be948ec971336216d7aaf1c', 'request_id': 'req-fb6196bb-33c5-4e0c-bfd0-313366f1d21a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:37.025433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fb6196bb-33c5-4e0c-bfd0-313366f1d21a admin admin] The token cache is being invalidate because project 2c5b7e6c7be948ec971336216d7aaf1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:08:37.025723 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fb6196bb-33c5-4e0c-bfd0-313366f1d21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:37.026391 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-fb6196bb-33c5-4e0c-bfd0-313366f1d21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:37.027930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1218/2468] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:08:36 2022] DELETE /identity/v3/projects/2c5b7e6c7be948ec971336216d7aaf1c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:08:37.033521 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c04321-b4f2-462b-98ee-5d128fa60b96 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:37.033803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c04321-b4f2-462b-98ee-5d128fa60b96 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:37.034088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c04321-b4f2-462b-98ee-5d128fa60b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:37.071486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-93c04321-b4f2-462b-98ee-5d128fa60b96 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:37.072698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-93c04321-b4f2-462b-98ee-5d128fa60b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:37.133690 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1251/2469] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:37.141012 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae0758-11fa-46eb-8a56-5f8b1e63aba8 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:37.141314 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae0758-11fa-46eb-8a56-5f8b1e63aba8 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:37.141604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae0758-11fa-46eb-8a56-5f8b1e63aba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:37.164072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-2aae0758-11fa-46eb-8a56-5f8b1e63aba8 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:37.165296 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2aae0758-11fa-46eb-8a56-5f8b1e63aba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:37.173318 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1219/2470] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:37.178453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c04321-b4f2-462b-98ee-5d128fa60b96 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:37.188124 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c04321-b4f2-462b-98ee-5d128fa60b96 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:37.193795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91831b-092c-4221-b31f-edfcf097561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:37.194532 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91831b-092c-4221-b31f-edfcf097561e admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:37.194827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91831b-092c-4221-b31f-edfcf097561e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:37.195111 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91831b-092c-4221-b31f-edfcf097561e admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:37.195843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91831b-092c-4221-b31f-edfcf097561e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:08:37.196155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91831b-092c-4221-b31f-edfcf097561e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:37.197783 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91831b-092c-4221-b31f-edfcf097561e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:37.212497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1252/2471] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:08:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:08:37.216506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae0758-11fa-46eb-8a56-5f8b1e63aba8 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:37.227372 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae0758-11fa-46eb-8a56-5f8b1e63aba8 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:37.232077 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f76b53-f450-43d1-b205-4cd9e554dc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:37.232736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f76b53-f450-43d1-b205-4cd9e554dc5f admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:37.238699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f76b53-f450-43d1-b205-4cd9e554dc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:37.238699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f76b53-f450-43d1-b205-4cd9e554dc5f admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:37.238699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f76b53-f450-43d1-b205-4cd9e554dc5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:37.238699 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f76b53-f450-43d1-b205-4cd9e554dc5f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:37.341119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1220/2472] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:08:37 2022] POST /identity/v3/projects => generated 378 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:08:37.342739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91831b-092c-4221-b31f-edfcf097561e admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:37.356251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91831b-092c-4221-b31f-edfcf097561e admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:37.423933 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858724f7-5d73-4107-8793-7dd95bcc2907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:37.424718 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858724f7-5d73-4107-8793-7dd95bcc2907 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:37.425356 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858724f7-5d73-4107-8793-7dd95bcc2907 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:37.425763 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858724f7-5d73-4107-8793-7dd95bcc2907 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:37.426601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858724f7-5d73-4107-8793-7dd95bcc2907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:37.428994 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858724f7-5d73-4107-8793-7dd95bcc2907 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:37.522479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1253/2473] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:08:37 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:08:37.526702 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f76b53-f450-43d1-b205-4cd9e554dc5f admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:37.537451 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f76b53-f450-43d1-b205-4cd9e554dc5f admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:37.542517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b3d86-aa53-4290-acf0-9631e2466af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:37.543190 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b3d86-aa53-4290-acf0-9631e2466af3 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:37.543481 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b3d86-aa53-4290-acf0-9631e2466af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:37.543765 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b3d86-aa53-4290-acf0-9631e2466af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:37.544495 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b3d86-aa53-4290-acf0-9631e2466af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:37.546092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b3d86-aa53-4290-acf0-9631e2466af3 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:37.556941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1221/2474] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:37 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:37.562440 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858724f7-5d73-4107-8793-7dd95bcc2907 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:37.574622 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858724f7-5d73-4107-8793-7dd95bcc2907 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:37.579787 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b5e24-d36e-4ba6-b90f-90ff4a12de11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:37.580446 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b5e24-d36e-4ba6-b90f-90ff4a12de11 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:37.580733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b5e24-d36e-4ba6-b90f-90ff4a12de11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:37.581010 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b5e24-d36e-4ba6-b90f-90ff4a12de11 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:37.581976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b5e24-d36e-4ba6-b90f-90ff4a12de11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:37.583682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b5e24-d36e-4ba6-b90f-90ff4a12de11 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:37.594037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1254/2475] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:37 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:37.598529 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b3d86-aa53-4290-acf0-9631e2466af3 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:37.608691 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b3d86-aa53-4290-acf0-9631e2466af3 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:37.613988 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2ab10-fca6-4bdf-bb7f-4f4b0ddf9820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:37.614919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2ab10-fca6-4bdf-bb7f-4f4b0ddf9820 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:37.615317 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2ab10-fca6-4bdf-bb7f-4f4b0ddf9820 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:37.615608 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2ab10-fca6-4bdf-bb7f-4f4b0ddf9820 admin admin] PATH_INFO: `/v3/projects/f7360fec962c43c8886714b01c003d67/users/80b94848e2d04bcdba5c210e0511754d/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:37.631858 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2ab10-fca6-4bdf-bb7f-4f4b0ddf9820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7360fec962c43c8886714b01c003d67, user_id=80b94848e2d04bcdba5c210e0511754d, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:37.634598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2ab10-fca6-4bdf-bb7f-4f4b0ddf9820 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:37.746892 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1222/2476] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:37 2022] PUT /identity/v3/projects/f7360fec962c43c8886714b01c003d67/users/80b94848e2d04bcdba5c210e0511754d/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:37.759201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e19706-abec-4577-82d5-2daeb903106f None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:37.759669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e19706-abec-4577-82d5-2daeb903106f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:37.759944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e19706-abec-4577-82d5-2daeb903106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:37.785950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:37.789462 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-89e19706-abec-4577-82d5-2daeb903106f None None] MFA Rules not processed for user `80b94848e2d04bcdba5c210e0511754d`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:37.790834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-89e19706-abec-4577-82d5-2daeb903106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:37.855451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1255/2477] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:37.860140 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2ab10-fca6-4bdf-bb7f-4f4b0ddf9820 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:37.910444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:37.924614 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2ab10-fca6-4bdf-bb7f-4f4b0ddf9820 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:37.929983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129ea7d-c402-4b2e-b54a-52431847e515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:37.930731 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129ea7d-c402-4b2e-b54a-52431847e515 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:37.931020 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129ea7d-c402-4b2e-b54a-52431847e515 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:37.931294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129ea7d-c402-4b2e-b54a-52431847e515 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:37.931974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129ea7d-c402-4b2e-b54a-52431847e515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:37.933880 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129ea7d-c402-4b2e-b54a-52431847e515 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:38.040211 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1223/2478] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:08:37 2022] POST /identity/v3/projects => generated 378 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:08:38.044266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e19706-abec-4577-82d5-2daeb903106f None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:38.056931 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e19706-abec-4577-82d5-2daeb903106f None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:38.125327 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9bd46-73a2-44de-9970-1786a00ad309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:38.126003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9bd46-73a2-44de-9970-1786a00ad309 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:38.126292 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9bd46-73a2-44de-9970-1786a00ad309 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:38.126600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9bd46-73a2-44de-9970-1786a00ad309 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:38.127281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9bd46-73a2-44de-9970-1786a00ad309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:38.129225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9bd46-73a2-44de-9970-1786a00ad309 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:38.249278 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1256/2479] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:08:38 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:08:38.253657 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129ea7d-c402-4b2e-b54a-52431847e515 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:38.264263 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129ea7d-c402-4b2e-b54a-52431847e515 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:38.269370 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441fc8b-0cde-4d1e-bfcf-951319c23247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:38.270106 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441fc8b-0cde-4d1e-bfcf-951319c23247 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:38.270429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441fc8b-0cde-4d1e-bfcf-951319c23247 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:38.270704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441fc8b-0cde-4d1e-bfcf-951319c23247 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:38.271426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441fc8b-0cde-4d1e-bfcf-951319c23247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:38.273013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441fc8b-0cde-4d1e-bfcf-951319c23247 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:38.283447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1224/2480] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:38 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:38.288357 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9bd46-73a2-44de-9970-1786a00ad309 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:38.298399 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9bd46-73a2-44de-9970-1786a00ad309 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:38.303391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8331fc4-02a9-4d61-92fc-5f4b659763b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:38.304050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8331fc4-02a9-4d61-92fc-5f4b659763b3 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:38.304346 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8331fc4-02a9-4d61-92fc-5f4b659763b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:38.304628 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8331fc4-02a9-4d61-92fc-5f4b659763b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:38.305356 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8331fc4-02a9-4d61-92fc-5f4b659763b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:38.307000 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8331fc4-02a9-4d61-92fc-5f4b659763b3 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:38.317032 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1257/2481] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:38 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:08:38.321110 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441fc8b-0cde-4d1e-bfcf-951319c23247 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:38.331853 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441fc8b-0cde-4d1e-bfcf-951319c23247 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:38.336609 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc392d37-4358-4144-8ad7-ff96a012c9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:38.337479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc392d37-4358-4144-8ad7-ff96a012c9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:38.337758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc392d37-4358-4144-8ad7-ff96a012c9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:38.338035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc392d37-4358-4144-8ad7-ff96a012c9f2 admin admin] PATH_INFO: `/v3/projects/8a85ec41711e4e45bf0cd388b2c3db71/users/ee4f8dcdc51c45709cf09c356016eed8/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:38.353202 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc392d37-4358-4144-8ad7-ff96a012c9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a85ec41711e4e45bf0cd388b2c3db71, user_id=ee4f8dcdc51c45709cf09c356016eed8, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:38.355901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc392d37-4358-4144-8ad7-ff96a012c9f2 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:38.494840 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1225/2482] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:38 2022] PUT /identity/v3/projects/8a85ec41711e4e45bf0cd388b2c3db71/users/ee4f8dcdc51c45709cf09c356016eed8/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:38.558452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c4999-0e86-42d4-ae2f-d1daefa20047 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:38.559019 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c4999-0e86-42d4-ae2f-d1daefa20047 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:38.559019 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c4999-0e86-42d4-ae2f-d1daefa20047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:38.586865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-b07c4999-0e86-42d4-ae2f-d1daefa20047 None None] MFA Rules not processed for user `ee4f8dcdc51c45709cf09c356016eed8`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:38.588093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b07c4999-0e86-42d4-ae2f-d1daefa20047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:38.653690 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1258/2483] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:38.658199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc392d37-4358-4144-8ad7-ff96a012c9f2 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:38.720379 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc392d37-4358-4144-8ad7-ff96a012c9f2 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:38.725651 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0f960-f469-45dd-a42a-812894ae4e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:38.726312 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0f960-f469-45dd-a42a-812894ae4e2d admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:38.726648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0f960-f469-45dd-a42a-812894ae4e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:38.726915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0f960-f469-45dd-a42a-812894ae4e2d admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:38.727610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0f960-f469-45dd-a42a-812894ae4e2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:38.729522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0f960-f469-45dd-a42a-812894ae4e2d admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:38.818508 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1226/2484] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:08:38 2022] POST /identity/v3/projects => generated 376 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:08:38.822246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c4999-0e86-42d4-ae2f-d1daefa20047 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:38.837038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c4999-0e86-42d4-ae2f-d1daefa20047 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:38.849363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:38.857531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0f960-f469-45dd-a42a-812894ae4e2d admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:38.859943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b7f0f960-f469-45dd-a42a-812894ae4e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:38.910738 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d71c2-29cd-4243-a7d8-c424fb6c2926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:38.911441 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d71c2-29cd-4243-a7d8-c424fb6c2926 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:38.911729 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d71c2-29cd-4243-a7d8-c424fb6c2926 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:38.912012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d71c2-29cd-4243-a7d8-c424fb6c2926 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:38.912710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d71c2-29cd-4243-a7d8-c424fb6c2926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:38.915059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d71c2-29cd-4243-a7d8-c424fb6c2926 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:38.922211 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0f960-f469-45dd-a42a-812894ae4e2d admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:38.926491 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe450ed-e69f-4672-a175-3b99662d8f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:38.927141 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe450ed-e69f-4672-a175-3b99662d8f4d service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:38.927432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe450ed-e69f-4672-a175-3b99662d8f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:38.927714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe450ed-e69f-4672-a175-3b99662d8f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:38.929590 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7fe450ed-e69f-4672-a175-3b99662d8f4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:38.939446 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe450ed-e69f-4672-a175-3b99662d8f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:38.942738 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe450ed-e69f-4672-a175-3b99662d8f4d service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:38.948952 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1227/2485] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:08:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:08:39.032183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1259/2486] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:08:38 2022] POST /identity/v3/users => generated 295 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:08:39.036751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe450ed-e69f-4672-a175-3b99662d8f4d service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:39.048363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe450ed-e69f-4672-a175-3b99662d8f4d service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:39.053078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992e14e-fb30-493f-9f56-83e01d0d0511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:39.053749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992e14e-fb30-493f-9f56-83e01d0d0511 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:39.054034 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992e14e-fb30-493f-9f56-83e01d0d0511 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:39.054314 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992e14e-fb30-493f-9f56-83e01d0d0511 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:39.055066 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992e14e-fb30-493f-9f56-83e01d0d0511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:39.056708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992e14e-fb30-493f-9f56-83e01d0d0511 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:39.070897 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1228/2487] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:39 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:08:39.072075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d71c2-29cd-4243-a7d8-c424fb6c2926 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:39.083015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d71c2-29cd-4243-a7d8-c424fb6c2926 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:39.087825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ae7b8-b028-4317-878d-0c7314cde5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:39.088719 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ae7b8-b028-4317-878d-0c7314cde5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:39.089001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ae7b8-b028-4317-878d-0c7314cde5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:39.089284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ae7b8-b028-4317-878d-0c7314cde5b3 admin admin] PATH_INFO: `/v3/projects/dd1e164d87bf4411a93917e3ffb0f9f7/users/00da221dfcb24b60aff2cad2ca7d09d5/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:39.106539 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ae7b8-b028-4317-878d-0c7314cde5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1e164d87bf4411a93917e3ffb0f9f7, user_id=00da221dfcb24b60aff2cad2ca7d09d5, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:39.109199 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ae7b8-b028-4317-878d-0c7314cde5b3 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:39.222065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1260/2488] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:39 2022] PUT /identity/v3/projects/dd1e164d87bf4411a93917e3ffb0f9f7/users/00da221dfcb24b60aff2cad2ca7d09d5/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:39.226598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992e14e-fb30-493f-9f56-83e01d0d0511 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:39.237234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992e14e-fb30-493f-9f56-83e01d0d0511 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:39.248111 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:39.297210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767aaa4-083c-4d50-8c7a-f4811f67bb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:39.297884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767aaa4-083c-4d50-8c7a-f4811f67bb50 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:39.298958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767aaa4-083c-4d50-8c7a-f4811f67bb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:39.299254 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767aaa4-083c-4d50-8c7a-f4811f67bb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:39.300030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767aaa4-083c-4d50-8c7a-f4811f67bb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:39.301885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767aaa4-083c-4d50-8c7a-f4811f67bb50 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:39.312060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1229/2489] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:08:39 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:08:39.317232 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ae7b8-b028-4317-878d-0c7314cde5b3 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:39.327988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ae7b8-b028-4317-878d-0c7314cde5b3 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:39.333923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c130e4f-6024-4733-90da-85b63909f290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:39.335097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c130e4f-6024-4733-90da-85b63909f290 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:39.335390 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c130e4f-6024-4733-90da-85b63909f290 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:39.335707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c130e4f-6024-4733-90da-85b63909f290 admin admin] PATH_INFO: `/v3/projects/dd1e164d87bf4411a93917e3ffb0f9f7/users/00da221dfcb24b60aff2cad2ca7d09d5/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:39.338073 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c130e4f-6024-4733-90da-85b63909f290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1e164d87bf4411a93917e3ffb0f9f7, user_id=00da221dfcb24b60aff2cad2ca7d09d5, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:39.341364 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c130e4f-6024-4733-90da-85b63909f290 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:39.354123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1261/2490] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:08:39 2022] PUT /identity/v3/projects/dd1e164d87bf4411a93917e3ffb0f9f7/users/00da221dfcb24b60aff2cad2ca7d09d5/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:39.366396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd77b5b-18d2-4d14-91b3-7ab8dd36c0b6 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:39.367206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd77b5b-18d2-4d14-91b3-7ab8dd36c0b6 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:39.367735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd77b5b-18d2-4d14-91b3-7ab8dd36c0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:39.396051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-dcd77b5b-18d2-4d14-91b3-7ab8dd36c0b6 None None] MFA Rules not processed for user `00da221dfcb24b60aff2cad2ca7d09d5`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:39.397262 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-dcd77b5b-18d2-4d14-91b3-7ab8dd36c0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:39.472035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1230/2491] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:39.483512 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c130e4f-6024-4733-90da-85b63909f290 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:39.485218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-2c130e4f-6024-4733-90da-85b63909f290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:39.575599 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c130e4f-6024-4733-90da-85b63909f290 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:39.582761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b059742-54aa-4b15-9574-791857617f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:39.583673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b059742-54aa-4b15-9574-791857617f3d service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:39.584002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b059742-54aa-4b15-9574-791857617f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:39.584363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b059742-54aa-4b15-9574-791857617f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:39.599724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b059742-54aa-4b15-9574-791857617f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:39.601437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b059742-54aa-4b15-9574-791857617f3d service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:39.612972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1262/2492] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:08:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:39.779464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd77b5b-18d2-4d14-91b3-7ab8dd36c0b6 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:39.789204 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd77b5b-18d2-4d14-91b3-7ab8dd36c0b6 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:39.793316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167284c7-3a4c-4f79-ac2a-3e2ac45257a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:39.793316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167284c7-3a4c-4f79-ac2a-3e2ac45257a1 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:39.793626 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167284c7-3a4c-4f79-ac2a-3e2ac45257a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:39.793907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167284c7-3a4c-4f79-ac2a-3e2ac45257a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:39.850844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167284c7-3a4c-4f79-ac2a-3e2ac45257a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:39.852228 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167284c7-3a4c-4f79-ac2a-3e2ac45257a1 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:39.862345 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1231/2493] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:08:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:49.607600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=65,keystone:INSERT=5 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:49.857210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=85 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:53.211886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ba61a-2d21-4046-9dc9-42725541cd5e None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:53.212573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ba61a-2d21-4046-9dc9-42725541cd5e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:53.212573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ba61a-2d21-4046-9dc9-42725541cd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:53.242145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-3f4ba61a-2d21-4046-9dc9-42725541cd5e None None] MFA Rules not processed for user `289cb250e20344d28bd5fd17255d5896`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:53.243576 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-3f4ba61a-2d21-4046-9dc9-42725541cd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:53.300208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1263/2494] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:08:54.265368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167284c7-3a4c-4f79-ac2a-3e2ac45257a1 service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:54.266838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-167284c7-3a4c-4f79-ac2a-3e2ac45257a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:54.344118 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167284c7-3a4c-4f79-ac2a-3e2ac45257a1 service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:54.350674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb61ac-d7b0-4a1f-aa46-480616eea976 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:54.351331 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb61ac-d7b0-4a1f-aa46-480616eea976 service placement] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:54.351619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb61ac-d7b0-4a1f-aa46-480616eea976 service placement] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:54.351899 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb61ac-d7b0-4a1f-aa46-480616eea976 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:54.353743 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-cdfb61ac-d7b0-4a1f-aa46-480616eea976 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:54.366601 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb61ac-d7b0-4a1f-aa46-480616eea976 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:54.368210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb61ac-d7b0-4a1f-aa46-480616eea976 service placement] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:54.378256 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1232/2495] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:08:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:56.721584 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3d163-97a2-4d98-9795-beea303482a4 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:56.722510 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3d163-97a2-4d98-9795-beea303482a4 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:56.722510 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3d163-97a2-4d98-9795-beea303482a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:56.742583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-98c3d163-97a2-4d98-9795-beea303482a4 None None] MFA Rules not processed for user `530b2b1951644755afd1432381cf37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:56.743797 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-98c3d163-97a2-4d98-9795-beea303482a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:56.807886 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1264/2496] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:08:56.871225 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb61ac-d7b0-4a1f-aa46-480616eea976 service placement] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:56.973882 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb61ac-d7b0-4a1f-aa46-480616eea976 service placement] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:56.979548 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30787058-1886-4361-b3fd-3906b1c77eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:56.981059 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30787058-1886-4361-b3fd-3906b1c77eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:56.981866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30787058-1886-4361-b3fd-3906b1c77eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:56.982292 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30787058-1886-4361-b3fd-3906b1c77eb8 admin admin] PATH_INFO: `/v3/users/80b94848e2d04bcdba5c210e0511754d` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:56.983794 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30787058-1886-4361-b3fd-3906b1c77eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80b94848e2d04bcdba5c210e0511754d)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:56.986207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30787058-1886-4361-b3fd-3906b1c77eb8 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:57.377478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-30787058-1886-4361-b3fd-3906b1c77eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80b94848e2d04bcdba5c210e0511754d'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:57.378169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-30787058-1886-4361-b3fd-3906b1c77eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80b94848e2d04bcdba5c210e0511754d'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:57.379714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-30787058-1886-4361-b3fd-3906b1c77eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80b94848e2d04bcdba5c210e0511754d'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:57.459798 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-30787058-1886-4361-b3fd-3906b1c77eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80b94848e2d04bcdba5c210e0511754d'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:57.478133 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-30787058-1886-4361-b3fd-3906b1c77eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80b94848e2d04bcdba5c210e0511754d'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:57.498735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1233/2497] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:08:56 2022] DELETE /identity/v3/users/80b94848e2d04bcdba5c210e0511754d => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:08:57.504255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec24f65-fb8a-4c65-b2c1-e5e1029d0015 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:57.504940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec24f65-fb8a-4c65-b2c1-e5e1029d0015 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:57.505300 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec24f65-fb8a-4c65-b2c1-e5e1029d0015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:57.526311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-2ec24f65-fb8a-4c65-b2c1-e5e1029d0015 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:57.527761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-2ec24f65-fb8a-4c65-b2c1-e5e1029d0015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:57.625552 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1265/2498] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:57.636221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30787058-1886-4361-b3fd-3906b1c77eb8 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:57.643199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-30787058-1886-4361-b3fd-3906b1c77eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:57.656298 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:57.722668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30787058-1886-4361-b3fd-3906b1c77eb8 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:57.730984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e3039-4268-49d1-86c3-ee72a03eeaf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:57.730984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e3039-4268-49d1-86c3-ee72a03eeaf3 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:57.730984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e3039-4268-49d1-86c3-ee72a03eeaf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:57.730984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e3039-4268-49d1-86c3-ee72a03eeaf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:57.741119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e3039-4268-49d1-86c3-ee72a03eeaf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:57.743155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e3039-4268-49d1-86c3-ee72a03eeaf3 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:57.756327 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1234/2499] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:58.307636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec24f65-fb8a-4c65-b2c1-e5e1029d0015 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:58.308161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-2ec24f65-fb8a-4c65-b2c1-e5e1029d0015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:58.329751 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec24f65-fb8a-4c65-b2c1-e5e1029d0015 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:58.338788 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6aa97-f942-4292-ab31-227870c062a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:58.338788 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6aa97-f942-4292-ab31-227870c062a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:58.338788 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6aa97-f942-4292-ab31-227870c062a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:58.339653 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6aa97-f942-4292-ab31-227870c062a1 admin admin] PATH_INFO: `/v3/projects/f7360fec962c43c8886714b01c003d67` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:58.340389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6aa97-f942-4292-ab31-227870c062a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7360fec962c43c8886714b01c003d67)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:58.342969 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6aa97-f942-4292-ab31-227870c062a1 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:58.525177 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:58.543406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-67d6aa97-f942-4292-ab31-227870c062a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7360fec962c43c8886714b01c003d67', 'request_id': 'req-67d6aa97-f942-4292-ab31-227870c062a1'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:58.614717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-67d6aa97-f942-4292-ab31-227870c062a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7360fec962c43c8886714b01c003d67', 'request_id': 'req-67d6aa97-f942-4292-ab31-227870c062a1'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:58.624016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-67d6aa97-f942-4292-ab31-227870c062a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7360fec962c43c8886714b01c003d67', 'request_id': 'req-67d6aa97-f942-4292-ab31-227870c062a1'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:58.638852 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-67d6aa97-f942-4292-ab31-227870c062a1 admin admin] The token cache is being invalidate because project f7360fec962c43c8886714b01c003d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:08:58.639685 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-67d6aa97-f942-4292-ab31-227870c062a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:58.640724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-67d6aa97-f942-4292-ab31-227870c062a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:58.643151 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1266/2500] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:08:58 2022] DELETE /identity/v3/projects/f7360fec962c43c8886714b01c003d67 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:58.647321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e3039-4268-49d1-86c3-ee72a03eeaf3 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:58.661546 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e3039-4268-49d1-86c3-ee72a03eeaf3 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:58.733274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e70dd-cd37-4e6a-9fe8-87658e087dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:58.734425 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e70dd-cd37-4e6a-9fe8-87658e087dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:58.734776 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e70dd-cd37-4e6a-9fe8-87658e087dee admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:58.735072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e70dd-cd37-4e6a-9fe8-87658e087dee admin admin] PATH_INFO: `/v3/users/ee4f8dcdc51c45709cf09c356016eed8` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:58.736419 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e70dd-cd37-4e6a-9fe8-87658e087dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4f8dcdc51c45709cf09c356016eed8)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:58.739195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e70dd-cd37-4e6a-9fe8-87658e087dee admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:58.978638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0f8e70dd-cd37-4e6a-9fe8-87658e087dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4f8dcdc51c45709cf09c356016eed8'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:58.979556 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0f8e70dd-cd37-4e6a-9fe8-87658e087dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4f8dcdc51c45709cf09c356016eed8'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:58.980515 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0f8e70dd-cd37-4e6a-9fe8-87658e087dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4f8dcdc51c45709cf09c356016eed8'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:59.110977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0f8e70dd-cd37-4e6a-9fe8-87658e087dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4f8dcdc51c45709cf09c356016eed8'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:59.130545 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0f8e70dd-cd37-4e6a-9fe8-87658e087dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4f8dcdc51c45709cf09c356016eed8'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:59.150433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1235/2501] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:08:58 2022] DELETE /identity/v3/users/ee4f8dcdc51c45709cf09c356016eed8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:59.736555 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6aa97-f942-4292-ab31-227870c062a1 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:59.741446 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-67d6aa97-f942-4292-ab31-227870c062a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:59.755693 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6aa97-f942-4292-ab31-227870c062a1 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:59.838795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc3cd3-5a16-4033-b936-24386caa0160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:59.839660 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc3cd3-5a16-4033-b936-24386caa0160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:59.839944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc3cd3-5a16-4033-b936-24386caa0160 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:59.840217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc3cd3-5a16-4033-b936-24386caa0160 admin admin] PATH_INFO: `/v3/projects/8a85ec41711e4e45bf0cd388b2c3db71` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:59.841478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc3cd3-5a16-4033-b936-24386caa0160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a85ec41711e4e45bf0cd388b2c3db71)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:59.843424 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc3cd3-5a16-4033-b936-24386caa0160 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:00.017529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a6bc3cd3-5a16-4033-b936-24386caa0160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a85ec41711e4e45bf0cd388b2c3db71', 'request_id': 'req-a6bc3cd3-5a16-4033-b936-24386caa0160'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:09:00.127748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a6bc3cd3-5a16-4033-b936-24386caa0160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a85ec41711e4e45bf0cd388b2c3db71', 'request_id': 'req-a6bc3cd3-5a16-4033-b936-24386caa0160'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:09:00.135367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a6bc3cd3-5a16-4033-b936-24386caa0160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a85ec41711e4e45bf0cd388b2c3db71', 'request_id': 'req-a6bc3cd3-5a16-4033-b936-24386caa0160'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:09:00.147026 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a6bc3cd3-5a16-4033-b936-24386caa0160 admin admin] The token cache is being invalidate because project 8a85ec41711e4e45bf0cd388b2c3db71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:09:00.147316 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a6bc3cd3-5a16-4033-b936-24386caa0160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:09:00.148012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a6bc3cd3-5a16-4033-b936-24386caa0160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:09:00.149718 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1267/2502] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:08:59 2022] DELETE /identity/v3/projects/8a85ec41711e4e45bf0cd388b2c3db71 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:09:00.153888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e70dd-cd37-4e6a-9fe8-87658e087dee admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:00.155453 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0f8e70dd-cd37-4e6a-9fe8-87658e087dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:00.169801 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e70dd-cd37-4e6a-9fe8-87658e087dee admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:00.209546 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:00.248961 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef8839-5ce1-4d64-bab2-6baa128ba765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:00.249854 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef8839-5ce1-4d64-bab2-6baa128ba765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:00.250142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef8839-5ce1-4d64-bab2-6baa128ba765 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:00.250465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef8839-5ce1-4d64-bab2-6baa128ba765 admin admin] PATH_INFO: `/v3/users/00da221dfcb24b60aff2cad2ca7d09d5` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:00.251672 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef8839-5ce1-4d64-bab2-6baa128ba765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00da221dfcb24b60aff2cad2ca7d09d5)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:00.253654 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef8839-5ce1-4d64-bab2-6baa128ba765 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:00.452443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-7fef8839-5ce1-4d64-bab2-6baa128ba765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00da221dfcb24b60aff2cad2ca7d09d5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:09:00.453405 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-7fef8839-5ce1-4d64-bab2-6baa128ba765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00da221dfcb24b60aff2cad2ca7d09d5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:09:00.454035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-7fef8839-5ce1-4d64-bab2-6baa128ba765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00da221dfcb24b60aff2cad2ca7d09d5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:09:00.537651 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-7fef8839-5ce1-4d64-bab2-6baa128ba765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00da221dfcb24b60aff2cad2ca7d09d5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:09:00.549954 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-7fef8839-5ce1-4d64-bab2-6baa128ba765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00da221dfcb24b60aff2cad2ca7d09d5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:09:00.563511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1236/2503] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:09:00 2022] DELETE /identity/v3/users/00da221dfcb24b60aff2cad2ca7d09d5 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:09:01.101183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc3cd3-5a16-4033-b936-24386caa0160 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:01.104205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a6bc3cd3-5a16-4033-b936-24386caa0160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:01.134260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc3cd3-5a16-4033-b936-24386caa0160 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:01.192189 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:01.200586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691821e8-168c-47d7-8171-48f7eca3f369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:01.202181 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691821e8-168c-47d7-8171-48f7eca3f369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:01.202586 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691821e8-168c-47d7-8171-48f7eca3f369 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:01.203100 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691821e8-168c-47d7-8171-48f7eca3f369 admin admin] PATH_INFO: `/v3/projects/dd1e164d87bf4411a93917e3ffb0f9f7` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:01.204699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691821e8-168c-47d7-8171-48f7eca3f369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1e164d87bf4411a93917e3ffb0f9f7)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:01.206452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691821e8-168c-47d7-8171-48f7eca3f369 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:01.358477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-691821e8-168c-47d7-8171-48f7eca3f369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1e164d87bf4411a93917e3ffb0f9f7', 'request_id': 'req-691821e8-168c-47d7-8171-48f7eca3f369'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:09:01.418815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-691821e8-168c-47d7-8171-48f7eca3f369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1e164d87bf4411a93917e3ffb0f9f7', 'request_id': 'req-691821e8-168c-47d7-8171-48f7eca3f369'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:09:01.426341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-691821e8-168c-47d7-8171-48f7eca3f369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1e164d87bf4411a93917e3ffb0f9f7', 'request_id': 'req-691821e8-168c-47d7-8171-48f7eca3f369'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:09:01.437154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-691821e8-168c-47d7-8171-48f7eca3f369 admin admin] The token cache is being invalidate because project dd1e164d87bf4411a93917e3ffb0f9f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:09:01.437429 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-691821e8-168c-47d7-8171-48f7eca3f369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:09:01.438100 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-691821e8-168c-47d7-8171-48f7eca3f369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:09:01.439689 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1268/2504] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:09:01 2022] DELETE /identity/v3/projects/dd1e164d87bf4411a93917e3ffb0f9f7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:09:10.797957 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=39,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:11.510954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:17.043648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688a4dc-2fe4-4e44-b20b-9456d7c9cc84 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:17.048362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688a4dc-2fe4-4e44-b20b-9456d7c9cc84 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:17.048362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688a4dc-2fe4-4e44-b20b-9456d7c9cc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:17.073746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-7688a4dc-2fe4-4e44-b20b-9456d7c9cc84 None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:09:17.076074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7688a4dc-2fe4-4e44-b20b-9456d7c9cc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:17.133230 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1237/2505] 10.222.0.112 () {58 vars in 1014 bytes} [Thu May 26 17:09:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:09:17.377145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691821e8-168c-47d7-8171-48f7eca3f369 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:17.379351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-691821e8-168c-47d7-8171-48f7eca3f369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:17.452013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691821e8-168c-47d7-8171-48f7eca3f369 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:17.458231 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf231f7-e996-4cc0-a49a-cf0f92b6bbfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:17.458932 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf231f7-e996-4cc0-a49a-cf0f92b6bbfd service swift] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:17.459216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf231f7-e996-4cc0-a49a-cf0f92b6bbfd service swift] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:17.459494 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf231f7-e996-4cc0-a49a-cf0f92b6bbfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:17.467842 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf231f7-e996-4cc0-a49a-cf0f92b6bbfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:17.469423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf231f7-e996-4cc0-a49a-cf0f92b6bbfd service swift] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:17.477963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1269/2506] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 17:09:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:09:27.126480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=29 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:27.475068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=32 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:31.628943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688a4dc-2fe4-4e44-b20b-9456d7c9cc84 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:31.630375 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7688a4dc-2fe4-4e44-b20b-9456d7c9cc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:31.686335 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688a4dc-2fe4-4e44-b20b-9456d7c9cc84 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:31.689937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a7df5-edd4-4c1d-a045-b67ddc81e9c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:31.690718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a7df5-edd4-4c1d-a045-b67ddc81e9c9 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:31.691010 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a7df5-edd4-4c1d-a045-b67ddc81e9c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:31.691287 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a7df5-edd4-4c1d-a045-b67ddc81e9c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:31.693043 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-fd4a7df5-edd4-4c1d-a045-b67ddc81e9c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:31.758960 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a7df5-edd4-4c1d-a045-b67ddc81e9c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:31.760401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a7df5-edd4-4c1d-a045-b67ddc81e9c9 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:31.771213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1238/2507] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:09:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:09:35.166732 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf231f7-e996-4cc0-a49a-cf0f92b6bbfd service swift] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:35.168177 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7bf231f7-e996-4cc0-a49a-cf0f92b6bbfd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:35.254421 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf231f7-e996-4cc0-a49a-cf0f92b6bbfd service swift] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:35.261714 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66cc4f-e1bc-49bc-accb-34d449673f09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:35.262406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66cc4f-e1bc-49bc-accb-34d449673f09 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:35.262692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66cc4f-e1bc-49bc-accb-34d449673f09 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:35.262970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66cc4f-e1bc-49bc-accb-34d449673f09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:35.264765 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ba66cc4f-e1bc-49bc-accb-34d449673f09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:35.278017 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66cc4f-e1bc-49bc-accb-34d449673f09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:35.279652 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66cc4f-e1bc-49bc-accb-34d449673f09 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:35.291245 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1270/2508] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:09:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:09:38.996219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a7df5-edd4-4c1d-a045-b67ddc81e9c9 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:38.997732 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-fd4a7df5-edd4-4c1d-a045-b67ddc81e9c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:39.058726 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a7df5-edd4-4c1d-a045-b67ddc81e9c9 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:39.062387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed033fa-7555-4ec9-b42b-ddc4c301854c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf32c811ead4fd0b69c83890a56509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:39.063102 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed033fa-7555-4ec9-b42b-ddc4c301854c service glance] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:39.063391 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed033fa-7555-4ec9-b42b-ddc4c301854c service glance] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:39.063676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed033fa-7555-4ec9-b42b-ddc4c301854c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:39.065575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1ed033fa-7555-4ec9-b42b-ddc4c301854c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:39.079683 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed033fa-7555-4ec9-b42b-ddc4c301854c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:39.081166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed033fa-7555-4ec9-b42b-ddc4c301854c service glance] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:39.092950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1239/2509] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:09:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:09:39.292206 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66cc4f-e1bc-49bc-accb-34d449673f09 service nova] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:39.293753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ba66cc4f-e1bc-49bc-accb-34d449673f09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:39.305542 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66cc4f-e1bc-49bc-accb-34d449673f09 service nova] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:39.309251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156311c-2b3b-4a07-8e95-31105e2ab2ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:39.309892 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156311c-2b3b-4a07-8e95-31105e2ab2ee service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:39.310197 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156311c-2b3b-4a07-8e95-31105e2ab2ee service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:39.310510 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156311c-2b3b-4a07-8e95-31105e2ab2ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:39.312193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c156311c-2b3b-4a07-8e95-31105e2ab2ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:39.322144 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156311c-2b3b-4a07-8e95-31105e2ab2ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:39.323616 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156311c-2b3b-4a07-8e95-31105e2ab2ee service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:39.333691 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1271/2510] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:09:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:09:39.407541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed033fa-7555-4ec9-b42b-ddc4c301854c service glance] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:39.417817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed033fa-7555-4ec9-b42b-ddc4c301854c service glance] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:39.421501 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee3dbb-d206-4b35-a7c1-c9a60c31e90a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:39.422137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee3dbb-d206-4b35-a7c1-c9a60c31e90a service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:39.422456 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee3dbb-d206-4b35-a7c1-c9a60c31e90a service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:39.422736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee3dbb-d206-4b35-a7c1-c9a60c31e90a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:39.424489 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b8ee3dbb-d206-4b35-a7c1-c9a60c31e90a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:39.437692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee3dbb-d206-4b35-a7c1-c9a60c31e90a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:39.439148 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee3dbb-d206-4b35-a7c1-c9a60c31e90a service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:39.449881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1240/2511] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:09:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:09:42.541358 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfba63-a1ad-47f2-8585-ca89c799ce7c None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:42.541881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfba63-a1ad-47f2-8585-ca89c799ce7c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:42.541989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfba63-a1ad-47f2-8585-ca89c799ce7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:42.561232 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-25cfba63-a1ad-47f2-8585-ca89c799ce7c None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:09:42.562478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-25cfba63-a1ad-47f2-8585-ca89c799ce7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:42.570869 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1272/2512] 10.222.0.112 () {58 vars in 1014 bytes} [Thu May 26 17:09:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:09:42.583026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee3dbb-d206-4b35-a7c1-c9a60c31e90a service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:42.594121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee3dbb-d206-4b35-a7c1-c9a60c31e90a service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:42.599396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a265486-aba2-4523-8a1b-144b8f14cb91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:42.600053 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a265486-aba2-4523-8a1b-144b8f14cb91 service swift] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:42.600345 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a265486-aba2-4523-8a1b-144b8f14cb91 service swift] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:42.600632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a265486-aba2-4523-8a1b-144b8f14cb91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:42.609189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a265486-aba2-4523-8a1b-144b8f14cb91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:42.610842 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a265486-aba2-4523-8a1b-144b8f14cb91 service swift] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:42.620082 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1241/2513] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 17:09:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:09:52.556211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=43 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:52.616452 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=88 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:17.497880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209df060-57b0-4f65-b248-ae4bb6f75999 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:17.498481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209df060-57b0-4f65-b248-ae4bb6f75999 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:17.498589 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209df060-57b0-4f65-b248-ae4bb6f75999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:17.547823 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-209df060-57b0-4f65-b248-ae4bb6f75999 None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:17.549038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-209df060-57b0-4f65-b248-ae4bb6f75999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:17.573927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1273/2514] 10.222.0.112 () {58 vars in 972 bytes} [Thu May 26 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:17.596306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a265486-aba2-4523-8a1b-144b8f14cb91 service swift] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:17.617354 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a265486-aba2-4523-8a1b-144b8f14cb91 service swift] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:17.622432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf138ec1-5ec0-4192-a5cd-01c806b39fd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:17.628684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf138ec1-5ec0-4192-a5cd-01c806b39fd1 service swift] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:17.628684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf138ec1-5ec0-4192-a5cd-01c806b39fd1 service swift] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:17.628684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf138ec1-5ec0-4192-a5cd-01c806b39fd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:17.632476 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf138ec1-5ec0-4192-a5cd-01c806b39fd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:17.634049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf138ec1-5ec0-4192-a5cd-01c806b39fd1 service swift] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:17.641996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1242/2515] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 17:10:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 17:10:21.651448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209df060-57b0-4f65-b248-ae4bb6f75999 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:21.673519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209df060-57b0-4f65-b248-ae4bb6f75999 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:21.679357 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f05f0-f3fa-47fd-8144-1695d984125e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:21.679999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f05f0-f3fa-47fd-8144-1695d984125e service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:21.680284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f05f0-f3fa-47fd-8144-1695d984125e service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:21.680567 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f05f0-f3fa-47fd-8144-1695d984125e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:21.682316 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a86f05f0-f3fa-47fd-8144-1695d984125e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:21.761147 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f05f0-f3fa-47fd-8144-1695d984125e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:21.762777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f05f0-f3fa-47fd-8144-1695d984125e service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:21.781292 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1274/2516] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:10:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:27.638931 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=10 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:31.778623 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=66 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:59.699540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b499fa-ea29-4623-b32a-6c0a4555ba4a None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:59.700132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b499fa-ea29-4623-b32a-6c0a4555ba4a None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:59.700132 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b499fa-ea29-4623-b32a-6c0a4555ba4a None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:59.702306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1243/2517] 10.222.0.112 () {54 vars in 926 bytes} [Thu May 26 17:10:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:10:59.714817 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd40216-6635-4d12-bf19-d9ea3a127c99 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:59.715314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd40216-6635-4d12-bf19-d9ea3a127c99 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:59.715408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd40216-6635-4d12-bf19-d9ea3a127c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:59.738674 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b499fa-ea29-4623-b32a-6c0a4555ba4a None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:59.741678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b7b499fa-ea29-4623-b32a-6c0a4555ba4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:59.800011 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b499fa-ea29-4623-b32a-6c0a4555ba4a None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:59.807079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d5d03-3bc8-4d99-bbfa-1fba625cdaae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:59.807809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d5d03-3bc8-4d99-bbfa-1fba625cdaae service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:59.808101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d5d03-3bc8-4d99-bbfa-1fba625cdaae service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:59.808531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d5d03-3bc8-4d99-bbfa-1fba625cdaae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:59.810721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0e6d5d03-3bc8-4d99-bbfa-1fba625cdaae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:59.816819 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-edd40216-6635-4d12-bf19-d9ea3a127c99 None None] MFA Rules not processed for user `0288901db0244eab9a737af460ce1bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:59.817863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-edd40216-6635-4d12-bf19-d9ea3a127c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:59.826972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1275/2518] 10.222.0.112 () {58 vars in 1023 bytes} [Thu May 26 17:10:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:59.828664 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d5d03-3bc8-4d99-bbfa-1fba625cdaae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:59.830614 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d5d03-3bc8-4d99-bbfa-1fba625cdaae service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:59.842900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd40216-6635-4d12-bf19-d9ea3a127c99 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:59.854624 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1244/2519] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:10:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:10:59.859082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd40216-6635-4d12-bf19-d9ea3a127c99 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:59.862558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1826157-4e81-4cc5-8f6e-1743915df9cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:59.863479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1826157-4e81-4cc5-8f6e-1743915df9cc service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:59.864075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1826157-4e81-4cc5-8f6e-1743915df9cc service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:59.864593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1826157-4e81-4cc5-8f6e-1743915df9cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:59.874463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1826157-4e81-4cc5-8f6e-1743915df9cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:59.876628 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1826157-4e81-4cc5-8f6e-1743915df9cc service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:59.898737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1276/2520] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:10:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:59.996904 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83784c60-5f07-4b1c-80b4-088bea3c88c2 None None] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:59.997698 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83784c60-5f07-4b1c-80b4-088bea3c88c2 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:59.998008 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83784c60-5f07-4b1c-80b4-088bea3c88c2 None None] PATH_INFO: `/` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:59.999943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1245/2521] 10.222.0.112 () {54 vars in 926 bytes} [Thu May 26 17:10:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:11:00.006772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18a547-b638-45a4-ac0e-429fd01c381d None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:00.007070 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18a547-b638-45a4-ac0e-429fd01c381d None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:00.014807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18a547-b638-45a4-ac0e-429fd01c381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:00.029606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-8f18a547-b638-45a4-ac0e-429fd01c381d None None] MFA Rules not processed for user `5f2ec4c76f8f4d858bce53f30cc198fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:00.031123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8f18a547-b638-45a4-ac0e-429fd01c381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:00.042369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1277/2522] 10.222.0.112 () {58 vars in 1023 bytes} [Thu May 26 17:11:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:11:00.054817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83784c60-5f07-4b1c-80b4-088bea3c88c2 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:00.068070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83784c60-5f07-4b1c-80b4-088bea3c88c2 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:00.072761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248435c8-560a-4436-9943-ac2f0b3c5ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:00.073431 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248435c8-560a-4436-9943-ac2f0b3c5ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:00.073717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248435c8-560a-4436-9943-ac2f0b3c5ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:00.074000 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248435c8-560a-4436-9943-ac2f0b3c5ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:00.086983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248435c8-560a-4436-9943-ac2f0b3c5ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:00.088513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248435c8-560a-4436-9943-ac2f0b3c5ac1 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:00.102470 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1246/2523] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:06.309075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18a547-b638-45a4-ac0e-429fd01c381d None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:06.324874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18a547-b638-45a4-ac0e-429fd01c381d None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:06.331298 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf69cfb-98c5-4b7a-9cc7-855dd5d3fe7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:06.331298 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf69cfb-98c5-4b7a-9cc7-855dd5d3fe7f service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:06.331298 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf69cfb-98c5-4b7a-9cc7-855dd5d3fe7f service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:06.331298 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf69cfb-98c5-4b7a-9cc7-855dd5d3fe7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:06.331791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-9cf69cfb-98c5-4b7a-9cc7-855dd5d3fe7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:06.394725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf69cfb-98c5-4b7a-9cc7-855dd5d3fe7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:06.396226 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf69cfb-98c5-4b7a-9cc7-855dd5d3fe7f service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:06.406398 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1278/2524] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:10.095971 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=17 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:10.387221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248435c8-560a-4436-9943-ac2f0b3c5ac1 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:10.388842 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-248435c8-560a-4436-9943-ac2f0b3c5ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:10.405457 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248435c8-560a-4436-9943-ac2f0b3c5ac1 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:10.410731 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2aa531-b08a-4c0e-89f0-6cb380ecb056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:10.411650 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aa531-b08a-4c0e-89f0-6cb380ecb056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:10.411937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aa531-b08a-4c0e-89f0-6cb380ecb056 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:10.412217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aa531-b08a-4c0e-89f0-6cb380ecb056 admin admin] PATH_INFO: `/v3/users/8207acca876a4af5ac75dd4283916763` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:10.414224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2aa531-b08a-4c0e-89f0-6cb380ecb056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8207acca876a4af5ac75dd4283916763)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:10.416218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2aa531-b08a-4c0e-89f0-6cb380ecb056 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:10.594289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4f2aa531-b08a-4c0e-89f0-6cb380ecb056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8207acca876a4af5ac75dd4283916763'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:10.594896 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4f2aa531-b08a-4c0e-89f0-6cb380ecb056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8207acca876a4af5ac75dd4283916763'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:10.595497 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4f2aa531-b08a-4c0e-89f0-6cb380ecb056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8207acca876a4af5ac75dd4283916763'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:10.649406 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4f2aa531-b08a-4c0e-89f0-6cb380ecb056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8207acca876a4af5ac75dd4283916763'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:10.663044 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4f2aa531-b08a-4c0e-89f0-6cb380ecb056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8207acca876a4af5ac75dd4283916763'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:10.677549 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1247/2525] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:11:10 2022] DELETE /identity/v3/users/8207acca876a4af5ac75dd4283916763 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:10.956954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf69cfb-98c5-4b7a-9cc7-855dd5d3fe7f service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:10.969048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf69cfb-98c5-4b7a-9cc7-855dd5d3fe7f service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:11.027560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a188eb-e9e8-4116-8c85-fae9a8df37be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:11.028422 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a188eb-e9e8-4116-8c85-fae9a8df37be admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:11.028708 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a188eb-e9e8-4116-8c85-fae9a8df37be admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:11.029016 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a188eb-e9e8-4116-8c85-fae9a8df37be admin admin] PATH_INFO: `/v3/projects/6f18b754d17d4ded958a80cf2781c72b` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:11.030154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a188eb-e9e8-4116-8c85-fae9a8df37be admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f18b754d17d4ded958a80cf2781c72b)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:11.032093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a188eb-e9e8-4116-8c85-fae9a8df37be admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:11.165980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:11.167328 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-37a188eb-e9e8-4116-8c85-fae9a8df37be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f18b754d17d4ded958a80cf2781c72b', 'request_id': 'req-37a188eb-e9e8-4116-8c85-fae9a8df37be'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:11.235004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-37a188eb-e9e8-4116-8c85-fae9a8df37be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f18b754d17d4ded958a80cf2781c72b', 'request_id': 'req-37a188eb-e9e8-4116-8c85-fae9a8df37be'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:11.242352 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-37a188eb-e9e8-4116-8c85-fae9a8df37be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f18b754d17d4ded958a80cf2781c72b', 'request_id': 'req-37a188eb-e9e8-4116-8c85-fae9a8df37be'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:11.253455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-37a188eb-e9e8-4116-8c85-fae9a8df37be admin admin] The token cache is being invalidate because project 6f18b754d17d4ded958a80cf2781c72b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:11.253748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-37a188eb-e9e8-4116-8c85-fae9a8df37be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:11.254432 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-37a188eb-e9e8-4116-8c85-fae9a8df37be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:11.255977 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1279/2526] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:11:10 2022] DELETE /identity/v3/projects/6f18b754d17d4ded958a80cf2781c72b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:11.266380 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7c3c-2c6d-463e-bce8-78cee2ace62e None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:11.266866 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7c3c-2c6d-463e-bce8-78cee2ace62e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:11.266979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7c3c-2c6d-463e-bce8-78cee2ace62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:11.285615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-7fcd7c3c-2c6d-463e-bce8-78cee2ace62e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:11.286880 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-7fcd7c3c-2c6d-463e-bce8-78cee2ace62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:11.348479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1248/2527] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:11.356375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8e2b-1795-4956-ab10-61b8f16e9ef8 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:11.356663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8e2b-1795-4956-ab10-61b8f16e9ef8 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:11.356963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8e2b-1795-4956-ab10-61b8f16e9ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:11.376468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-1efe8e2b-1795-4956-ab10-61b8f16e9ef8 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:11.377666 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1efe8e2b-1795-4956-ab10-61b8f16e9ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:11.386191 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1280/2528] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:11.390571 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd7c3c-2c6d-463e-bce8-78cee2ace62e None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:11.401032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd7c3c-2c6d-463e-bce8-78cee2ace62e None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:11.405655 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7368d63-5da3-4b70-aece-aadf13d538b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:11.406300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7368d63-5da3-4b70-aece-aadf13d538b2 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:11.406605 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7368d63-5da3-4b70-aece-aadf13d538b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:11.406883 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7368d63-5da3-4b70-aece-aadf13d538b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:11.407600 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7368d63-5da3-4b70-aece-aadf13d538b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:11:11.407908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7368d63-5da3-4b70-aece-aadf13d538b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:11.409489 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7368d63-5da3-4b70-aece-aadf13d538b2 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:11.421158 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1249/2529] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:11:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:11:11.425305 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe8e2b-1795-4956-ab10-61b8f16e9ef8 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:11.435379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe8e2b-1795-4956-ab10-61b8f16e9ef8 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:11.440029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a93083-883e-437d-a72d-90683d4675c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:11.440674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a93083-883e-437d-a72d-90683d4675c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:11.440960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a93083-883e-437d-a72d-90683d4675c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:11.441234 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a93083-883e-437d-a72d-90683d4675c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:11.441925 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a93083-883e-437d-a72d-90683d4675c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:11.443843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a93083-883e-437d-a72d-90683d4675c4 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:11.531438 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1281/2530] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:11:11 2022] POST /identity/v3/projects => generated 376 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:11.532706 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7368d63-5da3-4b70-aece-aadf13d538b2 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:11.542752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7368d63-5da3-4b70-aece-aadf13d538b2 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:11.600244 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852357ec-3356-4843-b3ff-eaef3846500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:11.600966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852357ec-3356-4843-b3ff-eaef3846500a admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:11.601254 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852357ec-3356-4843-b3ff-eaef3846500a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:11.601535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852357ec-3356-4843-b3ff-eaef3846500a admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:11.602221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852357ec-3356-4843-b3ff-eaef3846500a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:11.604422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852357ec-3356-4843-b3ff-eaef3846500a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:11.611219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:11.687202 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1250/2531] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:11:11 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:11.694984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a93083-883e-437d-a72d-90683d4675c4 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:11.705568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a93083-883e-437d-a72d-90683d4675c4 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:11.710507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd0909-4561-4dc2-9257-8afd6c5f4150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:11.711165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd0909-4561-4dc2-9257-8afd6c5f4150 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:11.711447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd0909-4561-4dc2-9257-8afd6c5f4150 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:11.711721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd0909-4561-4dc2-9257-8afd6c5f4150 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:11.712471 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd0909-4561-4dc2-9257-8afd6c5f4150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:11.714051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd0909-4561-4dc2-9257-8afd6c5f4150 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:11.724421 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1282/2532] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:11 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:11.728877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852357ec-3356-4843-b3ff-eaef3846500a admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:11.738944 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852357ec-3356-4843-b3ff-eaef3846500a admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:11.744554 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbbb94-f751-41eb-96d8-f6a01e62ac8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:11.745216 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbbb94-f751-41eb-96d8-f6a01e62ac8c admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:11.745506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbbb94-f751-41eb-96d8-f6a01e62ac8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:11.745794 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbbb94-f751-41eb-96d8-f6a01e62ac8c admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:11.746566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbbb94-f751-41eb-96d8-f6a01e62ac8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:11.748259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbbb94-f751-41eb-96d8-f6a01e62ac8c admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:11.760808 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1251/2533] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:11 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:11.764823 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd0909-4561-4dc2-9257-8afd6c5f4150 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:11.775034 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd0909-4561-4dc2-9257-8afd6c5f4150 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:11.779805 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5fb5d-8e8e-45f8-a81d-64ee781ba861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:11.780683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5fb5d-8e8e-45f8-a81d-64ee781ba861 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:11.780968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5fb5d-8e8e-45f8-a81d-64ee781ba861 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:11.781246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5fb5d-8e8e-45f8-a81d-64ee781ba861 admin admin] PATH_INFO: `/v3/projects/1abc0bcaa5bf4121a02f9e3bc6910804/users/b3c4ff8c0eca413fbe709169475c1498/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:11.797142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5fb5d-8e8e-45f8-a81d-64ee781ba861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1abc0bcaa5bf4121a02f9e3bc6910804, user_id=b3c4ff8c0eca413fbe709169475c1498, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:11.799842 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5fb5d-8e8e-45f8-a81d-64ee781ba861 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:11.863763 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1283/2534] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:11:11 2022] PUT /identity/v3/projects/1abc0bcaa5bf4121a02f9e3bc6910804/users/b3c4ff8c0eca413fbe709169475c1498/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:11.875426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b5625-a8be-4cbd-a31e-e883c677805d None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:11.875793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b5625-a8be-4cbd-a31e-e883c677805d None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:11.876109 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b5625-a8be-4cbd-a31e-e883c677805d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:11.904035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-d63b5625-a8be-4cbd-a31e-e883c677805d None None] MFA Rules not processed for user `b3c4ff8c0eca413fbe709169475c1498`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:11.905268 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d63b5625-a8be-4cbd-a31e-e883c677805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:11.969130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1252/2535] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:11:11.980391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5fb5d-8e8e-45f8-a81d-64ee781ba861 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:11.982103 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-26e5fb5d-8e8e-45f8-a81d-64ee781ba861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:12.056430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5fb5d-8e8e-45f8-a81d-64ee781ba861 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:12.062227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d7542-221d-4d0f-b554-ffc050098d40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:12.062907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d7542-221d-4d0f-b554-ffc050098d40 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:12.063194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d7542-221d-4d0f-b554-ffc050098d40 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:12.063474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d7542-221d-4d0f-b554-ffc050098d40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:12.072135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d7542-221d-4d0f-b554-ffc050098d40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:12.073707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d7542-221d-4d0f-b554-ffc050098d40 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:12.083135 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1284/2536] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:12.294009 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b5625-a8be-4cbd-a31e-e883c677805d None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:12.357631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b5625-a8be-4cbd-a31e-e883c677805d None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:12.362067 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34439d-3705-4ba1-aacb-db6408414c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:12.362970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34439d-3705-4ba1-aacb-db6408414c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:12.363254 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34439d-3705-4ba1-aacb-db6408414c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:12.363554 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34439d-3705-4ba1-aacb-db6408414c24 admin admin] PATH_INFO: `/v3/users/b3c4ff8c0eca413fbe709169475c1498` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:12.364731 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34439d-3705-4ba1-aacb-db6408414c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c4ff8c0eca413fbe709169475c1498)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:12.367307 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34439d-3705-4ba1-aacb-db6408414c24 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:12.571042 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9b34439d-3705-4ba1-aacb-db6408414c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c4ff8c0eca413fbe709169475c1498'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:12.571705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9b34439d-3705-4ba1-aacb-db6408414c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c4ff8c0eca413fbe709169475c1498'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:12.572318 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9b34439d-3705-4ba1-aacb-db6408414c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c4ff8c0eca413fbe709169475c1498'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:12.642829 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9b34439d-3705-4ba1-aacb-db6408414c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c4ff8c0eca413fbe709169475c1498'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:12.654555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:12.655739 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-9b34439d-3705-4ba1-aacb-db6408414c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c4ff8c0eca413fbe709169475c1498'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:12.668587 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1253/2537] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:11:12 2022] DELETE /identity/v3/users/b3c4ff8c0eca413fbe709169475c1498 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:12.673186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e6b3-4652-4259-91df-f3fda4dd88e7 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:12.673485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e6b3-4652-4259-91df-f3fda4dd88e7 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:12.673769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e6b3-4652-4259-91df-f3fda4dd88e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:12.692478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-9585e6b3-4652-4259-91df-f3fda4dd88e7 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:12.693776 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-9585e6b3-4652-4259-91df-f3fda4dd88e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:12.746952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:12.756594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1285/2538] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:12.766404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34439d-3705-4ba1-aacb-db6408414c24 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:12.768029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9b34439d-3705-4ba1-aacb-db6408414c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:12.827092 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34439d-3705-4ba1-aacb-db6408414c24 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:12.831479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7eb1ba-fdb5-4dd5-9195-ebd3a2f71af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:12.832079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7eb1ba-fdb5-4dd5-9195-ebd3a2f71af5 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:12.832374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7eb1ba-fdb5-4dd5-9195-ebd3a2f71af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:12.832660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7eb1ba-fdb5-4dd5-9195-ebd3a2f71af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:12.842271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7eb1ba-fdb5-4dd5-9195-ebd3a2f71af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:12.843753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7eb1ba-fdb5-4dd5-9195-ebd3a2f71af5 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:12.853839 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1254/2539] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:11:13.286791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585e6b3-4652-4259-91df-f3fda4dd88e7 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:13.289211 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-9585e6b3-4652-4259-91df-f3fda4dd88e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:13.303362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585e6b3-4652-4259-91df-f3fda4dd88e7 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:13.308827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9329b-2a1f-461c-9e15-5e1951393bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:13.309699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9329b-2a1f-461c-9e15-5e1951393bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:13.310039 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9329b-2a1f-461c-9e15-5e1951393bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:13.310250 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9329b-2a1f-461c-9e15-5e1951393bdf admin admin] PATH_INFO: `/v3/projects/1abc0bcaa5bf4121a02f9e3bc6910804` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:13.311536 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9329b-2a1f-461c-9e15-5e1951393bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1abc0bcaa5bf4121a02f9e3bc6910804)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:13.313410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9329b-2a1f-461c-9e15-5e1951393bdf admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:13.421030 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-7ea9329b-2a1f-461c-9e15-5e1951393bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1abc0bcaa5bf4121a02f9e3bc6910804', 'request_id': 'req-7ea9329b-2a1f-461c-9e15-5e1951393bdf'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:13.488504 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-7ea9329b-2a1f-461c-9e15-5e1951393bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1abc0bcaa5bf4121a02f9e3bc6910804', 'request_id': 'req-7ea9329b-2a1f-461c-9e15-5e1951393bdf'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:13.495823 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-7ea9329b-2a1f-461c-9e15-5e1951393bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1abc0bcaa5bf4121a02f9e3bc6910804', 'request_id': 'req-7ea9329b-2a1f-461c-9e15-5e1951393bdf'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:13.506233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-7ea9329b-2a1f-461c-9e15-5e1951393bdf admin admin] The token cache is being invalidate because project 1abc0bcaa5bf4121a02f9e3bc6910804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:13.506580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-7ea9329b-2a1f-461c-9e15-5e1951393bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:13.507622 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-7ea9329b-2a1f-461c-9e15-5e1951393bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:13.509152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1286/2540] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:11:13 2022] DELETE /identity/v3/projects/1abc0bcaa5bf4121a02f9e3bc6910804 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:13.514200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f799b-c5fa-4030-ab11-bc622a2cfe01 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:13.514712 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f799b-c5fa-4030-ab11-bc622a2cfe01 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:13.514933 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f799b-c5fa-4030-ab11-bc622a2cfe01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:13.532942 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-bf9f799b-c5fa-4030-ab11-bc622a2cfe01 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:13.534147 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-bf9f799b-c5fa-4030-ab11-bc622a2cfe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:13.594025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1255/2541] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:13.602210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620930c7-177e-48c1-9dff-086ebefd245e None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:13.602633 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620930c7-177e-48c1-9dff-086ebefd245e None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:13.603013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620930c7-177e-48c1-9dff-086ebefd245e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:13.622368 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-620930c7-177e-48c1-9dff-086ebefd245e None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:13.623579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-620930c7-177e-48c1-9dff-086ebefd245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:13.631473 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1287/2542] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:13.635871 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f799b-c5fa-4030-ab11-bc622a2cfe01 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:13.645561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f799b-c5fa-4030-ab11-bc622a2cfe01 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:13.650708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fed5a4-8afa-417d-a53d-9c8db1da2b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:13.651459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fed5a4-8afa-417d-a53d-9c8db1da2b81 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:13.651746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fed5a4-8afa-417d-a53d-9c8db1da2b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:13.652024 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fed5a4-8afa-417d-a53d-9c8db1da2b81 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:13.652741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fed5a4-8afa-417d-a53d-9c8db1da2b81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:11:13.653051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fed5a4-8afa-417d-a53d-9c8db1da2b81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:13.654684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fed5a4-8afa-417d-a53d-9c8db1da2b81 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:13.666579 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1256/2543] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:11:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:11:13.670865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620930c7-177e-48c1-9dff-086ebefd245e None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:13.680142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620930c7-177e-48c1-9dff-086ebefd245e None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:13.684701 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae326c3-f843-4dca-9dea-be743a562ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:13.685379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae326c3-f843-4dca-9dea-be743a562ccc admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:13.685663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae326c3-f843-4dca-9dea-be743a562ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:13.685939 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae326c3-f843-4dca-9dea-be743a562ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:13.686661 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae326c3-f843-4dca-9dea-be743a562ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:13.688551 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae326c3-f843-4dca-9dea-be743a562ccc admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:13.776379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1288/2544] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:11:13 2022] POST /identity/v3/projects => generated 358 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:13.780229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fed5a4-8afa-417d-a53d-9c8db1da2b81 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:13.791025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fed5a4-8afa-417d-a53d-9c8db1da2b81 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:13.847364 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b9d98-f09f-4061-9ddc-83c44f771c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:13.848042 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b9d98-f09f-4061-9ddc-83c44f771c8a admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:13.848724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b9d98-f09f-4061-9ddc-83c44f771c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:13.848724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b9d98-f09f-4061-9ddc-83c44f771c8a admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:13.849274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b9d98-f09f-4061-9ddc-83c44f771c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:13.851934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b9d98-f09f-4061-9ddc-83c44f771c8a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:13.978475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1257/2545] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:11:13 2022] POST /identity/v3/users => generated 280 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:13.979783 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae326c3-f843-4dca-9dea-be743a562ccc admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:13.990042 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae326c3-f843-4dca-9dea-be743a562ccc admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:13.995642 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79e9e7-5fa2-48fa-9fb7-4d2e97ed2202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:13.996305 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79e9e7-5fa2-48fa-9fb7-4d2e97ed2202 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:13.996588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79e9e7-5fa2-48fa-9fb7-4d2e97ed2202 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:13.996943 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79e9e7-5fa2-48fa-9fb7-4d2e97ed2202 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:13.997577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79e9e7-5fa2-48fa-9fb7-4d2e97ed2202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:13.999195 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79e9e7-5fa2-48fa-9fb7-4d2e97ed2202 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:14.013610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1289/2546] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:13 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:14.015051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b9d98-f09f-4061-9ddc-83c44f771c8a admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:14.025425 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b9d98-f09f-4061-9ddc-83c44f771c8a admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:14.030084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30082d1-0b8b-4c99-840e-839ee857e5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:14.030811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30082d1-0b8b-4c99-840e-839ee857e5cd admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:14.031078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30082d1-0b8b-4c99-840e-839ee857e5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:14.031360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30082d1-0b8b-4c99-840e-839ee857e5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:14.032087 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30082d1-0b8b-4c99-840e-839ee857e5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:14.033690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30082d1-0b8b-4c99-840e-839ee857e5cd admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:14.034989 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:14.045352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1258/2547] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:14 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:14.057250 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79e9e7-5fa2-48fa-9fb7-4d2e97ed2202 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:14.067201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79e9e7-5fa2-48fa-9fb7-4d2e97ed2202 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:14.072370 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01196d95-7a3c-47c3-91e2-4cb610ac5696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:14.073318 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01196d95-7a3c-47c3-91e2-4cb610ac5696 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:14.073602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01196d95-7a3c-47c3-91e2-4cb610ac5696 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:14.073880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01196d95-7a3c-47c3-91e2-4cb610ac5696 admin admin] PATH_INFO: `/v3/projects/f30f4bf1f8c641d3adbf118d5be25dc8/users/4e178ef18313414fac6153c9247a5719/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:14.089890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01196d95-7a3c-47c3-91e2-4cb610ac5696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30f4bf1f8c641d3adbf118d5be25dc8, user_id=4e178ef18313414fac6153c9247a5719, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:14.092583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01196d95-7a3c-47c3-91e2-4cb610ac5696 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:14.307288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1290/2548] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:11:14 2022] PUT /identity/v3/projects/f30f4bf1f8c641d3adbf118d5be25dc8/users/4e178ef18313414fac6153c9247a5719/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:14.331799 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e1945-51cd-4515-8fe6-65258d045729 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:14.332091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e1945-51cd-4515-8fe6-65258d045729 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:14.332373 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e1945-51cd-4515-8fe6-65258d045729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:14.359860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-296e1945-51cd-4515-8fe6-65258d045729 None None] MFA Rules not processed for user `4e178ef18313414fac6153c9247a5719`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:14.361118 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-296e1945-51cd-4515-8fe6-65258d045729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:14.425373 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1259/2549] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:14.430071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01196d95-7a3c-47c3-91e2-4cb610ac5696 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:14.492266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01196d95-7a3c-47c3-91e2-4cb610ac5696 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:14.497020 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa943200-f6e2-49e6-bc83-fb7fbd347d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:14.497460 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa943200-f6e2-49e6-bc83-fb7fbd347d2a admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:14.497743 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa943200-f6e2-49e6-bc83-fb7fbd347d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:14.509061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa943200-f6e2-49e6-bc83-fb7fbd347d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:14.509061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa943200-f6e2-49e6-bc83-fb7fbd347d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:14.509061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa943200-f6e2-49e6-bc83-fb7fbd347d2a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:14.672872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1291/2550] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:11:14 2022] POST /identity/v3/projects => generated 358 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:14.676753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e1945-51cd-4515-8fe6-65258d045729 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:14.687697 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e1945-51cd-4515-8fe6-65258d045729 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:14.744802 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7250c1-3af8-4c7a-b28a-23c72c35eccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:14.745401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7250c1-3af8-4c7a-b28a-23c72c35eccd admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:14.745692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7250c1-3af8-4c7a-b28a-23c72c35eccd admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:14.745976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7250c1-3af8-4c7a-b28a-23c72c35eccd admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:14.746696 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7250c1-3af8-4c7a-b28a-23c72c35eccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:14.748631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7250c1-3af8-4c7a-b28a-23c72c35eccd admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:14.870857 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1260/2551] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:11:14 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:14.874746 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa943200-f6e2-49e6-bc83-fb7fbd347d2a admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:14.880413 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:14.886267 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa943200-f6e2-49e6-bc83-fb7fbd347d2a admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:14.890933 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030d7b0-dc61-426f-8e98-b3b5e89c2417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:14.891590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030d7b0-dc61-426f-8e98-b3b5e89c2417 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:14.891879 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030d7b0-dc61-426f-8e98-b3b5e89c2417 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:14.892160 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030d7b0-dc61-426f-8e98-b3b5e89c2417 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:14.904121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030d7b0-dc61-426f-8e98-b3b5e89c2417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:14.904121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030d7b0-dc61-426f-8e98-b3b5e89c2417 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:14.905940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1292/2552] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:14 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:14.910206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7250c1-3af8-4c7a-b28a-23c72c35eccd admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:14.929638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7250c1-3af8-4c7a-b28a-23c72c35eccd admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:14.934653 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60637eb3-a04d-4cec-a492-476f9397050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:14.936440 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60637eb3-a04d-4cec-a492-476f9397050f admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:14.936755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60637eb3-a04d-4cec-a492-476f9397050f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:14.937025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60637eb3-a04d-4cec-a492-476f9397050f admin admin] PATH_INFO: `/v3/projects/fcea4644f6e243b9a3eb1696c7866d46/users/2d272aafdb2147acaa95947270d500bd/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:14.955449 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60637eb3-a04d-4cec-a492-476f9397050f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcea4644f6e243b9a3eb1696c7866d46, user_id=2d272aafdb2147acaa95947270d500bd, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:14.958195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60637eb3-a04d-4cec-a492-476f9397050f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:15.076438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1261/2553] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:11:14 2022] PUT /identity/v3/projects/fcea4644f6e243b9a3eb1696c7866d46/users/2d272aafdb2147acaa95947270d500bd/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:15.081513 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030d7b0-dc61-426f-8e98-b3b5e89c2417 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:15.092454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030d7b0-dc61-426f-8e98-b3b5e89c2417 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:15.150471 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6508c-5727-457e-9825-c79105b51cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:15.156791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6508c-5727-457e-9825-c79105b51cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:15.156791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6508c-5727-457e-9825-c79105b51cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:15.156791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6508c-5727-457e-9825-c79105b51cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:15.156791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6508c-5727-457e-9825-c79105b51cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:15.156791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6508c-5727-457e-9825-c79105b51cb6 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:15.167092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1293/2554] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:15 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:15.168423 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60637eb3-a04d-4cec-a492-476f9397050f admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:15.179790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60637eb3-a04d-4cec-a492-476f9397050f admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:15.185604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb4f11-968a-47ed-84fa-9f7e659ee561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:15.186535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb4f11-968a-47ed-84fa-9f7e659ee561 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:15.186821 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb4f11-968a-47ed-84fa-9f7e659ee561 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:15.187097 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb4f11-968a-47ed-84fa-9f7e659ee561 admin admin] PATH_INFO: `/v3/projects/fcea4644f6e243b9a3eb1696c7866d46/users/2d272aafdb2147acaa95947270d500bd/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:15.189086 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb4f11-968a-47ed-84fa-9f7e659ee561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcea4644f6e243b9a3eb1696c7866d46, user_id=2d272aafdb2147acaa95947270d500bd, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:15.191742 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb4f11-968a-47ed-84fa-9f7e659ee561 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:15.204342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1262/2555] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:11:15 2022] PUT /identity/v3/projects/fcea4644f6e243b9a3eb1696c7866d46/users/2d272aafdb2147acaa95947270d500bd/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:15.217039 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0216b6-8eb7-4416-ae62-9bfc65095b2d None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:15.217332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0216b6-8eb7-4416-ae62-9bfc65095b2d None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:15.217616 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0216b6-8eb7-4416-ae62-9bfc65095b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:15.246133 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-9e0216b6-8eb7-4416-ae62-9bfc65095b2d None None] MFA Rules not processed for user `2d272aafdb2147acaa95947270d500bd`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:15.247442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-9e0216b6-8eb7-4416-ae62-9bfc65095b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:15.322702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1294/2556] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:15.330155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb4f11-968a-47ed-84fa-9f7e659ee561 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:15.331914 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d5bb4f11-968a-47ed-84fa-9f7e659ee561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:15.379643 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:15.415070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb4f11-968a-47ed-84fa-9f7e659ee561 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:15.419583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0705dd-9877-4546-9287-f54545f4c398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:15.420235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0705dd-9877-4546-9287-f54545f4c398 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:15.420519 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0705dd-9877-4546-9287-f54545f4c398 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:15.420800 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0705dd-9877-4546-9287-f54545f4c398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:15.430820 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0705dd-9877-4546-9287-f54545f4c398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:15.439130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0705dd-9877-4546-9287-f54545f4c398 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:15.442339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1263/2557] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:15.696682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0216b6-8eb7-4416-ae62-9bfc65095b2d None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:15.707130 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0216b6-8eb7-4416-ae62-9bfc65095b2d None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:15.711061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe0ad1-48c0-4c9b-80a8-f9a198232fff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:15.711701 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe0ad1-48c0-4c9b-80a8-f9a198232fff service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:15.711985 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe0ad1-48c0-4c9b-80a8-f9a198232fff service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:15.712297 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe0ad1-48c0-4c9b-80a8-f9a198232fff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:15.769369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe0ad1-48c0-4c9b-80a8-f9a198232fff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:15.770986 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe0ad1-48c0-4c9b-80a8-f9a198232fff service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:15.780578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1295/2558] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:25.460302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=18 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:25.776337 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=95 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:39.555046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0705dd-9877-4546-9287-f54545f4c398 service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:39.624295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0705dd-9877-4546-9287-f54545f4c398 service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:39.628887 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65121f0-5ace-43dc-bdcd-ccad9d61bded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:39.629842 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65121f0-5ace-43dc-bdcd-ccad9d61bded admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:39.630242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65121f0-5ace-43dc-bdcd-ccad9d61bded admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:39.630572 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65121f0-5ace-43dc-bdcd-ccad9d61bded admin admin] PATH_INFO: `/v3/users/4e178ef18313414fac6153c9247a5719` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:39.631786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65121f0-5ace-43dc-bdcd-ccad9d61bded admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e178ef18313414fac6153c9247a5719)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:39.633724 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65121f0-5ace-43dc-bdcd-ccad9d61bded admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:39.883196 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d65121f0-5ace-43dc-bdcd-ccad9d61bded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e178ef18313414fac6153c9247a5719'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:39.883888 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d65121f0-5ace-43dc-bdcd-ccad9d61bded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e178ef18313414fac6153c9247a5719'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:39.885260 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d65121f0-5ace-43dc-bdcd-ccad9d61bded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e178ef18313414fac6153c9247a5719'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:40.014682 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d65121f0-5ace-43dc-bdcd-ccad9d61bded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e178ef18313414fac6153c9247a5719'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:40.030395 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d65121f0-5ace-43dc-bdcd-ccad9d61bded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e178ef18313414fac6153c9247a5719'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:40.045604 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1264/2559] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:11:39 2022] DELETE /identity/v3/users/4e178ef18313414fac6153c9247a5719 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:40.050300 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c424224-5a18-4ccf-a154-12e3d6ff74b6 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:40.053930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c424224-5a18-4ccf-a154-12e3d6ff74b6 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:40.053930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c424224-5a18-4ccf-a154-12e3d6ff74b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:40.078965 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-3c424224-5a18-4ccf-a154-12e3d6ff74b6 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:40.080488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-3c424224-5a18-4ccf-a154-12e3d6ff74b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:40.143898 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1296/2560] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:40.154396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65121f0-5ace-43dc-bdcd-ccad9d61bded admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:40.155876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d65121f0-5ace-43dc-bdcd-ccad9d61bded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:40.222850 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65121f0-5ace-43dc-bdcd-ccad9d61bded admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:40.226767 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae4988-3737-45f0-b6ea-4ad070b2b735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:40.227427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae4988-3737-45f0-b6ea-4ad070b2b735 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:40.227716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae4988-3737-45f0-b6ea-4ad070b2b735 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:40.228727 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae4988-3737-45f0-b6ea-4ad070b2b735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:40.238872 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae4988-3737-45f0-b6ea-4ad070b2b735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:40.240375 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae4988-3737-45f0-b6ea-4ad070b2b735 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:40.251076 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1265/2561] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:11:40.324651 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c424224-5a18-4ccf-a154-12e3d6ff74b6 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:40.327311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-3c424224-5a18-4ccf-a154-12e3d6ff74b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:40.427527 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c424224-5a18-4ccf-a154-12e3d6ff74b6 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:40.433493 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33e03a-416e-42cd-8be4-0b9e2d8a3b5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:40.434153 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33e03a-416e-42cd-8be4-0b9e2d8a3b5c service placement] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:40.434477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33e03a-416e-42cd-8be4-0b9e2d8a3b5c service placement] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:40.434777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33e03a-416e-42cd-8be4-0b9e2d8a3b5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:40.436564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-4a33e03a-416e-42cd-8be4-0b9e2d8a3b5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:40.450692 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33e03a-416e-42cd-8be4-0b9e2d8a3b5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:40.452304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33e03a-416e-42cd-8be4-0b9e2d8a3b5c service placement] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:40.465495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1297/2562] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:40.765198 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae4988-3737-45f0-b6ea-4ad070b2b735 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:40.766733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4bae4988-3737-45f0-b6ea-4ad070b2b735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:40.780013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae4988-3737-45f0-b6ea-4ad070b2b735 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:40.785037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbc51e-717a-461b-b756-f39308e4ae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:40.788652 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbc51e-717a-461b-b756-f39308e4ae50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:40.788652 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbc51e-717a-461b-b756-f39308e4ae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:40.788652 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbc51e-717a-461b-b756-f39308e4ae50 admin admin] PATH_INFO: `/v3/projects/f30f4bf1f8c641d3adbf118d5be25dc8` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:40.788652 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbc51e-717a-461b-b756-f39308e4ae50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30f4bf1f8c641d3adbf118d5be25dc8)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:40.789687 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbc51e-717a-461b-b756-f39308e4ae50 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:40.808798 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:40.981568 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-a7bbc51e-717a-461b-b756-f39308e4ae50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30f4bf1f8c641d3adbf118d5be25dc8', 'request_id': 'req-a7bbc51e-717a-461b-b756-f39308e4ae50'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:41.094959 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-a7bbc51e-717a-461b-b756-f39308e4ae50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30f4bf1f8c641d3adbf118d5be25dc8', 'request_id': 'req-a7bbc51e-717a-461b-b756-f39308e4ae50'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:41.103717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-a7bbc51e-717a-461b-b756-f39308e4ae50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30f4bf1f8c641d3adbf118d5be25dc8', 'request_id': 'req-a7bbc51e-717a-461b-b756-f39308e4ae50'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:41.114257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-a7bbc51e-717a-461b-b756-f39308e4ae50 admin admin] The token cache is being invalidate because project f30f4bf1f8c641d3adbf118d5be25dc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:41.114588 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-a7bbc51e-717a-461b-b756-f39308e4ae50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:41.115310 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-a7bbc51e-717a-461b-b756-f39308e4ae50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:41.116900 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1266/2563] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:11:40 2022] DELETE /identity/v3/projects/f30f4bf1f8c641d3adbf118d5be25dc8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:41.121570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33e03a-416e-42cd-8be4-0b9e2d8a3b5c service placement] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:41.132427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33e03a-416e-42cd-8be4-0b9e2d8a3b5c service placement] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:41.209972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91edb1-1ffc-47d3-aa8e-8fb6c9d548c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:41.210989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91edb1-1ffc-47d3-aa8e-8fb6c9d548c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:41.211343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91edb1-1ffc-47d3-aa8e-8fb6c9d548c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:41.211696 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91edb1-1ffc-47d3-aa8e-8fb6c9d548c5 admin admin] PATH_INFO: `/v3/users/2d272aafdb2147acaa95947270d500bd` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:41.213757 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91edb1-1ffc-47d3-aa8e-8fb6c9d548c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d272aafdb2147acaa95947270d500bd)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:41.215737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91edb1-1ffc-47d3-aa8e-8fb6c9d548c5 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:41.229860 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:41.409729 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5e91edb1-1ffc-47d3-aa8e-8fb6c9d548c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d272aafdb2147acaa95947270d500bd'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:41.410512 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5e91edb1-1ffc-47d3-aa8e-8fb6c9d548c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d272aafdb2147acaa95947270d500bd'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:41.422985 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5e91edb1-1ffc-47d3-aa8e-8fb6c9d548c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d272aafdb2147acaa95947270d500bd'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:41.523117 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5e91edb1-1ffc-47d3-aa8e-8fb6c9d548c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d272aafdb2147acaa95947270d500bd'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:41.534009 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5e91edb1-1ffc-47d3-aa8e-8fb6c9d548c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d272aafdb2147acaa95947270d500bd'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:41.547447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1298/2564] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:11:41 2022] DELETE /identity/v3/users/2d272aafdb2147acaa95947270d500bd => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:42.079241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbc51e-717a-461b-b756-f39308e4ae50 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:42.080972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a7bbc51e-717a-461b-b756-f39308e4ae50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:42.096770 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbc51e-717a-461b-b756-f39308e4ae50 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:42.157235 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d3a02-245c-4c45-a20a-754d53e78012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:42.158109 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d3a02-245c-4c45-a20a-754d53e78012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:42.158434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d3a02-245c-4c45-a20a-754d53e78012 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:42.158720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d3a02-245c-4c45-a20a-754d53e78012 admin admin] PATH_INFO: `/v3/projects/fcea4644f6e243b9a3eb1696c7866d46` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:42.159957 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d3a02-245c-4c45-a20a-754d53e78012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcea4644f6e243b9a3eb1696c7866d46)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:42.161895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d3a02-245c-4c45-a20a-754d53e78012 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:42.272665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d51d3a02-245c-4c45-a20a-754d53e78012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcea4644f6e243b9a3eb1696c7866d46', 'request_id': 'req-d51d3a02-245c-4c45-a20a-754d53e78012'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:42.397248 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d51d3a02-245c-4c45-a20a-754d53e78012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcea4644f6e243b9a3eb1696c7866d46', 'request_id': 'req-d51d3a02-245c-4c45-a20a-754d53e78012'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:42.404934 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d51d3a02-245c-4c45-a20a-754d53e78012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcea4644f6e243b9a3eb1696c7866d46', 'request_id': 'req-d51d3a02-245c-4c45-a20a-754d53e78012'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:42.416786 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d51d3a02-245c-4c45-a20a-754d53e78012 admin admin] The token cache is being invalidate because project fcea4644f6e243b9a3eb1696c7866d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:42.417162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d51d3a02-245c-4c45-a20a-754d53e78012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:42.417910 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d51d3a02-245c-4c45-a20a-754d53e78012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:42.419563 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1267/2565] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:11:42 2022] DELETE /identity/v3/projects/fcea4644f6e243b9a3eb1696c7866d46 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:42.425287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29209d-2c8c-482c-8e74-7e8cdcd4a047 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:42.425803 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29209d-2c8c-482c-8e74-7e8cdcd4a047 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:42.425907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29209d-2c8c-482c-8e74-7e8cdcd4a047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:42.448508 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-9f29209d-2c8c-482c-8e74-7e8cdcd4a047 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:42.449723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-9f29209d-2c8c-482c-8e74-7e8cdcd4a047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:42.508508 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1299/2566] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:42.517526 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e081c14-f81c-4cde-9f0a-6af792d5156f None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:42.517825 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e081c14-f81c-4cde-9f0a-6af792d5156f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:42.518107 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e081c14-f81c-4cde-9f0a-6af792d5156f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:42.538855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-1e081c14-f81c-4cde-9f0a-6af792d5156f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:42.541816 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1e081c14-f81c-4cde-9f0a-6af792d5156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:42.548057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1268/2567] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:42.552288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29209d-2c8c-482c-8e74-7e8cdcd4a047 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:42.561935 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29209d-2c8c-482c-8e74-7e8cdcd4a047 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:42.568051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2773a-e986-41ec-96fb-fcff52cef80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:42.568051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2773a-e986-41ec-96fb-fcff52cef80e admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:42.568051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2773a-e986-41ec-96fb-fcff52cef80e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:42.568051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2773a-e986-41ec-96fb-fcff52cef80e admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:42.568491 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2773a-e986-41ec-96fb-fcff52cef80e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:11:42.568640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2773a-e986-41ec-96fb-fcff52cef80e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:42.570212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2773a-e986-41ec-96fb-fcff52cef80e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:42.585574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1300/2568] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:11:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:11:42.590196 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e081c14-f81c-4cde-9f0a-6af792d5156f None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:42.600049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e081c14-f81c-4cde-9f0a-6af792d5156f None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:42.605729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefea9b4-a3a9-49fe-8d09-73614eb79a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:42.606436 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefea9b4-a3a9-49fe-8d09-73614eb79a5c admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:42.614119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefea9b4-a3a9-49fe-8d09-73614eb79a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:42.614119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefea9b4-a3a9-49fe-8d09-73614eb79a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:42.614119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefea9b4-a3a9-49fe-8d09-73614eb79a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:42.614119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefea9b4-a3a9-49fe-8d09-73614eb79a5c admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:42.711120 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1269/2569] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:11:42 2022] POST /identity/v3/projects => generated 388 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:42.712971 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2773a-e986-41ec-96fb-fcff52cef80e admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:42.723550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2773a-e986-41ec-96fb-fcff52cef80e admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:42.783783 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae3e92-3611-4cba-a588-fb33d7b3ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:42.784449 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae3e92-3611-4cba-a588-fb33d7b3ef71 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:42.784739 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae3e92-3611-4cba-a588-fb33d7b3ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:42.785018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae3e92-3611-4cba-a588-fb33d7b3ef71 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:42.785707 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae3e92-3611-4cba-a588-fb33d7b3ef71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:42.787714 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae3e92-3611-4cba-a588-fb33d7b3ef71 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:42.927345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1301/2570] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:11:42 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:42.928569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefea9b4-a3a9-49fe-8d09-73614eb79a5c admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:42.939466 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefea9b4-a3a9-49fe-8d09-73614eb79a5c admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:42.944084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd9159-002d-4b0e-ae45-c38033b52779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:42.944760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd9159-002d-4b0e-ae45-c38033b52779 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:42.945046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd9159-002d-4b0e-ae45-c38033b52779 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:42.945419 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd9159-002d-4b0e-ae45-c38033b52779 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:42.946045 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd9159-002d-4b0e-ae45-c38033b52779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:42.948499 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd9159-002d-4b0e-ae45-c38033b52779 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:42.949884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:42.960864 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1270/2571] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:42 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:42.964568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae3e92-3611-4cba-a588-fb33d7b3ef71 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:42.974559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae3e92-3611-4cba-a588-fb33d7b3ef71 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:42.979481 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267a26e-8c6a-4817-9c50-361c712e5f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:42.983808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267a26e-8c6a-4817-9c50-361c712e5f91 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:42.983808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267a26e-8c6a-4817-9c50-361c712e5f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:42.983808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267a26e-8c6a-4817-9c50-361c712e5f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:42.983808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267a26e-8c6a-4817-9c50-361c712e5f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:42.983808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267a26e-8c6a-4817-9c50-361c712e5f91 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:42.984585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:42.995184 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1302/2572] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:42 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:42.999321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd9159-002d-4b0e-ae45-c38033b52779 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:43.010045 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd9159-002d-4b0e-ae45-c38033b52779 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:43.014622 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adea648-de3d-4174-baaf-ececa6cd3eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:43.018237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adea648-de3d-4174-baaf-ececa6cd3eab admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:43.018237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adea648-de3d-4174-baaf-ececa6cd3eab admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:43.018237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adea648-de3d-4174-baaf-ececa6cd3eab admin admin] PATH_INFO: `/v3/projects/8f3cba5caa8645ad9359e6390f6e60bd/users/f830cbe983a547e5979ea2866df7e777/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:43.030368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adea648-de3d-4174-baaf-ececa6cd3eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3cba5caa8645ad9359e6390f6e60bd, user_id=f830cbe983a547e5979ea2866df7e777, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:43.033030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adea648-de3d-4174-baaf-ececa6cd3eab admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:43.130439 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1271/2573] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:11:42 2022] PUT /identity/v3/projects/8f3cba5caa8645ad9359e6390f6e60bd/users/f830cbe983a547e5979ea2866df7e777/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:11:43.142654 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501891d6-8c0b-4269-96ad-5aa22ce92e1b None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:43.142947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501891d6-8c0b-4269-96ad-5aa22ce92e1b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:43.143224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501891d6-8c0b-4269-96ad-5aa22ce92e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:43.172004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-501891d6-8c0b-4269-96ad-5aa22ce92e1b None None] MFA Rules not processed for user `f830cbe983a547e5979ea2866df7e777`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:43.173161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-501891d6-8c0b-4269-96ad-5aa22ce92e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:43.246810 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1303/2574] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:43.253169 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adea648-de3d-4174-baaf-ececa6cd3eab admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:43.315245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adea648-de3d-4174-baaf-ececa6cd3eab admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:43.319939 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2ec19-d790-4da1-94af-c1bcf3ced013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:43.320595 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2ec19-d790-4da1-94af-c1bcf3ced013 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:43.320883 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2ec19-d790-4da1-94af-c1bcf3ced013 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:43.321165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2ec19-d790-4da1-94af-c1bcf3ced013 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:43.322968 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2ec19-d790-4da1-94af-c1bcf3ced013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:43.324890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2ec19-d790-4da1-94af-c1bcf3ced013 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:43.506511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1272/2575] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:11:43 2022] POST /identity/v3/projects => generated 388 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:43.510837 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501891d6-8c0b-4269-96ad-5aa22ce92e1b None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:43.521858 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501891d6-8c0b-4269-96ad-5aa22ce92e1b None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:43.578951 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abb314-91b2-47c7-8534-4b89c8878399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:43.579623 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abb314-91b2-47c7-8534-4b89c8878399 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:43.579908 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abb314-91b2-47c7-8534-4b89c8878399 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:43.580183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abb314-91b2-47c7-8534-4b89c8878399 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:43.581142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abb314-91b2-47c7-8534-4b89c8878399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:43.583085 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abb314-91b2-47c7-8534-4b89c8878399 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:43.733687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1304/2576] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:11:43 2022] POST /identity/v3/users => generated 301 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:11:43.737662 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2ec19-d790-4da1-94af-c1bcf3ced013 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:43.747830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2ec19-d790-4da1-94af-c1bcf3ced013 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:43.752319 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732bae1-d8e5-4634-9c74-03b0f0404dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:43.752973 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732bae1-d8e5-4634-9c74-03b0f0404dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:43.753259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732bae1-d8e5-4634-9c74-03b0f0404dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:43.753537 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732bae1-d8e5-4634-9c74-03b0f0404dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:43.754252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732bae1-d8e5-4634-9c74-03b0f0404dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:43.755966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732bae1-d8e5-4634-9c74-03b0f0404dd4 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:43.766980 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1273/2577] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:43 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:43.771101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abb314-91b2-47c7-8534-4b89c8878399 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:43.781673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abb314-91b2-47c7-8534-4b89c8878399 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:43.788992 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f34d9e-76a8-49ab-a12e-9678ffd6ce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:43.788992 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34d9e-76a8-49ab-a12e-9678ffd6ce24 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:43.788992 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34d9e-76a8-49ab-a12e-9678ffd6ce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:43.788992 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34d9e-76a8-49ab-a12e-9678ffd6ce24 admin admin] PATH_INFO: `/v3/projects/59ed83cb95b1427db0c0a2645593d36a/users/89dd9682137f466f8c39e52c5323cfbe/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:43.802877 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f34d9e-76a8-49ab-a12e-9678ffd6ce24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ed83cb95b1427db0c0a2645593d36a, user_id=89dd9682137f466f8c39e52c5323cfbe, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:43.805501 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f34d9e-76a8-49ab-a12e-9678ffd6ce24 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:43.889220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1305/2578] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:11:43 2022] PUT /identity/v3/projects/59ed83cb95b1427db0c0a2645593d36a/users/89dd9682137f466f8c39e52c5323cfbe/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:11:43.893263 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732bae1-d8e5-4634-9c74-03b0f0404dd4 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:43.904078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732bae1-d8e5-4634-9c74-03b0f0404dd4 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:43.958987 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bd75c-9a34-450a-ba98-c5125a90d01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:43.959651 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bd75c-9a34-450a-ba98-c5125a90d01c admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:43.959940 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bd75c-9a34-450a-ba98-c5125a90d01c admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:43.960219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bd75c-9a34-450a-ba98-c5125a90d01c admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:43.960936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bd75c-9a34-450a-ba98-c5125a90d01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:43.963184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bd75c-9a34-450a-ba98-c5125a90d01c admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:43.973266 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1274/2579] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:43 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:11:43.977564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f34d9e-76a8-49ab-a12e-9678ffd6ce24 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:43.989090 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f34d9e-76a8-49ab-a12e-9678ffd6ce24 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:43.994178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b74e3-e558-4b39-a4fa-ff7d259293ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:43.995096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b74e3-e558-4b39-a4fa-ff7d259293ea admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:43.996365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b74e3-e558-4b39-a4fa-ff7d259293ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:43.996365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b74e3-e558-4b39-a4fa-ff7d259293ea admin admin] PATH_INFO: `/v3/projects/59ed83cb95b1427db0c0a2645593d36a/users/89dd9682137f466f8c39e52c5323cfbe/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:43.997793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b74e3-e558-4b39-a4fa-ff7d259293ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ed83cb95b1427db0c0a2645593d36a, user_id=89dd9682137f466f8c39e52c5323cfbe, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:44.000458 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b74e3-e558-4b39-a4fa-ff7d259293ea admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:44.011585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1306/2580] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:11:43 2022] PUT /identity/v3/projects/59ed83cb95b1427db0c0a2645593d36a/users/89dd9682137f466f8c39e52c5323cfbe/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:44.032332 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfc59c-aa7d-4a37-9e83-74926065e797 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:44.032676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfc59c-aa7d-4a37-9e83-74926065e797 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:44.033041 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfc59c-aa7d-4a37-9e83-74926065e797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:44.061297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-9ecfc59c-aa7d-4a37-9e83-74926065e797 None None] MFA Rules not processed for user `89dd9682137f466f8c39e52c5323cfbe`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:44.062535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9ecfc59c-aa7d-4a37-9e83-74926065e797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:44.093238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:44.130333 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1275/2581] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:44.142642 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b74e3-e558-4b39-a4fa-ff7d259293ea admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:44.144365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e96b74e3-e558-4b39-a4fa-ff7d259293ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:44.192226 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:44.208619 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b74e3-e558-4b39-a4fa-ff7d259293ea admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:44.212846 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cfe75-8a48-49cb-bd07-76fc4eb07c6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:44.213502 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cfe75-8a48-49cb-bd07-76fc4eb07c6f service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:44.213780 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cfe75-8a48-49cb-bd07-76fc4eb07c6f service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:44.214059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cfe75-8a48-49cb-bd07-76fc4eb07c6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:44.223219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cfe75-8a48-49cb-bd07-76fc4eb07c6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:44.224638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cfe75-8a48-49cb-bd07-76fc4eb07c6f service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:44.233964 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1307/2582] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:44.262763 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfc59c-aa7d-4a37-9e83-74926065e797 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:44.324921 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfc59c-aa7d-4a37-9e83-74926065e797 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:44.329763 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c815f-0ef3-4f6c-afb4-fc739fe9859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:44.330984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c815f-0ef3-4f6c-afb4-fc739fe9859e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:44.331270 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c815f-0ef3-4f6c-afb4-fc739fe9859e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:44.331547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c815f-0ef3-4f6c-afb4-fc739fe9859e admin admin] PATH_INFO: `/v3/users/f830cbe983a547e5979ea2866df7e777` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:44.332749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c815f-0ef3-4f6c-afb4-fc739fe9859e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f830cbe983a547e5979ea2866df7e777)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:44.334812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c815f-0ef3-4f6c-afb4-fc739fe9859e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:44.615851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-336c815f-0ef3-4f6c-afb4-fc739fe9859e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f830cbe983a547e5979ea2866df7e777'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:44.616433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-336c815f-0ef3-4f6c-afb4-fc739fe9859e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f830cbe983a547e5979ea2866df7e777'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:44.617032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-336c815f-0ef3-4f6c-afb4-fc739fe9859e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f830cbe983a547e5979ea2866df7e777'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:44.749836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-336c815f-0ef3-4f6c-afb4-fc739fe9859e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f830cbe983a547e5979ea2866df7e777'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:44.763373 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-336c815f-0ef3-4f6c-afb4-fc739fe9859e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f830cbe983a547e5979ea2866df7e777'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:44.776246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1276/2583] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:11:44 2022] DELETE /identity/v3/users/f830cbe983a547e5979ea2866df7e777 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:44.781120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7d47f-c375-49f7-b44b-0e4c4c6c7229 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:44.781603 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7d47f-c375-49f7-b44b-0e4c4c6c7229 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:44.781603 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7d47f-c375-49f7-b44b-0e4c4c6c7229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:44.800296 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-80b7d47f-c375-49f7-b44b-0e4c4c6c7229 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:44.801495 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-80b7d47f-c375-49f7-b44b-0e4c4c6c7229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:44.860227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1308/2584] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:44.870747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c815f-0ef3-4f6c-afb4-fc739fe9859e admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:44.872195 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-336c815f-0ef3-4f6c-afb4-fc739fe9859e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:44.924123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:44.929117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c815f-0ef3-4f6c-afb4-fc739fe9859e admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:44.933463 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2191e-864c-4035-80d6-6a77e1718d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:44.934116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2191e-864c-4035-80d6-6a77e1718d04 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:44.934433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2191e-864c-4035-80d6-6a77e1718d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:44.934715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2191e-864c-4035-80d6-6a77e1718d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:44.943366 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2191e-864c-4035-80d6-6a77e1718d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:44.944806 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2191e-864c-4035-80d6-6a77e1718d04 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:44.960741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1277/2585] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:45.456582 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7d47f-c375-49f7-b44b-0e4c4c6c7229 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:45.458004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-80b7d47f-c375-49f7-b44b-0e4c4c6c7229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:45.471408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7d47f-c375-49f7-b44b-0e4c4c6c7229 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:45.476121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:45.477214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:45.477498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:45.478573 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5 admin admin] PATH_INFO: `/v3/projects/8f3cba5caa8645ad9359e6390f6e60bd` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:45.480251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3cba5caa8645ad9359e6390f6e60bd)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:45.482142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:45.609749 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3cba5caa8645ad9359e6390f6e60bd', 'request_id': 'req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:45.688405 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3cba5caa8645ad9359e6390f6e60bd', 'request_id': 'req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:45.694991 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3cba5caa8645ad9359e6390f6e60bd', 'request_id': 'req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:45.705957 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5 admin admin] The token cache is being invalidate because project 8f3cba5caa8645ad9359e6390f6e60bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:45.706385 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:45.706885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:45.708406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1309/2586] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:11:45 2022] DELETE /identity/v3/projects/8f3cba5caa8645ad9359e6390f6e60bd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:45.712462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2191e-864c-4035-80d6-6a77e1718d04 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:45.721960 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2191e-864c-4035-80d6-6a77e1718d04 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:45.777907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a3c30-8626-4d3d-beda-d87923e989b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:45.778812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a3c30-8626-4d3d-beda-d87923e989b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:45.779098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a3c30-8626-4d3d-beda-d87923e989b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:45.779372 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a3c30-8626-4d3d-beda-d87923e989b4 admin admin] PATH_INFO: `/v3/users/89dd9682137f466f8c39e52c5323cfbe` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:45.780542 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a3c30-8626-4d3d-beda-d87923e989b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89dd9682137f466f8c39e52c5323cfbe)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:45.782518 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a3c30-8626-4d3d-beda-d87923e989b4 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:46.028290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b31a3c30-8626-4d3d-beda-d87923e989b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89dd9682137f466f8c39e52c5323cfbe'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:46.028932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b31a3c30-8626-4d3d-beda-d87923e989b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89dd9682137f466f8c39e52c5323cfbe'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:46.029533 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b31a3c30-8626-4d3d-beda-d87923e989b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89dd9682137f466f8c39e52c5323cfbe'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:46.098342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b31a3c30-8626-4d3d-beda-d87923e989b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89dd9682137f466f8c39e52c5323cfbe'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:46.114853 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b31a3c30-8626-4d3d-beda-d87923e989b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89dd9682137f466f8c39e52c5323cfbe'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:46.132636 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1278/2587] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:11:45 2022] DELETE /identity/v3/users/89dd9682137f466f8c39e52c5323cfbe => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:46.644735 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:46.646218 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:46.660367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d363c0a-1e87-4baa-9703-478f8b8b7ba5 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:46.718946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb8025-f400-419f-a8fb-8e362b1d8989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:46.719815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb8025-f400-419f-a8fb-8e362b1d8989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:46.720093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb8025-f400-419f-a8fb-8e362b1d8989 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:46.721325 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb8025-f400-419f-a8fb-8e362b1d8989 admin admin] PATH_INFO: `/v3/projects/59ed83cb95b1427db0c0a2645593d36a` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:46.722630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb8025-f400-419f-a8fb-8e362b1d8989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ed83cb95b1427db0c0a2645593d36a)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:46.724718 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb8025-f400-419f-a8fb-8e362b1d8989 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:46.732596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:46.829887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6fbb8025-f400-419f-a8fb-8e362b1d8989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ed83cb95b1427db0c0a2645593d36a', 'request_id': 'req-6fbb8025-f400-419f-a8fb-8e362b1d8989'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:46.943811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6fbb8025-f400-419f-a8fb-8e362b1d8989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ed83cb95b1427db0c0a2645593d36a', 'request_id': 'req-6fbb8025-f400-419f-a8fb-8e362b1d8989'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:46.950761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6fbb8025-f400-419f-a8fb-8e362b1d8989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ed83cb95b1427db0c0a2645593d36a', 'request_id': 'req-6fbb8025-f400-419f-a8fb-8e362b1d8989'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:46.961665 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6fbb8025-f400-419f-a8fb-8e362b1d8989 admin admin] The token cache is being invalidate because project 59ed83cb95b1427db0c0a2645593d36a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:46.962463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6fbb8025-f400-419f-a8fb-8e362b1d8989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:46.963106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6fbb8025-f400-419f-a8fb-8e362b1d8989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:46.964656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1310/2588] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:11:46 2022] DELETE /identity/v3/projects/59ed83cb95b1427db0c0a2645593d36a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:46.969686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44140e-e937-4a2d-940d-b5b90339d4b3 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:46.970176 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44140e-e937-4a2d-940d-b5b90339d4b3 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:46.970288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44140e-e937-4a2d-940d-b5b90339d4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:46.989128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-df44140e-e937-4a2d-940d-b5b90339d4b3 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:46.990477 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-df44140e-e937-4a2d-940d-b5b90339d4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:47.054042 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1279/2589] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:11:47.063273 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1177e-3301-4fac-95da-91c1b7ae0c33 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:47.063562 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1177e-3301-4fac-95da-91c1b7ae0c33 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:47.063839 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1177e-3301-4fac-95da-91c1b7ae0c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:47.083068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e3b1177e-3301-4fac-95da-91c1b7ae0c33 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:47.084200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e3b1177e-3301-4fac-95da-91c1b7ae0c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:47.093530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1311/2590] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:47.097817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44140e-e937-4a2d-940d-b5b90339d4b3 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:47.107848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44140e-e937-4a2d-940d-b5b90339d4b3 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:47.112456 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ef9ab-6960-4205-9b7c-9c631df2f012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:47.113108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ef9ab-6960-4205-9b7c-9c631df2f012 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:47.113395 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ef9ab-6960-4205-9b7c-9c631df2f012 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:47.113675 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ef9ab-6960-4205-9b7c-9c631df2f012 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:47.114425 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ef9ab-6960-4205-9b7c-9c631df2f012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:11:47.114750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ef9ab-6960-4205-9b7c-9c631df2f012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:47.116346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ef9ab-6960-4205-9b7c-9c631df2f012 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:47.119436 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:47.129057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1280/2591] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:11:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:11:47.133477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1177e-3301-4fac-95da-91c1b7ae0c33 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:47.144157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1177e-3301-4fac-95da-91c1b7ae0c33 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:47.148805 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3638a7-fb4f-4660-bbf8-0e668f5eef9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:47.149453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3638a7-fb4f-4660-bbf8-0e668f5eef9a admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:47.150365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3638a7-fb4f-4660-bbf8-0e668f5eef9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:47.150644 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3638a7-fb4f-4660-bbf8-0e668f5eef9a admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:47.151319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3638a7-fb4f-4660-bbf8-0e668f5eef9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:47.153196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3638a7-fb4f-4660-bbf8-0e668f5eef9a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:47.284996 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1312/2592] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:11:47 2022] POST /identity/v3/projects => generated 380 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:47.289141 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ef9ab-6960-4205-9b7c-9c631df2f012 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:47.299464 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ef9ab-6960-4205-9b7c-9c631df2f012 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:47.358063 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922f415-7f51-4953-a929-ffabd53479f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:47.358707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922f415-7f51-4953-a929-ffabd53479f3 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:47.358994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922f415-7f51-4953-a929-ffabd53479f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:47.359275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922f415-7f51-4953-a929-ffabd53479f3 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:47.360022 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922f415-7f51-4953-a929-ffabd53479f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:47.361933 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922f415-7f51-4953-a929-ffabd53479f3 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:47.443516 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1281/2593] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:11:47 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:47.448585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3638a7-fb4f-4660-bbf8-0e668f5eef9a admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:47.459384 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3638a7-fb4f-4660-bbf8-0e668f5eef9a admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:47.464275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c74ab-fe8e-4b0e-bddd-c0e590098bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:47.464940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c74ab-fe8e-4b0e-bddd-c0e590098bbe admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:47.465228 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c74ab-fe8e-4b0e-bddd-c0e590098bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:47.465621 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c74ab-fe8e-4b0e-bddd-c0e590098bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:47.466419 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c74ab-fe8e-4b0e-bddd-c0e590098bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:47.468161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c74ab-fe8e-4b0e-bddd-c0e590098bbe admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:47.479013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1313/2594] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:47 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:47.483221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922f415-7f51-4953-a929-ffabd53479f3 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:47.494185 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922f415-7f51-4953-a929-ffabd53479f3 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:47.499126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ac004-c234-4230-8d3e-bd168df611cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:47.499929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ac004-c234-4230-8d3e-bd168df611cc admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:47.500231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ac004-c234-4230-8d3e-bd168df611cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:47.500533 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ac004-c234-4230-8d3e-bd168df611cc admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:47.501259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ac004-c234-4230-8d3e-bd168df611cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:47.502912 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ac004-c234-4230-8d3e-bd168df611cc admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:47.514506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1282/2595] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:47 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:47.519372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c74ab-fe8e-4b0e-bddd-c0e590098bbe admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:47.530367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c74ab-fe8e-4b0e-bddd-c0e590098bbe admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:47.535634 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444fce6-ed58-4d97-a832-c5b41d5ab5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:47.537513 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444fce6-ed58-4d97-a832-c5b41d5ab5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:47.537513 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444fce6-ed58-4d97-a832-c5b41d5ab5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:47.537513 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444fce6-ed58-4d97-a832-c5b41d5ab5f6 admin admin] PATH_INFO: `/v3/projects/9385b68938cc4c35afc128c582753572/users/bc14ecb5718a4f739f7db15514c83a19/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:47.559123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444fce6-ed58-4d97-a832-c5b41d5ab5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9385b68938cc4c35afc128c582753572, user_id=bc14ecb5718a4f739f7db15514c83a19, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:47.561934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444fce6-ed58-4d97-a832-c5b41d5ab5f6 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:47.597959 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ac004-c234-4230-8d3e-bd168df611cc admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:47.599716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d13ac004-c234-4230-8d3e-bd168df611cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:47.638564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1314/2596] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:11:47 2022] PUT /identity/v3/projects/9385b68938cc4c35afc128c582753572/users/bc14ecb5718a4f739f7db15514c83a19/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:47.648970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e6404-c6dd-4395-acda-badb314004ab None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:47.649624 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e6404-c6dd-4395-acda-badb314004ab None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:47.649624 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e6404-c6dd-4395-acda-badb314004ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:47.660561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ac004-c234-4230-8d3e-bd168df611cc admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:47.676474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-119e6404-c6dd-4395-acda-badb314004ab None None] MFA Rules not processed for user `bc14ecb5718a4f739f7db15514c83a19`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:47.677687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-119e6404-c6dd-4395-acda-badb314004ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:47.712386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc96ba1-c952-470d-9af5-0da4a740876a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:47.713237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc96ba1-c952-470d-9af5-0da4a740876a service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:47.713600 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc96ba1-c952-470d-9af5-0da4a740876a service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:47.713957 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc96ba1-c952-470d-9af5-0da4a740876a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:47.715783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8bc96ba1-c952-470d-9af5-0da4a740876a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:47.746334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1315/2597] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:11:47.750698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e6404-c6dd-4395-acda-badb314004ab None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:47.761763 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:47.771703 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:47.779924 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc96ba1-c952-470d-9af5-0da4a740876a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:47.781373 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc96ba1-c952-470d-9af5-0da4a740876a service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:47.792994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1283/2598] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:11:47.816672 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e6404-c6dd-4395-acda-badb314004ab None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:47.822067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c3c09-61a9-4b4e-b76e-79b443c8b669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:47.822762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c3c09-61a9-4b4e-b76e-79b443c8b669 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:47.823075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c3c09-61a9-4b4e-b76e-79b443c8b669 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:47.823353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c3c09-61a9-4b4e-b76e-79b443c8b669 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:47.824062 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c3c09-61a9-4b4e-b76e-79b443c8b669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:47.826234 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c3c09-61a9-4b4e-b76e-79b443c8b669 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:47.932675 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1316/2599] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:11:47 2022] POST /identity/v3/projects => generated 382 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:11:47.945900 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc96ba1-c952-470d-9af5-0da4a740876a service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:47.945900 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc96ba1-c952-470d-9af5-0da4a740876a service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:48.003149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c1f4c-c322-426c-ac50-056b1399ae61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:48.003838 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c1f4c-c322-426c-ac50-056b1399ae61 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:48.004129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c1f4c-c322-426c-ac50-056b1399ae61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:48.004411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c1f4c-c322-426c-ac50-056b1399ae61 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:48.005125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c1f4c-c322-426c-ac50-056b1399ae61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:48.007107 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c1f4c-c322-426c-ac50-056b1399ae61 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:48.129634 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1284/2600] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:11:47 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:48.133770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c3c09-61a9-4b4e-b76e-79b443c8b669 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:48.144679 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c3c09-61a9-4b4e-b76e-79b443c8b669 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:48.149345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a609af-c1d7-4065-acd4-8ad244370329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:48.150678 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a609af-c1d7-4065-acd4-8ad244370329 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:48.150967 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a609af-c1d7-4065-acd4-8ad244370329 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:48.151246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a609af-c1d7-4065-acd4-8ad244370329 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:48.151976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a609af-c1d7-4065-acd4-8ad244370329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:48.153910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a609af-c1d7-4065-acd4-8ad244370329 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:48.164943 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1317/2601] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:48 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:48.170100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c1f4c-c322-426c-ac50-056b1399ae61 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:48.180350 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c1f4c-c322-426c-ac50-056b1399ae61 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:48.185750 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf4fdf-0d29-4878-9a3c-5fe3375a9f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:48.186620 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf4fdf-0d29-4878-9a3c-5fe3375a9f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:48.186910 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf4fdf-0d29-4878-9a3c-5fe3375a9f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:48.187189 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf4fdf-0d29-4878-9a3c-5fe3375a9f05 admin admin] PATH_INFO: `/v3/projects/35f26588d9b44515b64ad2a2175e824b/users/c21f639a39e545f69560ccf1d3db1eaf/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:48.204507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf4fdf-0d29-4878-9a3c-5fe3375a9f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f26588d9b44515b64ad2a2175e824b, user_id=c21f639a39e545f69560ccf1d3db1eaf, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:48.207704 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf4fdf-0d29-4878-9a3c-5fe3375a9f05 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:48.295172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1285/2602] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:11:48 2022] PUT /identity/v3/projects/35f26588d9b44515b64ad2a2175e824b/users/c21f639a39e545f69560ccf1d3db1eaf/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:48.299267 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a609af-c1d7-4065-acd4-8ad244370329 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:48.316836 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a609af-c1d7-4065-acd4-8ad244370329 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:48.379033 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bca543-6cdd-402b-ac95-442fe94c594e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:48.379701 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bca543-6cdd-402b-ac95-442fe94c594e admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:48.379981 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bca543-6cdd-402b-ac95-442fe94c594e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:48.380252 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bca543-6cdd-402b-ac95-442fe94c594e admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:48.380987 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bca543-6cdd-402b-ac95-442fe94c594e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:48.382642 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bca543-6cdd-402b-ac95-442fe94c594e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:48.393593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1318/2603] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:48 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:48.397922 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf4fdf-0d29-4878-9a3c-5fe3375a9f05 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:48.409170 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf4fdf-0d29-4878-9a3c-5fe3375a9f05 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:48.415780 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de383741-116e-4e95-a826-e923f2a956e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:48.416855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de383741-116e-4e95-a826-e923f2a956e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:48.423823 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de383741-116e-4e95-a826-e923f2a956e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:48.423823 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de383741-116e-4e95-a826-e923f2a956e3 admin admin] PATH_INFO: `/v3/projects/35f26588d9b44515b64ad2a2175e824b/users/c21f639a39e545f69560ccf1d3db1eaf/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:48.423823 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de383741-116e-4e95-a826-e923f2a956e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f26588d9b44515b64ad2a2175e824b, user_id=c21f639a39e545f69560ccf1d3db1eaf, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:48.423823 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de383741-116e-4e95-a826-e923f2a956e3 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:48.433678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1286/2604] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:11:48 2022] PUT /identity/v3/projects/35f26588d9b44515b64ad2a2175e824b/users/c21f639a39e545f69560ccf1d3db1eaf/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:11:48.444018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67726988-6ce2-4f9f-b8cc-604dd004bb60 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:48.444319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67726988-6ce2-4f9f-b8cc-604dd004bb60 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:48.444597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67726988-6ce2-4f9f-b8cc-604dd004bb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:48.472040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-67726988-6ce2-4f9f-b8cc-604dd004bb60 None None] MFA Rules not processed for user `c21f639a39e545f69560ccf1d3db1eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:48.473266 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-67726988-6ce2-4f9f-b8cc-604dd004bb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:48.546347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1319/2605] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:48.557210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de383741-116e-4e95-a826-e923f2a956e3 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:48.559436 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-de383741-116e-4e95-a826-e923f2a956e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:48.626507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de383741-116e-4e95-a826-e923f2a956e3 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:48.630613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43574bff-df1a-4ba6-9304-9fb0d4a51ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:48.631180 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43574bff-df1a-4ba6-9304-9fb0d4a51ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:48.631468 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43574bff-df1a-4ba6-9304-9fb0d4a51ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:48.631807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43574bff-df1a-4ba6-9304-9fb0d4a51ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:48.642105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43574bff-df1a-4ba6-9304-9fb0d4a51ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:48.643585 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43574bff-df1a-4ba6-9304-9fb0d4a51ec2 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:48.653844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1287/2606] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:49.241269 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67726988-6ce2-4f9f-b8cc-604dd004bb60 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:49.268082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:49.311048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67726988-6ce2-4f9f-b8cc-604dd004bb60 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:49.316180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6e804-6713-4f5d-8cd4-d30e58988e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:49.316900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6e804-6713-4f5d-8cd4-d30e58988e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:49.317237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6e804-6713-4f5d-8cd4-d30e58988e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:49.322061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6e804-6713-4f5d-8cd4-d30e58988e4d admin admin] PATH_INFO: `/v3/users/bc14ecb5718a4f739f7db15514c83a19` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:49.322061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6e804-6713-4f5d-8cd4-d30e58988e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc14ecb5718a4f739f7db15514c83a19)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:49.322061 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6e804-6713-4f5d-8cd4-d30e58988e4d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:49.532928 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-cde6e804-6713-4f5d-8cd4-d30e58988e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc14ecb5718a4f739f7db15514c83a19'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:49.533600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-cde6e804-6713-4f5d-8cd4-d30e58988e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc14ecb5718a4f739f7db15514c83a19'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:49.551549 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-cde6e804-6713-4f5d-8cd4-d30e58988e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc14ecb5718a4f739f7db15514c83a19'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:49.660528 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-cde6e804-6713-4f5d-8cd4-d30e58988e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc14ecb5718a4f739f7db15514c83a19'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:49.671442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-cde6e804-6713-4f5d-8cd4-d30e58988e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc14ecb5718a4f739f7db15514c83a19'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:49.683989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1320/2607] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:11:49 2022] DELETE /identity/v3/users/bc14ecb5718a4f739f7db15514c83a19 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:49.686108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30ffd9-a980-4dcc-a756-13e22ed29943 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:49.686610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30ffd9-a980-4dcc-a756-13e22ed29943 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:49.686610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30ffd9-a980-4dcc-a756-13e22ed29943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:49.708522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-dd30ffd9-a980-4dcc-a756-13e22ed29943 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:49.709815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-dd30ffd9-a980-4dcc-a756-13e22ed29943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:49.745297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:49.774358 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1288/2608] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:11:49.784110 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6e804-6713-4f5d-8cd4-d30e58988e4d admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:49.785905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-cde6e804-6713-4f5d-8cd4-d30e58988e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:49.888002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6e804-6713-4f5d-8cd4-d30e58988e4d admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:49.892156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6410d-ebcb-4b22-bead-a564e5275af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:49.893129 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6410d-ebcb-4b22-bead-a564e5275af7 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:49.893392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6410d-ebcb-4b22-bead-a564e5275af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:49.893800 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6410d-ebcb-4b22-bead-a564e5275af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:49.906874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6410d-ebcb-4b22-bead-a564e5275af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:49.908467 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6410d-ebcb-4b22-bead-a564e5275af7 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:49.930553 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1321/2609] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:50.570489 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30ffd9-a980-4dcc-a756-13e22ed29943 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:50.572562 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-dd30ffd9-a980-4dcc-a756-13e22ed29943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:50.585509 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30ffd9-a980-4dcc-a756-13e22ed29943 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:50.607281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea3311-d111-473e-b747-0f06f368ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:50.607281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea3311-d111-473e-b747-0f06f368ac8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:50.607281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea3311-d111-473e-b747-0f06f368ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:50.607281 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea3311-d111-473e-b747-0f06f368ac8d admin admin] PATH_INFO: `/v3/projects/9385b68938cc4c35afc128c582753572` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:50.608511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea3311-d111-473e-b747-0f06f368ac8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9385b68938cc4c35afc128c582753572)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:50.608511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea3311-d111-473e-b747-0f06f368ac8d admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:50.769323 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-53ea3311-d111-473e-b747-0f06f368ac8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9385b68938cc4c35afc128c582753572', 'request_id': 'req-53ea3311-d111-473e-b747-0f06f368ac8d'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:50.832304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-53ea3311-d111-473e-b747-0f06f368ac8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9385b68938cc4c35afc128c582753572', 'request_id': 'req-53ea3311-d111-473e-b747-0f06f368ac8d'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:50.841218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-53ea3311-d111-473e-b747-0f06f368ac8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9385b68938cc4c35afc128c582753572', 'request_id': 'req-53ea3311-d111-473e-b747-0f06f368ac8d'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:50.854385 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-53ea3311-d111-473e-b747-0f06f368ac8d admin admin] The token cache is being invalidate because project 9385b68938cc4c35afc128c582753572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:50.854746 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-53ea3311-d111-473e-b747-0f06f368ac8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:50.855424 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-53ea3311-d111-473e-b747-0f06f368ac8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:50.857021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1289/2610] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:11:50 2022] DELETE /identity/v3/projects/9385b68938cc4c35afc128c582753572 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:50.861042 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6410d-ebcb-4b22-bead-a564e5275af7 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:50.871539 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6410d-ebcb-4b22-bead-a564e5275af7 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:50.909221 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:50.934729 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f895c-fd2d-4091-a159-7310bf43b602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:50.935627 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f895c-fd2d-4091-a159-7310bf43b602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:50.935911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f895c-fd2d-4091-a159-7310bf43b602 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:50.936189 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f895c-fd2d-4091-a159-7310bf43b602 admin admin] PATH_INFO: `/v3/users/c21f639a39e545f69560ccf1d3db1eaf` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:50.937478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f895c-fd2d-4091-a159-7310bf43b602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21f639a39e545f69560ccf1d3db1eaf)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:50.939441 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f895c-fd2d-4091-a159-7310bf43b602 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:51.202539 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a17f895c-fd2d-4091-a159-7310bf43b602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21f639a39e545f69560ccf1d3db1eaf'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:51.203753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a17f895c-fd2d-4091-a159-7310bf43b602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21f639a39e545f69560ccf1d3db1eaf'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:51.221944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a17f895c-fd2d-4091-a159-7310bf43b602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21f639a39e545f69560ccf1d3db1eaf'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:51.339219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a17f895c-fd2d-4091-a159-7310bf43b602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21f639a39e545f69560ccf1d3db1eaf'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:51.353092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a17f895c-fd2d-4091-a159-7310bf43b602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21f639a39e545f69560ccf1d3db1eaf'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:51.360916 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1322/2611] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:11:50 2022] DELETE /identity/v3/users/c21f639a39e545f69560ccf1d3db1eaf => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:51.766084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea3311-d111-473e-b747-0f06f368ac8d admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:51.768149 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-53ea3311-d111-473e-b747-0f06f368ac8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:51.859605 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea3311-d111-473e-b747-0f06f368ac8d admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:51.913162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:51.919454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86fb7f-4855-40de-bb66-6b883165e507 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:51.920309 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86fb7f-4855-40de-bb66-6b883165e507 service placement] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:51.920415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86fb7f-4855-40de-bb66-6b883165e507 service placement] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:51.920757 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86fb7f-4855-40de-bb66-6b883165e507 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:51.922613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-eb86fb7f-4855-40de-bb66-6b883165e507 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:51.934267 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86fb7f-4855-40de-bb66-6b883165e507 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:51.935878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86fb7f-4855-40de-bb66-6b883165e507 service placement] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:51.946477 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1290/2612] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:51.955828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f895c-fd2d-4091-a159-7310bf43b602 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:51.957289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a17f895c-fd2d-4091-a159-7310bf43b602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:51.961042 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86fb7f-4855-40de-bb66-6b883165e507 service placement] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:51.963124 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-eb86fb7f-4855-40de-bb66-6b883165e507 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:52.033972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f895c-fd2d-4091-a159-7310bf43b602 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:52.038734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d774be-4dbb-46ba-8a75-81d0d4528814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:52.039608 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d774be-4dbb-46ba-8a75-81d0d4528814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:52.039910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d774be-4dbb-46ba-8a75-81d0d4528814 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:52.040836 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d774be-4dbb-46ba-8a75-81d0d4528814 admin admin] PATH_INFO: `/v3/users/289cb250e20344d28bd5fd17255d5896` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:52.042285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86fb7f-4855-40de-bb66-6b883165e507 service placement] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:52.042467 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d774be-4dbb-46ba-8a75-81d0d4528814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=289cb250e20344d28bd5fd17255d5896)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:52.044231 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d774be-4dbb-46ba-8a75-81d0d4528814 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:52.052725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f41488-5dbb-42e4-bc39-6600f174422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:52.053596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f41488-5dbb-42e4-bc39-6600f174422a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:52.053971 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f41488-5dbb-42e4-bc39-6600f174422a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:52.054271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f41488-5dbb-42e4-bc39-6600f174422a admin admin] PATH_INFO: `/v3/projects/35f26588d9b44515b64ad2a2175e824b` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:52.055551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f41488-5dbb-42e4-bc39-6600f174422a admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f26588d9b44515b64ad2a2175e824b)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:52.058233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f41488-5dbb-42e4-bc39-6600f174422a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:52.272798 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e1d774be-4dbb-46ba-8a75-81d0d4528814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289cb250e20344d28bd5fd17255d5896'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:52.273058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-23f41488-5dbb-42e4-bc39-6600f174422a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f26588d9b44515b64ad2a2175e824b', 'request_id': 'req-23f41488-5dbb-42e4-bc39-6600f174422a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:52.273461 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e1d774be-4dbb-46ba-8a75-81d0d4528814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289cb250e20344d28bd5fd17255d5896'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:52.282223 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:52.286665 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e1d774be-4dbb-46ba-8a75-81d0d4528814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289cb250e20344d28bd5fd17255d5896'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:52.345875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-23f41488-5dbb-42e4-bc39-6600f174422a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f26588d9b44515b64ad2a2175e824b', 'request_id': 'req-23f41488-5dbb-42e4-bc39-6600f174422a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:52.353186 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-23f41488-5dbb-42e4-bc39-6600f174422a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f26588d9b44515b64ad2a2175e824b', 'request_id': 'req-23f41488-5dbb-42e4-bc39-6600f174422a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:52.364519 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-23f41488-5dbb-42e4-bc39-6600f174422a admin admin] The token cache is being invalidate because project 35f26588d9b44515b64ad2a2175e824b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:52.364813 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-23f41488-5dbb-42e4-bc39-6600f174422a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:52.365486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-23f41488-5dbb-42e4-bc39-6600f174422a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:52.367078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1291/2613] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:11:51 2022] DELETE /identity/v3/projects/35f26588d9b44515b64ad2a2175e824b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:52.372664 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308d4d5-528c-4aa0-9742-e2f653a04a46 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:52.372955 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308d4d5-528c-4aa0-9742-e2f653a04a46 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:52.373231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308d4d5-528c-4aa0-9742-e2f653a04a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:52.392133 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-3308d4d5-528c-4aa0-9742-e2f653a04a46 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:52.393342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-3308d4d5-528c-4aa0-9742-e2f653a04a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:52.443523 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e1d774be-4dbb-46ba-8a75-81d0d4528814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289cb250e20344d28bd5fd17255d5896'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:52.451751 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1292/2614] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:11:52.452418 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e1d774be-4dbb-46ba-8a75-81d0d4528814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289cb250e20344d28bd5fd17255d5896'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:52.458780 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1323/2615] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:11:51 2022] DELETE /identity/v3/users/289cb250e20344d28bd5fd17255d5896 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:52.459582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcc6f2-3c9a-41b3-b003-935defacee8c None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:52.459891 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcc6f2-3c9a-41b3-b003-935defacee8c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:52.460180 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcc6f2-3c9a-41b3-b003-935defacee8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:52.479236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-bbdcc6f2-3c9a-41b3-b003-935defacee8c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:52.480480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-bbdcc6f2-3c9a-41b3-b003-935defacee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:52.542277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1293/2616] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:11:52.550595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d774be-4dbb-46ba-8a75-81d0d4528814 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:52.552041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e1d774be-4dbb-46ba-8a75-81d0d4528814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:52.565804 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d774be-4dbb-46ba-8a75-81d0d4528814 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:52.570427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513e334-d9e6-42fd-8376-56ec6f405039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:52.571092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513e334-d9e6-42fd-8376-56ec6f405039 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:52.571897 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513e334-d9e6-42fd-8376-56ec6f405039 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:52.572222 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513e334-d9e6-42fd-8376-56ec6f405039 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:52.572904 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513e334-d9e6-42fd-8376-56ec6f405039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:11:52.573212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513e334-d9e6-42fd-8376-56ec6f405039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:52.574825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513e334-d9e6-42fd-8376-56ec6f405039 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:52.588059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1324/2617] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:11:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:11:52.596869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcc6f2-3c9a-41b3-b003-935defacee8c None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:52.606753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcc6f2-3c9a-41b3-b003-935defacee8c None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:52.611994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa0667-d401-4c9a-a8ee-9c61f5c92d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:52.612758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa0667-d401-4c9a-a8ee-9c61f5c92d57 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:52.613162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa0667-d401-4c9a-a8ee-9c61f5c92d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:52.613517 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa0667-d401-4c9a-a8ee-9c61f5c92d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:52.615624 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa0667-d401-4c9a-a8ee-9c61f5c92d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:52.618036 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa0667-d401-4c9a-a8ee-9c61f5c92d57 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:52.763207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1294/2618] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:11:52 2022] POST /identity/v3/projects => generated 374 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:52.767519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513e334-d9e6-42fd-8376-56ec6f405039 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:52.778497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513e334-d9e6-42fd-8376-56ec6f405039 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:52.811219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa0667-d401-4c9a-a8ee-9c61f5c92d57 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:52.813083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-6aaa0667-d401-4c9a-a8ee-9c61f5c92d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:52.848372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f2d5e-ac9d-4f82-ac37-6b00fb19d0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:52.848372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f2d5e-ac9d-4f82-ac37-6b00fb19d0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:52.848372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f2d5e-ac9d-4f82-ac37-6b00fb19d0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:52.848372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f2d5e-ac9d-4f82-ac37-6b00fb19d0b8 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:52.849262 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f2d5e-ac9d-4f82-ac37-6b00fb19d0b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:52.850449 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f2d5e-ac9d-4f82-ac37-6b00fb19d0b8 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:52.883255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa0667-d401-4c9a-a8ee-9c61f5c92d57 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:52.888651 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f4325-4f06-4ded-9f4e-10e90341faf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:52.889518 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f4325-4f06-4ded-9f4e-10e90341faf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:52.889865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f4325-4f06-4ded-9f4e-10e90341faf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:52.890133 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f4325-4f06-4ded-9f4e-10e90341faf0 admin admin] PATH_INFO: `/v3/projects/e6412eea680c4b2bbcac2efb59aabe52` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:52.891493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f4325-4f06-4ded-9f4e-10e90341faf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6412eea680c4b2bbcac2efb59aabe52)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:52.893422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f4325-4f06-4ded-9f4e-10e90341faf0 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:52.938174 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1325/2619] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:11:52 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:52.939260 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f2d5e-ac9d-4f82-ac37-6b00fb19d0b8 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:52.949136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f2d5e-ac9d-4f82-ac37-6b00fb19d0b8 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:52.954954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab2552-3077-469f-a4ad-525232a9cd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:52.955887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab2552-3077-469f-a4ad-525232a9cd91 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:52.956521 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab2552-3077-469f-a4ad-525232a9cd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:52.956631 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab2552-3077-469f-a4ad-525232a9cd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:52.957334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab2552-3077-469f-a4ad-525232a9cd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:52.959140 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab2552-3077-469f-a4ad-525232a9cd91 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:52.970976 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1326/2620] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:52 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:52.974912 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab2552-3077-469f-a4ad-525232a9cd91 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:52.986311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab2552-3077-469f-a4ad-525232a9cd91 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:52.991353 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28e243-a970-4d15-b144-8a9d1b096309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:52.992148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28e243-a970-4d15-b144-8a9d1b096309 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:52.992445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28e243-a970-4d15-b144-8a9d1b096309 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:52.992733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28e243-a970-4d15-b144-8a9d1b096309 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:52.993544 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28e243-a970-4d15-b144-8a9d1b096309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:52.995391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28e243-a970-4d15-b144-8a9d1b096309 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:53.009765 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1327/2621] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:52 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:11:53.010867 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28e243-a970-4d15-b144-8a9d1b096309 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:53.020359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28e243-a970-4d15-b144-8a9d1b096309 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:53.026959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e11f43-31a2-47cc-8a0b-abe9d5fd3ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:53.027846 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e11f43-31a2-47cc-8a0b-abe9d5fd3ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:53.028128 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e11f43-31a2-47cc-8a0b-abe9d5fd3ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:53.028402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e11f43-31a2-47cc-8a0b-abe9d5fd3ae2 admin admin] PATH_INFO: `/v3/projects/3511d2b2c4014889ae449a05344ff57d/users/21c11bd00fde4b6a914ce707a502784a/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:53.043596 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e11f43-31a2-47cc-8a0b-abe9d5fd3ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3511d2b2c4014889ae449a05344ff57d, user_id=21c11bd00fde4b6a914ce707a502784a, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:53.046240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e11f43-31a2-47cc-8a0b-abe9d5fd3ae2 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:53.050257 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:53.055931 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b92f4325-4f06-4ded-9f4e-10e90341faf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6412eea680c4b2bbcac2efb59aabe52', 'request_id': 'req-b92f4325-4f06-4ded-9f4e-10e90341faf0'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:53.135805 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b92f4325-4f06-4ded-9f4e-10e90341faf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6412eea680c4b2bbcac2efb59aabe52', 'request_id': 'req-b92f4325-4f06-4ded-9f4e-10e90341faf0'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:53.142170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1328/2622] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:11:53 2022] PUT /identity/v3/projects/3511d2b2c4014889ae449a05344ff57d/users/21c11bd00fde4b6a914ce707a502784a/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:53.143347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b92f4325-4f06-4ded-9f4e-10e90341faf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6412eea680c4b2bbcac2efb59aabe52', 'request_id': 'req-b92f4325-4f06-4ded-9f4e-10e90341faf0'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:53.147059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde33008-0ff6-4ced-b879-59e1d3ab72fc None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:53.147354 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde33008-0ff6-4ced-b879-59e1d3ab72fc None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:53.147636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde33008-0ff6-4ced-b879-59e1d3ab72fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:53.156919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b92f4325-4f06-4ded-9f4e-10e90341faf0 admin admin] The token cache is being invalidate because project e6412eea680c4b2bbcac2efb59aabe52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:53.157302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b92f4325-4f06-4ded-9f4e-10e90341faf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:53.158057 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b92f4325-4f06-4ded-9f4e-10e90341faf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:53.162524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1295/2623] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:11:52 2022] DELETE /identity/v3/projects/e6412eea680c4b2bbcac2efb59aabe52 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:11:53.164836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f7e2d-be9b-425d-813b-7a3fc5b0d7d7 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:53.165139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f7e2d-be9b-425d-813b-7a3fc5b0d7d7 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:53.165865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f7e2d-be9b-425d-813b-7a3fc5b0d7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:53.168399 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-cde33008-0ff6-4ced-b879-59e1d3ab72fc None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:53.169691 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-cde33008-0ff6-4ced-b879-59e1d3ab72fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:53.186982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-2a9f7e2d-be9b-425d-813b-7a3fc5b0d7d7 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:53.190634 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2a9f7e2d-be9b-425d-813b-7a3fc5b0d7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:53.246032 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1329/2624] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:11:53.256095 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde33008-0ff6-4ced-b879-59e1d3ab72fc None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:53.257729 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-cde33008-0ff6-4ced-b879-59e1d3ab72fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:53.269972 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:53.278371 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1296/2625] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:11:53.280488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20e94a-988f-4011-8d78-c67adb6f1720 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:53.281221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20e94a-988f-4011-8d78-c67adb6f1720 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:53.281221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20e94a-988f-4011-8d78-c67adb6f1720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:53.305452 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-2a20e94a-988f-4011-8d78-c67adb6f1720 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:53.307399 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-2a20e94a-988f-4011-8d78-c67adb6f1720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:53.316773 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1297/2626] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:53.320514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20e94a-988f-4011-8d78-c67adb6f1720 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:53.324048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde33008-0ff6-4ced-b879-59e1d3ab72fc None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:53.327805 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd57ef7-d773-4721-a9ed-cc573669a885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:53.328471 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd57ef7-d773-4721-a9ed-cc573669a885 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:53.328753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd57ef7-d773-4721-a9ed-cc573669a885 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:53.329032 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd57ef7-d773-4721-a9ed-cc573669a885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:53.334006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20e94a-988f-4011-8d78-c67adb6f1720 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:53.340850 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd57ef7-d773-4721-a9ed-cc573669a885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:53.341747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676203c-b2be-46f5-b0d0-96b0e93f8f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:53.342354 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd57ef7-d773-4721-a9ed-cc573669a885 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:53.342477 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676203c-b2be-46f5-b0d0-96b0e93f8f19 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:53.345305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676203c-b2be-46f5-b0d0-96b0e93f8f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:53.345305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676203c-b2be-46f5-b0d0-96b0e93f8f19 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:53.345305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676203c-b2be-46f5-b0d0-96b0e93f8f19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:11:53.345305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676203c-b2be-46f5-b0d0-96b0e93f8f19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:53.346597 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676203c-b2be-46f5-b0d0-96b0e93f8f19 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:53.352478 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1330/2627] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:11:53.365075 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1298/2628] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:11:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:11:53.367329 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd57ef7-d773-4721-a9ed-cc573669a885 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:53.381428 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd57ef7-d773-4721-a9ed-cc573669a885 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:53.387405 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d922212-95e7-4ed2-8f1e-876926bd4aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:53.388099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d922212-95e7-4ed2-8f1e-876926bd4aee admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:53.390825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d922212-95e7-4ed2-8f1e-876926bd4aee admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:53.390825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d922212-95e7-4ed2-8f1e-876926bd4aee admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:53.390825 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d922212-95e7-4ed2-8f1e-876926bd4aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:53.391433 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d922212-95e7-4ed2-8f1e-876926bd4aee admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:53.491989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1331/2629] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:11:53 2022] POST /identity/v3/projects => generated 386 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:53.496551 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676203c-b2be-46f5-b0d0-96b0e93f8f19 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:53.507718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676203c-b2be-46f5-b0d0-96b0e93f8f19 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:53.576390 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb44e24-b603-4559-b7c6-a36f27478ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:53.577085 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb44e24-b603-4559-b7c6-a36f27478ddd admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:53.577525 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb44e24-b603-4559-b7c6-a36f27478ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:53.577811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb44e24-b603-4559-b7c6-a36f27478ddd admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:53.578920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb44e24-b603-4559-b7c6-a36f27478ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:53.581161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb44e24-b603-4559-b7c6-a36f27478ddd admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:53.695593 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1299/2630] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:11:53 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:53.700233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d922212-95e7-4ed2-8f1e-876926bd4aee admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:53.711036 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d922212-95e7-4ed2-8f1e-876926bd4aee admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:53.716044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529b031-5890-45af-ad41-32e666b29155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:53.722021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529b031-5890-45af-ad41-32e666b29155 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:53.722021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529b031-5890-45af-ad41-32e666b29155 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:53.722021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529b031-5890-45af-ad41-32e666b29155 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:53.722486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:53.722733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529b031-5890-45af-ad41-32e666b29155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:53.722733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529b031-5890-45af-ad41-32e666b29155 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:53.734761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1332/2631] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:53 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:53.738652 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb44e24-b603-4559-b7c6-a36f27478ddd admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:53.751007 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb44e24-b603-4559-b7c6-a36f27478ddd admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:53.756550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b52cac-b85c-4618-accf-a953c329d548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:53.757343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b52cac-b85c-4618-accf-a953c329d548 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:53.757732 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b52cac-b85c-4618-accf-a953c329d548 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:53.758147 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b52cac-b85c-4618-accf-a953c329d548 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:53.759558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b52cac-b85c-4618-accf-a953c329d548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:53.761447 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b52cac-b85c-4618-accf-a953c329d548 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:53.773575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1300/2632] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:11:53 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:53.784872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529b031-5890-45af-ad41-32e666b29155 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:53.802602 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529b031-5890-45af-ad41-32e666b29155 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:53.812563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34689f9-83ce-446c-9431-1a35b04aae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:53.812563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34689f9-83ce-446c-9431-1a35b04aae7f admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:53.812563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34689f9-83ce-446c-9431-1a35b04aae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:53.812563 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34689f9-83ce-446c-9431-1a35b04aae7f admin admin] PATH_INFO: `/v3/projects/32d9c3c9c417461aa8c4cbf1752e33a0/users/7289f3e9da4e48d9b85e15a2b6f00f59/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:53.827274 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34689f9-83ce-446c-9431-1a35b04aae7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d9c3c9c417461aa8c4cbf1752e33a0, user_id=7289f3e9da4e48d9b85e15a2b6f00f59, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:53.829907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34689f9-83ce-446c-9431-1a35b04aae7f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:53.957207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1333/2633] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:11:53 2022] PUT /identity/v3/projects/32d9c3c9c417461aa8c4cbf1752e33a0/users/7289f3e9da4e48d9b85e15a2b6f00f59/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:53.969150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93405686-d154-4d8c-bfb3-4db3f2bbf959 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:53.969700 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93405686-d154-4d8c-bfb3-4db3f2bbf959 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:53.969815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93405686-d154-4d8c-bfb3-4db3f2bbf959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:54.021735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-93405686-d154-4d8c-bfb3-4db3f2bbf959 None None] MFA Rules not processed for user `7289f3e9da4e48d9b85e15a2b6f00f59`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:54.023234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-93405686-d154-4d8c-bfb3-4db3f2bbf959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:54.163264 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1301/2634] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:54.177341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34689f9-83ce-446c-9431-1a35b04aae7f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:54.178275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-f34689f9-83ce-446c-9431-1a35b04aae7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:54.265962 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34689f9-83ce-446c-9431-1a35b04aae7f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:54.280734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353b143-728b-4e08-8c0a-6717dac26eaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:54.284698 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353b143-728b-4e08-8c0a-6717dac26eaf service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:54.285371 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353b143-728b-4e08-8c0a-6717dac26eaf service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:54.285991 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353b143-728b-4e08-8c0a-6717dac26eaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:54.297122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353b143-728b-4e08-8c0a-6717dac26eaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:54.299051 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353b143-728b-4e08-8c0a-6717dac26eaf service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:54.311341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1334/2635] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:55.193098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebb3cb-615d-48d3-ba9f-d97063e8b0b3 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:55.193588 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebb3cb-615d-48d3-ba9f-d97063e8b0b3 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:55.193795 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebb3cb-615d-48d3-ba9f-d97063e8b0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:55.235522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-95ebb3cb-615d-48d3-ba9f-d97063e8b0b3 None None] MFA Rules not processed for user `21c11bd00fde4b6a914ce707a502784a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:55.236760 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-95ebb3cb-615d-48d3-ba9f-d97063e8b0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:55.247183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:55.334727 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1302/2636] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:55.347205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353b143-728b-4e08-8c0a-6717dac26eaf service nova] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:55.348675 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a353b143-728b-4e08-8c0a-6717dac26eaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:55.392780 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:55.410814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353b143-728b-4e08-8c0a-6717dac26eaf service nova] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:55.416823 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6298df-7801-4416-8d20-2d5f30bbd95b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:55.418046 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6298df-7801-4416-8d20-2d5f30bbd95b service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:55.418599 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6298df-7801-4416-8d20-2d5f30bbd95b service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:55.419048 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6298df-7801-4416-8d20-2d5f30bbd95b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:55.429950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6298df-7801-4416-8d20-2d5f30bbd95b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:55.443192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6298df-7801-4416-8d20-2d5f30bbd95b service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:55.461078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1335/2637] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:11:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:58.385774 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5174ef2-db28-456d-b19d-b0d42366c292 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:58.386253 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5174ef2-db28-456d-b19d-b0d42366c292 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:58.386374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5174ef2-db28-456d-b19d-b0d42366c292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:58.404961 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-b5174ef2-db28-456d-b19d-b0d42366c292 None None] MFA Rules not processed for user `21c11bd00fde4b6a914ce707a502784a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:58.411927 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b5174ef2-db28-456d-b19d-b0d42366c292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:58.413154 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1303/2638] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:11:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:02.223093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6298df-7801-4416-8d20-2d5f30bbd95b service cinder] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:02.280106 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6298df-7801-4416-8d20-2d5f30bbd95b service cinder] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:02.284011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e8012-de38-431f-a629-afe8585ba6e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:02.284663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e8012-de38-431f-a629-afe8585ba6e7 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:02.284944 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e8012-de38-431f-a629-afe8585ba6e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:02.285216 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e8012-de38-431f-a629-afe8585ba6e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:02.287002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b12e8012-de38-431f-a629-afe8585ba6e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:02.370257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e8012-de38-431f-a629-afe8585ba6e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:02.371710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e8012-de38-431f-a629-afe8585ba6e7 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:02.390555 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1336/2639] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:03.344853 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5174ef2-db28-456d-b19d-b0d42366c292 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:03.359033 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5174ef2-db28-456d-b19d-b0d42366c292 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:03.365265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c13007-f0c8-4195-aced-9d70412931fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:03.365982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c13007-f0c8-4195-aced-9d70412931fc service nova] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:03.366275 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c13007-f0c8-4195-aced-9d70412931fc service nova] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:03.366596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c13007-f0c8-4195-aced-9d70412931fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:03.370184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-26c13007-f0c8-4195-aced-9d70412931fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:03.383970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c13007-f0c8-4195-aced-9d70412931fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:03.386405 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c13007-f0c8-4195-aced-9d70412931fc service nova] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:03.399484 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1304/2640] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:05.484807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e8012-de38-431f-a629-afe8585ba6e7 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:05.494838 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e8012-de38-431f-a629-afe8585ba6e7 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:05.498512 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815cdb2-1d31-4a51-ba23-4be623cbdd28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:05.499149 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815cdb2-1d31-4a51-ba23-4be623cbdd28 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:05.499430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815cdb2-1d31-4a51-ba23-4be623cbdd28 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:05.499705 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815cdb2-1d31-4a51-ba23-4be623cbdd28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:05.501449 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c815cdb2-1d31-4a51-ba23-4be623cbdd28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:05.563937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815cdb2-1d31-4a51-ba23-4be623cbdd28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:05.565375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815cdb2-1d31-4a51-ba23-4be623cbdd28 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:05.571187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:05.576455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1337/2641] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:07.623911 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c13007-f0c8-4195-aced-9d70412931fc service nova] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:07.639307 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c13007-f0c8-4195-aced-9d70412931fc service nova] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:07.644991 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffc78f-cb16-4062-97a9-781d61354bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:07.646084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc78f-cb16-4062-97a9-781d61354bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.646400 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc78f-cb16-4062-97a9-781d61354bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.646918 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc78f-cb16-4062-97a9-781d61354bb9 admin admin] PATH_INFO: `/v3/users/7289f3e9da4e48d9b85e15a2b6f00f59` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.648321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffc78f-cb16-4062-97a9-781d61354bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7289f3e9da4e48d9b85e15a2b6f00f59)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:07.650680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffc78f-cb16-4062-97a9-781d61354bb9 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:07.877072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1dffc78f-cb16-4062-97a9-781d61354bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7289f3e9da4e48d9b85e15a2b6f00f59'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:07.878707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1dffc78f-cb16-4062-97a9-781d61354bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7289f3e9da4e48d9b85e15a2b6f00f59'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:07.879471 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1dffc78f-cb16-4062-97a9-781d61354bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7289f3e9da4e48d9b85e15a2b6f00f59'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:08.009151 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1dffc78f-cb16-4062-97a9-781d61354bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7289f3e9da4e48d9b85e15a2b6f00f59'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:08.024324 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-1dffc78f-cb16-4062-97a9-781d61354bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7289f3e9da4e48d9b85e15a2b6f00f59'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:08.039143 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1305/2642] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:12:07 2022] DELETE /identity/v3/users/7289f3e9da4e48d9b85e15a2b6f00f59 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:08.044645 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb14f10-1233-4e7e-b73a-3ba29904ed33 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:08.045157 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb14f10-1233-4e7e-b73a-3ba29904ed33 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:08.045487 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb14f10-1233-4e7e-b73a-3ba29904ed33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:08.065482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-8eb14f10-1233-4e7e-b73a-3ba29904ed33 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:08.067233 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8eb14f10-1233-4e7e-b73a-3ba29904ed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:08.139927 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1338/2643] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:08.156122 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffc78f-cb16-4062-97a9-781d61354bb9 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:08.157591 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1dffc78f-cb16-4062-97a9-781d61354bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:08.231037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffc78f-cb16-4062-97a9-781d61354bb9 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:08.234676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80759a29-638b-469e-aabb-439291555da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:08.235337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80759a29-638b-469e-aabb-439291555da0 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:08.235627 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80759a29-638b-469e-aabb-439291555da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:08.235912 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80759a29-638b-469e-aabb-439291555da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:08.245693 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80759a29-638b-469e-aabb-439291555da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:08.247544 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80759a29-638b-469e-aabb-439291555da0 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:08.262631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1306/2644] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:09.261468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb14f10-1233-4e7e-b73a-3ba29904ed33 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:09.263134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8eb14f10-1233-4e7e-b73a-3ba29904ed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:09.276816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb14f10-1233-4e7e-b73a-3ba29904ed33 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:09.281921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676d59c-91ed-475a-872d-2f64efb6b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:09.282961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676d59c-91ed-475a-872d-2f64efb6b8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:09.283315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676d59c-91ed-475a-872d-2f64efb6b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:09.283783 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676d59c-91ed-475a-872d-2f64efb6b8a5 admin admin] PATH_INFO: `/v3/projects/32d9c3c9c417461aa8c4cbf1752e33a0` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:09.284948 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676d59c-91ed-475a-872d-2f64efb6b8a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d9c3c9c417461aa8c4cbf1752e33a0)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:09.287056 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676d59c-91ed-475a-872d-2f64efb6b8a5 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:09.455682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a676d59c-91ed-475a-872d-2f64efb6b8a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d9c3c9c417461aa8c4cbf1752e33a0', 'request_id': 'req-a676d59c-91ed-475a-872d-2f64efb6b8a5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:09.559715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a676d59c-91ed-475a-872d-2f64efb6b8a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d9c3c9c417461aa8c4cbf1752e33a0', 'request_id': 'req-a676d59c-91ed-475a-872d-2f64efb6b8a5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:09.571033 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a676d59c-91ed-475a-872d-2f64efb6b8a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d9c3c9c417461aa8c4cbf1752e33a0', 'request_id': 'req-a676d59c-91ed-475a-872d-2f64efb6b8a5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:09.584480 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a676d59c-91ed-475a-872d-2f64efb6b8a5 admin admin] The token cache is being invalidate because project 32d9c3c9c417461aa8c4cbf1752e33a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:09.584723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a676d59c-91ed-475a-872d-2f64efb6b8a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:09.585543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a676d59c-91ed-475a-872d-2f64efb6b8a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:09.587415 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1339/2645] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:12:09 2022] DELETE /identity/v3/projects/32d9c3c9c417461aa8c4cbf1752e33a0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:09.592563 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d1dab-7e88-45e2-8766-01d4e168c4fa None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:09.595313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d1dab-7e88-45e2-8766-01d4e168c4fa None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:09.595313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d1dab-7e88-45e2-8766-01d4e168c4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:09.600733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:09.614598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-f05d1dab-7e88-45e2-8766-01d4e168c4fa None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:09.616362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f05d1dab-7e88-45e2-8766-01d4e168c4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:09.698559 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1307/2646] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:09.708056 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8715cf-3073-44d8-96d9-46e962eb6504 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:09.708349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8715cf-3073-44d8-96d9-46e962eb6504 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:09.708836 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8715cf-3073-44d8-96d9-46e962eb6504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:09.729940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-9e8715cf-3073-44d8-96d9-46e962eb6504 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:09.731399 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-9e8715cf-3073-44d8-96d9-46e962eb6504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:09.739888 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1340/2647] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:09.745536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d1dab-7e88-45e2-8766-01d4e168c4fa None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:09.757413 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d1dab-7e88-45e2-8766-01d4e168c4fa None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:09.765767 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8afd7-f9bc-40a1-a313-83cbd05bf5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:09.765767 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8afd7-f9bc-40a1-a313-83cbd05bf5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:09.765767 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8afd7-f9bc-40a1-a313-83cbd05bf5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:09.766102 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8afd7-f9bc-40a1-a313-83cbd05bf5a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:09.766607 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8afd7-f9bc-40a1-a313-83cbd05bf5a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:09.766921 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8afd7-f9bc-40a1-a313-83cbd05bf5a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:09.768538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8afd7-f9bc-40a1-a313-83cbd05bf5a9 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:09.782710 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1308/2648] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:12:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:12:09.787132 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8715cf-3073-44d8-96d9-46e962eb6504 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:09.800552 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8715cf-3073-44d8-96d9-46e962eb6504 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:09.812413 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a5916-7e4f-4e39-9a94-70df7b588f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:09.813012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a5916-7e4f-4e39-9a94-70df7b588f3f admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:09.813791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a5916-7e4f-4e39-9a94-70df7b588f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:09.813791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a5916-7e4f-4e39-9a94-70df7b588f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:09.814315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a5916-7e4f-4e39-9a94-70df7b588f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:09.816275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a5916-7e4f-4e39-9a94-70df7b588f3f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:09.910363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1341/2649] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:12:09 2022] POST /identity/v3/projects => generated 374 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:09.914022 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8afd7-f9bc-40a1-a313-83cbd05bf5a9 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:09.924990 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8afd7-f9bc-40a1-a313-83cbd05bf5a9 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:09.983974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2122d-ebe9-4622-92c9-33a7c764c0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:09.984671 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2122d-ebe9-4622-92c9-33a7c764c0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:09.984963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2122d-ebe9-4622-92c9-33a7c764c0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:09.985246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2122d-ebe9-4622-92c9-33a7c764c0f8 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:09.985959 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2122d-ebe9-4622-92c9-33a7c764c0f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:09.987944 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2122d-ebe9-4622-92c9-33a7c764c0f8 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:10.088825 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1309/2650] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:12:09 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:10.092947 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a5916-7e4f-4e39-9a94-70df7b588f3f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:10.122975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a5916-7e4f-4e39-9a94-70df7b588f3f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:10.128284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dc12d-061f-4942-b127-c01ef09dee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:10.129058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dc12d-061f-4942-b127-c01ef09dee26 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:10.130857 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dc12d-061f-4942-b127-c01ef09dee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:10.130857 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dc12d-061f-4942-b127-c01ef09dee26 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:10.131472 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dc12d-061f-4942-b127-c01ef09dee26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:10.133164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dc12d-061f-4942-b127-c01ef09dee26 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:10.153231 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1342/2651] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:10 2022] GET /identity/v3/roles => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:10.157219 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2122d-ebe9-4622-92c9-33a7c764c0f8 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:10.167946 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2122d-ebe9-4622-92c9-33a7c764c0f8 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:10.173613 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547aa4eb-81bc-48f3-b665-54b836e0db62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:10.174300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aa4eb-81bc-48f3-b665-54b836e0db62 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:10.174631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aa4eb-81bc-48f3-b665-54b836e0db62 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:10.174911 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aa4eb-81bc-48f3-b665-54b836e0db62 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:10.175978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547aa4eb-81bc-48f3-b665-54b836e0db62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:10.177718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547aa4eb-81bc-48f3-b665-54b836e0db62 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:10.195945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1310/2652] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:10 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:10.200065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dc12d-061f-4942-b127-c01ef09dee26 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:10.212259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dc12d-061f-4942-b127-c01ef09dee26 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:10.218015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff6dba-9c15-49a3-807b-12eced69f8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:10.218940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff6dba-9c15-49a3-807b-12eced69f8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:10.219514 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff6dba-9c15-49a3-807b-12eced69f8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:10.219982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff6dba-9c15-49a3-807b-12eced69f8c8 admin admin] PATH_INFO: `/v3/projects/7c07e2c3a7254cd78ab18e657d999f51/users/53bd77b0c09f422f94bcc1b85a588eb9/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:10.238867 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff6dba-9c15-49a3-807b-12eced69f8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c07e2c3a7254cd78ab18e657d999f51, user_id=53bd77b0c09f422f94bcc1b85a588eb9, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:10.241565 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff6dba-9c15-49a3-807b-12eced69f8c8 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:10.359760 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1343/2653] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:12:10 2022] PUT /identity/v3/projects/7c07e2c3a7254cd78ab18e657d999f51/users/53bd77b0c09f422f94bcc1b85a588eb9/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:10.370289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758541f0-091d-42a5-ab43-e1e66851c65e None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:10.370678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758541f0-091d-42a5-ab43-e1e66851c65e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:10.370964 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758541f0-091d-42a5-ab43-e1e66851c65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:10.397121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-758541f0-091d-42a5-ab43-e1e66851c65e None None] MFA Rules not processed for user `53bd77b0c09f422f94bcc1b85a588eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:10.398350 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-758541f0-091d-42a5-ab43-e1e66851c65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:10.463268 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1311/2654] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:10.475042 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff6dba-9c15-49a3-807b-12eced69f8c8 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:10.476726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-49ff6dba-9c15-49a3-807b-12eced69f8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:10.499633 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:10.517923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758541f0-091d-42a5-ab43-e1e66851c65e None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:10.519412 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-758541f0-091d-42a5-ab43-e1e66851c65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:10.558028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff6dba-9c15-49a3-807b-12eced69f8c8 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:10.563732 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05655a-cb52-442c-9733-04d4e2a58cba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:10.564460 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05655a-cb52-442c-9733-04d4e2a58cba service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:10.564818 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05655a-cb52-442c-9733-04d4e2a58cba service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:10.565196 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05655a-cb52-442c-9733-04d4e2a58cba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:10.573764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05655a-cb52-442c-9733-04d4e2a58cba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:10.575310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05655a-cb52-442c-9733-04d4e2a58cba service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:10.584597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1344/2655] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:10.590408 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758541f0-091d-42a5-ab43-e1e66851c65e None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:10.595101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2f7e9-2462-44f4-8c1f-15c46e5f0923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:10.598561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2f7e9-2462-44f4-8c1f-15c46e5f0923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:10.598561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2f7e9-2462-44f4-8c1f-15c46e5f0923 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:10.598561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2f7e9-2462-44f4-8c1f-15c46e5f0923 admin admin] PATH_INFO: `/v3/users/9e09f6a92f064ec78231fa06782bafda` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:10.598561 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2f7e9-2462-44f4-8c1f-15c46e5f0923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e09f6a92f064ec78231fa06782bafda)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:10.599978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2f7e9-2462-44f4-8c1f-15c46e5f0923 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:10.873213 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-dba2f7e9-2462-44f4-8c1f-15c46e5f0923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e09f6a92f064ec78231fa06782bafda'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:10.873944 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-dba2f7e9-2462-44f4-8c1f-15c46e5f0923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e09f6a92f064ec78231fa06782bafda'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:10.874763 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-dba2f7e9-2462-44f4-8c1f-15c46e5f0923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e09f6a92f064ec78231fa06782bafda'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:11.015016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-dba2f7e9-2462-44f4-8c1f-15c46e5f0923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e09f6a92f064ec78231fa06782bafda'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:11.029026 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-dba2f7e9-2462-44f4-8c1f-15c46e5f0923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e09f6a92f064ec78231fa06782bafda'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:11.045108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1312/2656] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:12:10 2022] DELETE /identity/v3/users/9e09f6a92f064ec78231fa06782bafda => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:11.359072 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05655a-cb52-442c-9733-04d4e2a58cba service nova] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:11.381219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05655a-cb52-442c-9733-04d4e2a58cba service nova] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:11.463867 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42918c1f-9aea-42c4-95eb-169f1812008f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:11.465570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42918c1f-9aea-42c4-95eb-169f1812008f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:11.465570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42918c1f-9aea-42c4-95eb-169f1812008f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:11.465570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42918c1f-9aea-42c4-95eb-169f1812008f admin admin] PATH_INFO: `/v3/projects/0c9ae847a0d449ab9c875f8a4f936d6a` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:11.467109 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42918c1f-9aea-42c4-95eb-169f1812008f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c9ae847a0d449ab9c875f8a4f936d6a)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:11.468970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42918c1f-9aea-42c4-95eb-169f1812008f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:11.593067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-42918c1f-9aea-42c4-95eb-169f1812008f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c9ae847a0d449ab9c875f8a4f936d6a', 'request_id': 'req-42918c1f-9aea-42c4-95eb-169f1812008f'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:11.700404 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-42918c1f-9aea-42c4-95eb-169f1812008f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c9ae847a0d449ab9c875f8a4f936d6a', 'request_id': 'req-42918c1f-9aea-42c4-95eb-169f1812008f'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:11.707377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-42918c1f-9aea-42c4-95eb-169f1812008f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c9ae847a0d449ab9c875f8a4f936d6a', 'request_id': 'req-42918c1f-9aea-42c4-95eb-169f1812008f'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:11.718350 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-42918c1f-9aea-42c4-95eb-169f1812008f admin admin] The token cache is being invalidate because project 0c9ae847a0d449ab9c875f8a4f936d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:11.718651 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-42918c1f-9aea-42c4-95eb-169f1812008f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:11.719281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-42918c1f-9aea-42c4-95eb-169f1812008f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:11.720878 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1345/2657] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:12:11 2022] DELETE /identity/v3/projects/0c9ae847a0d449ab9c875f8a4f936d6a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:11.725848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c4c4a-55aa-454b-b3f3-ae4a49a9db75 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:11.726301 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c4c4a-55aa-454b-b3f3-ae4a49a9db75 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:11.726472 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c4c4a-55aa-454b-b3f3-ae4a49a9db75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:11.745915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-190c4c4a-55aa-454b-b3f3-ae4a49a9db75 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:11.747143 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-190c4c4a-55aa-454b-b3f3-ae4a49a9db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:11.806849 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1313/2658] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:11.814840 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ff561-26e6-4096-9383-54a5ae610664 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:11.815128 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ff561-26e6-4096-9383-54a5ae610664 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:11.815435 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ff561-26e6-4096-9383-54a5ae610664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:11.834163 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-8f7ff561-26e6-4096-9383-54a5ae610664 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:11.835398 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8f7ff561-26e6-4096-9383-54a5ae610664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:11.844143 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1346/2659] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:11.848361 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c4c4a-55aa-454b-b3f3-ae4a49a9db75 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:11.858932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c4c4a-55aa-454b-b3f3-ae4a49a9db75 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:11.863515 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898520c-c308-4f12-bbc9-8c7542430a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:11.864161 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898520c-c308-4f12-bbc9-8c7542430a1a admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:11.864445 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898520c-c308-4f12-bbc9-8c7542430a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:11.864723 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898520c-c308-4f12-bbc9-8c7542430a1a admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:11.865442 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898520c-c308-4f12-bbc9-8c7542430a1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:11.865774 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898520c-c308-4f12-bbc9-8c7542430a1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:11.867459 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898520c-c308-4f12-bbc9-8c7542430a1a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:11.879735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1314/2660] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:12:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:12:11.884052 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ff561-26e6-4096-9383-54a5ae610664 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:11.893768 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ff561-26e6-4096-9383-54a5ae610664 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:11.898561 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e46cd7-37ea-4d44-a2a3-d91ee40607ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:11.899210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e46cd7-37ea-4d44-a2a3-d91ee40607ee admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:11.899498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e46cd7-37ea-4d44-a2a3-d91ee40607ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:11.900292 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e46cd7-37ea-4d44-a2a3-d91ee40607ee admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:11.900987 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e46cd7-37ea-4d44-a2a3-d91ee40607ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:11.902955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e46cd7-37ea-4d44-a2a3-d91ee40607ee admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:12.034214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1347/2661] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:12:11 2022] POST /identity/v3/projects => generated 364 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:12.038462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898520c-c308-4f12-bbc9-8c7542430a1a admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:12.049355 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898520c-c308-4f12-bbc9-8c7542430a1a admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:12.106315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c76ea-ade0-4ec3-b864-47e08a88ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:12.107019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c76ea-ade0-4ec3-b864-47e08a88ce2b admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:12.107316 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c76ea-ade0-4ec3-b864-47e08a88ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:12.107602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c76ea-ade0-4ec3-b864-47e08a88ce2b admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:12.108308 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c76ea-ade0-4ec3-b864-47e08a88ce2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:12.110243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c76ea-ade0-4ec3-b864-47e08a88ce2b admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:12.117994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:12.232726 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1315/2662] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:12:12 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:12.236745 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e46cd7-37ea-4d44-a2a3-d91ee40607ee admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:12.247769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e46cd7-37ea-4d44-a2a3-d91ee40607ee admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:12.252408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b79d97-1f1e-48cd-aab3-aef6fa64b97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:12.253069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b79d97-1f1e-48cd-aab3-aef6fa64b97b admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:12.253445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b79d97-1f1e-48cd-aab3-aef6fa64b97b admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:12.253724 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b79d97-1f1e-48cd-aab3-aef6fa64b97b admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:12.254487 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b79d97-1f1e-48cd-aab3-aef6fa64b97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:12.256112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b79d97-1f1e-48cd-aab3-aef6fa64b97b admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:12.267712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1348/2663] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:12 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:12.271678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c76ea-ade0-4ec3-b864-47e08a88ce2b admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:12.282072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c76ea-ade0-4ec3-b864-47e08a88ce2b admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:12.286619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f4a6d-18b6-45bd-871d-e1902bdfb0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:12.287274 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f4a6d-18b6-45bd-871d-e1902bdfb0dd admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:12.287560 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f4a6d-18b6-45bd-871d-e1902bdfb0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:12.287835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f4a6d-18b6-45bd-871d-e1902bdfb0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:12.288547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f4a6d-18b6-45bd-871d-e1902bdfb0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:12.290133 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f4a6d-18b6-45bd-871d-e1902bdfb0dd admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:12.300003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1316/2664] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:12 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:12.305240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b79d97-1f1e-48cd-aab3-aef6fa64b97b admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:12.315167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b79d97-1f1e-48cd-aab3-aef6fa64b97b admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:12.319823 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6ec41-7bca-4099-848f-8f4c79b3981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:12.320942 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6ec41-7bca-4099-848f-8f4c79b3981e admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:12.321290 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6ec41-7bca-4099-848f-8f4c79b3981e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:12.322429 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6ec41-7bca-4099-848f-8f4c79b3981e admin admin] PATH_INFO: `/v3/projects/2b9b7cfcb0084cbdbc8ffcd78f6e1028/users/0fb72dc439df49b69c49076f87c8bdf5/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:12.339715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6ec41-7bca-4099-848f-8f4c79b3981e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9b7cfcb0084cbdbc8ffcd78f6e1028, user_id=0fb72dc439df49b69c49076f87c8bdf5, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:12.342426 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6ec41-7bca-4099-848f-8f4c79b3981e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:12.454342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1349/2665] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:12:12 2022] PUT /identity/v3/projects/2b9b7cfcb0084cbdbc8ffcd78f6e1028/users/0fb72dc439df49b69c49076f87c8bdf5/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:12.466121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0b4ff-a08d-41fc-a0df-7a0e570c5cd3 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:12.466441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0b4ff-a08d-41fc-a0df-7a0e570c5cd3 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:12.466728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0b4ff-a08d-41fc-a0df-7a0e570c5cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:12.492837 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-8ec0b4ff-a08d-41fc-a0df-7a0e570c5cd3 None None] MFA Rules not processed for user `0fb72dc439df49b69c49076f87c8bdf5`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:12.494773 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8ec0b4ff-a08d-41fc-a0df-7a0e570c5cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:12.561196 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1317/2666] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:12.565766 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6ec41-7bca-4099-848f-8f4c79b3981e admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:12.631930 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6ec41-7bca-4099-848f-8f4c79b3981e admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:12.637217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e080e-350d-4501-a68e-c5b69a0b1ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:12.637876 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e080e-350d-4501-a68e-c5b69a0b1ebd admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:12.638161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e080e-350d-4501-a68e-c5b69a0b1ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:12.638477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e080e-350d-4501-a68e-c5b69a0b1ebd admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:12.639172 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e080e-350d-4501-a68e-c5b69a0b1ebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:12.641067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e080e-350d-4501-a68e-c5b69a0b1ebd admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:12.782792 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1350/2667] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:12:12 2022] POST /identity/v3/projects => generated 364 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:12.786952 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0b4ff-a08d-41fc-a0df-7a0e570c5cd3 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:12.797729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0b4ff-a08d-41fc-a0df-7a0e570c5cd3 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:12.860307 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea05dd-b121-4c51-8f1e-de3b8217fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:12.860981 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea05dd-b121-4c51-8f1e-de3b8217fef0 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:12.861272 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea05dd-b121-4c51-8f1e-de3b8217fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:12.861555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea05dd-b121-4c51-8f1e-de3b8217fef0 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:12.862261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea05dd-b121-4c51-8f1e-de3b8217fef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:12.864322 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea05dd-b121-4c51-8f1e-de3b8217fef0 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:13.002346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1318/2668] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:12:12 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:13.006464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e080e-350d-4501-a68e-c5b69a0b1ebd admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:13.017230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e080e-350d-4501-a68e-c5b69a0b1ebd admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:13.021787 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eef3f-95e7-491f-bb62-db6032849551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:13.022479 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eef3f-95e7-491f-bb62-db6032849551 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.022768 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eef3f-95e7-491f-bb62-db6032849551 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.023067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eef3f-95e7-491f-bb62-db6032849551 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.023820 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577eef3f-95e7-491f-bb62-db6032849551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:13.025585 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577eef3f-95e7-491f-bb62-db6032849551 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:13.040391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1351/2669] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:13 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:13.044136 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea05dd-b121-4c51-8f1e-de3b8217fef0 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:13.054473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea05dd-b121-4c51-8f1e-de3b8217fef0 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:13.059867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6616d55-b254-4842-b390-effa14f63393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:13.060789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6616d55-b254-4842-b390-effa14f63393 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.061078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6616d55-b254-4842-b390-effa14f63393 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.061358 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6616d55-b254-4842-b390-effa14f63393 admin admin] PATH_INFO: `/v3/projects/d48f3b3d9a7c45a8b8c80555cc065ad9/users/7e9e3b90ecac4216ac403ae2f1248080/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.077311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6616d55-b254-4842-b390-effa14f63393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48f3b3d9a7c45a8b8c80555cc065ad9, user_id=7e9e3b90ecac4216ac403ae2f1248080, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:13.080032 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6616d55-b254-4842-b390-effa14f63393 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:13.098787 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:13.167805 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1319/2670] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:12:13 2022] PUT /identity/v3/projects/d48f3b3d9a7c45a8b8c80555cc065ad9/users/7e9e3b90ecac4216ac403ae2f1248080/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:13.171620 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eef3f-95e7-491f-bb62-db6032849551 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:13.182537 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eef3f-95e7-491f-bb62-db6032849551 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:13.240459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046320bc-f63a-402d-a569-54a21567d64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:13.241134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046320bc-f63a-402d-a569-54a21567d64d admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.241423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046320bc-f63a-402d-a569-54a21567d64d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.241703 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046320bc-f63a-402d-a569-54a21567d64d admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.242469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046320bc-f63a-402d-a569-54a21567d64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:13.244112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046320bc-f63a-402d-a569-54a21567d64d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:13.254309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1352/2671] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:13 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:13.258379 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6616d55-b254-4842-b390-effa14f63393 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:13.269037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6616d55-b254-4842-b390-effa14f63393 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:13.274587 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e4817-9872-43ae-9849-3659da3dd529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:13.276098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e4817-9872-43ae-9849-3659da3dd529 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.276384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e4817-9872-43ae-9849-3659da3dd529 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.276663 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e4817-9872-43ae-9849-3659da3dd529 admin admin] PATH_INFO: `/v3/projects/d48f3b3d9a7c45a8b8c80555cc065ad9/users/7e9e3b90ecac4216ac403ae2f1248080/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.278738 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e4817-9872-43ae-9849-3659da3dd529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48f3b3d9a7c45a8b8c80555cc065ad9, user_id=7e9e3b90ecac4216ac403ae2f1248080, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:13.281408 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e4817-9872-43ae-9849-3659da3dd529 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:13.286224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:13.294721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1320/2672] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:12:13 2022] PUT /identity/v3/projects/d48f3b3d9a7c45a8b8c80555cc065ad9/users/7e9e3b90ecac4216ac403ae2f1248080/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:13.305597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5169-bd06-4bdd-bfa6-1e90d27d10c8 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.305897 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5169-bd06-4bdd-bfa6-1e90d27d10c8 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.306813 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5169-bd06-4bdd-bfa6-1e90d27d10c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.335842 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-cb7b5169-bd06-4bdd-bfa6-1e90d27d10c8 None None] MFA Rules not processed for user `7e9e3b90ecac4216ac403ae2f1248080`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:13.337076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-cb7b5169-bd06-4bdd-bfa6-1e90d27d10c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:13.406470 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1353/2673] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:13.418091 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e4817-9872-43ae-9849-3659da3dd529 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:13.419923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-124e4817-9872-43ae-9849-3659da3dd529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:13.478366 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e4817-9872-43ae-9849-3659da3dd529 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:13.482099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f40e2-0baa-4e34-9fc1-7384d06e20ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:13.482783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f40e2-0baa-4e34-9fc1-7384d06e20ad service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.483079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f40e2-0baa-4e34-9fc1-7384d06e20ad service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.483363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f40e2-0baa-4e34-9fc1-7384d06e20ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.492627 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f40e2-0baa-4e34-9fc1-7384d06e20ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:13.495112 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f40e2-0baa-4e34-9fc1-7384d06e20ad service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:13.504535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1321/2674] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:13.764380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b5169-bd06-4bdd-bfa6-1e90d27d10c8 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:13.766043 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-cb7b5169-bd06-4bdd-bfa6-1e90d27d10c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:13.779088 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b5169-bd06-4bdd-bfa6-1e90d27d10c8 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:13.782725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e22303-d976-4fbd-a06e-40c4f2e2905b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:13.783606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e22303-d976-4fbd-a06e-40c4f2e2905b service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.783906 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e22303-d976-4fbd-a06e-40c4f2e2905b service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.784166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e22303-d976-4fbd-a06e-40c4f2e2905b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.804686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:13.842534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:13.846219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e22303-d976-4fbd-a06e-40c4f2e2905b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:13.847697 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e22303-d976-4fbd-a06e-40c4f2e2905b service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:13.857509 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1354/2675] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:16.331731 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f40e2-0baa-4e34-9fc1-7384d06e20ad service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:16.333386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-319f40e2-0baa-4e34-9fc1-7384d06e20ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:16.426221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f40e2-0baa-4e34-9fc1-7384d06e20ad service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.431117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8302e9-fd76-4c94-8290-069a7cb09531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.432339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8302e9-fd76-4c94-8290-069a7cb09531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.432851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8302e9-fd76-4c94-8290-069a7cb09531 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.433372 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8302e9-fd76-4c94-8290-069a7cb09531 admin admin] PATH_INFO: `/v3/users/53bd77b0c09f422f94bcc1b85a588eb9` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.434908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8302e9-fd76-4c94-8290-069a7cb09531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53bd77b0c09f422f94bcc1b85a588eb9)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.437392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8302e9-fd76-4c94-8290-069a7cb09531 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.691462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-5c8302e9-fd76-4c94-8290-069a7cb09531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53bd77b0c09f422f94bcc1b85a588eb9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:16.692136 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-5c8302e9-fd76-4c94-8290-069a7cb09531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53bd77b0c09f422f94bcc1b85a588eb9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:16.692744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-5c8302e9-fd76-4c94-8290-069a7cb09531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53bd77b0c09f422f94bcc1b85a588eb9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:16.767162 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-5c8302e9-fd76-4c94-8290-069a7cb09531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53bd77b0c09f422f94bcc1b85a588eb9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:16.781813 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-5c8302e9-fd76-4c94-8290-069a7cb09531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53bd77b0c09f422f94bcc1b85a588eb9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:16.783157 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:16.797094 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1322/2676] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:12:16 2022] DELETE /identity/v3/users/53bd77b0c09f422f94bcc1b85a588eb9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:16.801603 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ae611-480a-4d42-ba16-dbc650e9e063 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.802114 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ae611-480a-4d42-ba16-dbc650e9e063 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.802217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ae611-480a-4d42-ba16-dbc650e9e063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.819411 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-7a1ae611-480a-4d42-ba16-dbc650e9e063 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:16.820617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7a1ae611-480a-4d42-ba16-dbc650e9e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:16.885045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1355/2677] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:16.894491 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8302e9-fd76-4c94-8290-069a7cb09531 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:16.895929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5c8302e9-fd76-4c94-8290-069a7cb09531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:16.959644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8302e9-fd76-4c94-8290-069a7cb09531 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.964114 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51411f-889c-4365-907b-cd9c1561f0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.964850 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51411f-889c-4365-907b-cd9c1561f0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.965151 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51411f-889c-4365-907b-cd9c1561f0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.965448 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51411f-889c-4365-907b-cd9c1561f0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.975177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51411f-889c-4365-907b-cd9c1561f0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.976656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51411f-889c-4365-907b-cd9c1561f0d7 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.987615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1323/2678] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:17.605220 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ae611-480a-4d42-ba16-dbc650e9e063 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:17.606770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7a1ae611-480a-4d42-ba16-dbc650e9e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:17.618652 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ae611-480a-4d42-ba16-dbc650e9e063 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:17.623453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b21ea-96d2-4b8c-b65b-b29cff7bdfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:17.624323 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b21ea-96d2-4b8c-b65b-b29cff7bdfb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.624610 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b21ea-96d2-4b8c-b65b-b29cff7bdfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.624884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b21ea-96d2-4b8c-b65b-b29cff7bdfb2 admin admin] PATH_INFO: `/v3/projects/7c07e2c3a7254cd78ab18e657d999f51` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.626181 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b21ea-96d2-4b8c-b65b-b29cff7bdfb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c07e2c3a7254cd78ab18e657d999f51)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:17.629250 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b21ea-96d2-4b8c-b65b-b29cff7bdfb2 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:17.795253 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-123b21ea-96d2-4b8c-b65b-b29cff7bdfb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c07e2c3a7254cd78ab18e657d999f51', 'request_id': 'req-123b21ea-96d2-4b8c-b65b-b29cff7bdfb2'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:17.892469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-123b21ea-96d2-4b8c-b65b-b29cff7bdfb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c07e2c3a7254cd78ab18e657d999f51', 'request_id': 'req-123b21ea-96d2-4b8c-b65b-b29cff7bdfb2'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:17.899597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-123b21ea-96d2-4b8c-b65b-b29cff7bdfb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c07e2c3a7254cd78ab18e657d999f51', 'request_id': 'req-123b21ea-96d2-4b8c-b65b-b29cff7bdfb2'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:17.906543 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:17.912219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-123b21ea-96d2-4b8c-b65b-b29cff7bdfb2 admin admin] The token cache is being invalidate because project 7c07e2c3a7254cd78ab18e657d999f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:17.912498 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-123b21ea-96d2-4b8c-b65b-b29cff7bdfb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:17.913436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-123b21ea-96d2-4b8c-b65b-b29cff7bdfb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:17.915142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1356/2679] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:12:17 2022] DELETE /identity/v3/projects/7c07e2c3a7254cd78ab18e657d999f51 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:17.920180 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3300c71-506c-4f6a-8208-6bc36619f79c None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.920690 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3300c71-506c-4f6a-8208-6bc36619f79c None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.920798 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3300c71-506c-4f6a-8208-6bc36619f79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.940134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-b3300c71-506c-4f6a-8208-6bc36619f79c None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:17.941395 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b3300c71-506c-4f6a-8208-6bc36619f79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:18.004426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1324/2680] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:18.014177 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eed38-5972-4925-9efe-48372eeea8e2 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:18.014483 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eed38-5972-4925-9efe-48372eeea8e2 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:18.014778 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eed38-5972-4925-9efe-48372eeea8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:18.036027 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-cd9eed38-5972-4925-9efe-48372eeea8e2 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:18.037271 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-cd9eed38-5972-4925-9efe-48372eeea8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:18.045816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1357/2681] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:18.050297 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3300c71-506c-4f6a-8208-6bc36619f79c None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:18.061412 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3300c71-506c-4f6a-8208-6bc36619f79c None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:18.066086 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab2a24-7871-46ca-8061-12b97576ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:18.066775 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab2a24-7871-46ca-8061-12b97576ee60 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:18.067064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab2a24-7871-46ca-8061-12b97576ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:18.067344 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab2a24-7871-46ca-8061-12b97576ee60 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:18.068067 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab2a24-7871-46ca-8061-12b97576ee60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:18.068375 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab2a24-7871-46ca-8061-12b97576ee60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:18.069976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab2a24-7871-46ca-8061-12b97576ee60 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:18.083177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1325/2682] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:12:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:12:18.087587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9eed38-5972-4925-9efe-48372eeea8e2 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:18.096539 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9eed38-5972-4925-9efe-48372eeea8e2 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:18.101165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049509a-d6ff-48ea-a3f8-754026be202f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:18.101805 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049509a-d6ff-48ea-a3f8-754026be202f admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:18.102086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049509a-d6ff-48ea-a3f8-754026be202f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:18.102488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049509a-d6ff-48ea-a3f8-754026be202f admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:18.103721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049509a-d6ff-48ea-a3f8-754026be202f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:18.105744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049509a-d6ff-48ea-a3f8-754026be202f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:18.199259 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1358/2683] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:12:18 2022] POST /identity/v3/projects => generated 368 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:18.203462 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab2a24-7871-46ca-8061-12b97576ee60 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:18.217460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab2a24-7871-46ca-8061-12b97576ee60 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:18.279893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a30426-afcd-489f-994b-22404db0bf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:18.280467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a30426-afcd-489f-994b-22404db0bf4c admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:18.280754 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a30426-afcd-489f-994b-22404db0bf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:18.281029 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a30426-afcd-489f-994b-22404db0bf4c admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:18.282080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a30426-afcd-489f-994b-22404db0bf4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:18.284102 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a30426-afcd-489f-994b-22404db0bf4c admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:18.419878 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1326/2684] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:12:18 2022] POST /identity/v3/users => generated 285 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:18.423992 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049509a-d6ff-48ea-a3f8-754026be202f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:18.434971 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049509a-d6ff-48ea-a3f8-754026be202f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:18.439580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0963eee-c532-4b9e-973c-e09ae7953619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:18.440243 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0963eee-c532-4b9e-973c-e09ae7953619 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:18.440530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0963eee-c532-4b9e-973c-e09ae7953619 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:18.440807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0963eee-c532-4b9e-973c-e09ae7953619 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:18.441525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0963eee-c532-4b9e-973c-e09ae7953619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:18.443145 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0963eee-c532-4b9e-973c-e09ae7953619 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:18.453427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1359/2685] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:18 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:18.457743 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a30426-afcd-489f-994b-22404db0bf4c admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:18.468484 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a30426-afcd-489f-994b-22404db0bf4c admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:18.473427 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e44f9-b0de-40ed-a333-1e158bf718e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:18.474120 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e44f9-b0de-40ed-a333-1e158bf718e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:18.474438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e44f9-b0de-40ed-a333-1e158bf718e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:18.474718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e44f9-b0de-40ed-a333-1e158bf718e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:18.475438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e44f9-b0de-40ed-a333-1e158bf718e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:18.477028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e44f9-b0de-40ed-a333-1e158bf718e2 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:18.480181 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:18.489335 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1327/2686] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:18 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:18.493648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0963eee-c532-4b9e-973c-e09ae7953619 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:18.503820 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0963eee-c532-4b9e-973c-e09ae7953619 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:18.508998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9e0dc-b2c4-49c2-a1bd-10664d2c07c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:18.510295 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9e0dc-b2c4-49c2-a1bd-10664d2c07c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:18.510593 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9e0dc-b2c4-49c2-a1bd-10664d2c07c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:18.510880 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9e0dc-b2c4-49c2-a1bd-10664d2c07c7 admin admin] PATH_INFO: `/v3/projects/f027e44cc89d4809ba00bf76e4679274/users/dc6631265db34f35b732e5142627f661/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:18.528815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9e0dc-b2c4-49c2-a1bd-10664d2c07c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f027e44cc89d4809ba00bf76e4679274, user_id=dc6631265db34f35b732e5142627f661, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:18.531735 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9e0dc-b2c4-49c2-a1bd-10664d2c07c7 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:18.639115 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1360/2687] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:12:18 2022] PUT /identity/v3/projects/f027e44cc89d4809ba00bf76e4679274/users/dc6631265db34f35b732e5142627f661/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:18.656765 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4138e-fb23-417d-835d-e0a5af48328e None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:18.657194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4138e-fb23-417d-835d-e0a5af48328e None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:18.657560 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4138e-fb23-417d-835d-e0a5af48328e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:18.687639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-57b4138e-fb23-417d-835d-e0a5af48328e None None] MFA Rules not processed for user `dc6631265db34f35b732e5142627f661`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:18.688844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-57b4138e-fb23-417d-835d-e0a5af48328e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:18.753715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1328/2688] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:18.764631 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9e0dc-b2c4-49c2-a1bd-10664d2c07c7 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:18.766403 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-58b9e0dc-b2c4-49c2-a1bd-10664d2c07c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:18.823795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9e0dc-b2c4-49c2-a1bd-10664d2c07c7 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:18.827453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51080d81-6e49-494b-860b-6ae416970a44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:18.828100 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51080d81-6e49-494b-860b-6ae416970a44 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:18.828386 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51080d81-6e49-494b-860b-6ae416970a44 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:18.828663 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51080d81-6e49-494b-860b-6ae416970a44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:18.837834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51080d81-6e49-494b-860b-6ae416970a44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:18.840828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51080d81-6e49-494b-860b-6ae416970a44 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:18.848674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1361/2689] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:27.394882 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4138e-fb23-417d-835d-e0a5af48328e None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:27.397121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-57b4138e-fb23-417d-835d-e0a5af48328e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:27.490767 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4138e-fb23-417d-835d-e0a5af48328e None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:27.494623 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e53ac3-75c4-4751-b7c1-65d1380f41d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:27.495430 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53ac3-75c4-4751-b7c1-65d1380f41d2 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:27.495725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53ac3-75c4-4751-b7c1-65d1380f41d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:27.496123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53ac3-75c4-4751-b7c1-65d1380f41d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:27.498285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-60e53ac3-75c4-4751-b7c1-65d1380f41d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:27.585624 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e53ac3-75c4-4751-b7c1-65d1380f41d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:27.587103 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e53ac3-75c4-4751-b7c1-65d1380f41d2 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:27.607321 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1329/2690] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:28.844660 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:DELETE=2,keystone:SELECT=56,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:31.724550 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51080d81-6e49-494b-860b-6ae416970a44 service cinder] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:31.726047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-51080d81-6e49-494b-860b-6ae416970a44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:31.798364 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51080d81-6e49-494b-860b-6ae416970a44 service cinder] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:31.803202 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd99c47-2443-4005-b361-6b4f1e53c060 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:31.803855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd99c47-2443-4005-b361-6b4f1e53c060 service placement] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:31.804138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd99c47-2443-4005-b361-6b4f1e53c060 service placement] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:31.804415 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd99c47-2443-4005-b361-6b4f1e53c060 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:31.806184 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6cd99c47-2443-4005-b361-6b4f1e53c060 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:31.817759 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd99c47-2443-4005-b361-6b4f1e53c060 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:31.819626 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd99c47-2443-4005-b361-6b4f1e53c060 service placement] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:31.829638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1362/2691] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:32.386718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecd036-d352-444b-9e6d-c043e728690b None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:32.387290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecd036-d352-444b-9e6d-c043e728690b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:32.387290 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecd036-d352-444b-9e6d-c043e728690b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:32.405218 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-28ecd036-d352-444b-9e6d-c043e728690b None None] MFA Rules not processed for user `21c11bd00fde4b6a914ce707a502784a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:32.406527 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-28ecd036-d352-444b-9e6d-c043e728690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:32.442558 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:32.468418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1330/2692] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:32.727069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd99c47-2443-4005-b361-6b4f1e53c060 service placement] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:32.742871 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd99c47-2443-4005-b361-6b4f1e53c060 service placement] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:32.751403 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc612a3e-8f81-4329-9cb8-80424489cfcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:32.752287 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc612a3e-8f81-4329-9cb8-80424489cfcc service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:32.752578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc612a3e-8f81-4329-9cb8-80424489cfcc service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:32.752862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc612a3e-8f81-4329-9cb8-80424489cfcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:32.754696 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-bc612a3e-8f81-4329-9cb8-80424489cfcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:32.774940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc612a3e-8f81-4329-9cb8-80424489cfcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:32.776297 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc612a3e-8f81-4329-9cb8-80424489cfcc service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:32.790554 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1363/2693] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:32.969035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecd036-d352-444b-9e6d-c043e728690b None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:32.970581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-28ecd036-d352-444b-9e6d-c043e728690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:32.989308 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecd036-d352-444b-9e6d-c043e728690b None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:32.994152 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4894b-3c8c-4101-9500-6e2b8437a690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:32.995503 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4894b-3c8c-4101-9500-6e2b8437a690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:32.995828 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4894b-3c8c-4101-9500-6e2b8437a690 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:32.996285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4894b-3c8c-4101-9500-6e2b8437a690 admin admin] PATH_INFO: `/v3/users/0fb72dc439df49b69c49076f87c8bdf5` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:32.997752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4894b-3c8c-4101-9500-6e2b8437a690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb72dc439df49b69c49076f87c8bdf5)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:32.999933 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4894b-3c8c-4101-9500-6e2b8437a690 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:33.375979 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97d4894b-3c8c-4101-9500-6e2b8437a690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb72dc439df49b69c49076f87c8bdf5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:33.376555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97d4894b-3c8c-4101-9500-6e2b8437a690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb72dc439df49b69c49076f87c8bdf5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:33.377187 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97d4894b-3c8c-4101-9500-6e2b8437a690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb72dc439df49b69c49076f87c8bdf5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:33.475620 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97d4894b-3c8c-4101-9500-6e2b8437a690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb72dc439df49b69c49076f87c8bdf5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:33.520358 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-97d4894b-3c8c-4101-9500-6e2b8437a690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb72dc439df49b69c49076f87c8bdf5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:33.554397 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1331/2694] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:12:32 2022] DELETE /identity/v3/users/0fb72dc439df49b69c49076f87c8bdf5 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:33.557747 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053b576-194b-4718-9eb0-0d1530b9080f None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:33.559009 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053b576-194b-4718-9eb0-0d1530b9080f None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:33.560114 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053b576-194b-4718-9eb0-0d1530b9080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:33.616049 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-8053b576-194b-4718-9eb0-0d1530b9080f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:33.621156 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8053b576-194b-4718-9eb0-0d1530b9080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:33.693845 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1364/2695] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:33.733531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4894b-3c8c-4101-9500-6e2b8437a690 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:33.735177 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-97d4894b-3c8c-4101-9500-6e2b8437a690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:33.804668 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4894b-3c8c-4101-9500-6e2b8437a690 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:33.809932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070ad6a-881c-474b-ba71-026a0520811e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:33.810755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070ad6a-881c-474b-ba71-026a0520811e service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:33.811212 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070ad6a-881c-474b-ba71-026a0520811e service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:33.811467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070ad6a-881c-474b-ba71-026a0520811e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:33.821578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070ad6a-881c-474b-ba71-026a0520811e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:33.823065 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070ad6a-881c-474b-ba71-026a0520811e service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:33.837811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1332/2696] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:34.463485 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053b576-194b-4718-9eb0-0d1530b9080f None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:34.466534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8053b576-194b-4718-9eb0-0d1530b9080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:34.496522 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053b576-194b-4718-9eb0-0d1530b9080f None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:34.499346 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d990532-ee50-40b4-8225-83974c7a125f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:34.500523 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d990532-ee50-40b4-8225-83974c7a125f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:34.501059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d990532-ee50-40b4-8225-83974c7a125f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:34.501442 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d990532-ee50-40b4-8225-83974c7a125f admin admin] PATH_INFO: `/v3/projects/2b9b7cfcb0084cbdbc8ffcd78f6e1028` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:34.503002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d990532-ee50-40b4-8225-83974c7a125f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9b7cfcb0084cbdbc8ffcd78f6e1028)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:34.504989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d990532-ee50-40b4-8225-83974c7a125f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:34.705933 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0d990532-ee50-40b4-8225-83974c7a125f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9b7cfcb0084cbdbc8ffcd78f6e1028', 'request_id': 'req-0d990532-ee50-40b4-8225-83974c7a125f'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:34.814601 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0d990532-ee50-40b4-8225-83974c7a125f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9b7cfcb0084cbdbc8ffcd78f6e1028', 'request_id': 'req-0d990532-ee50-40b4-8225-83974c7a125f'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:34.821581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0d990532-ee50-40b4-8225-83974c7a125f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9b7cfcb0084cbdbc8ffcd78f6e1028', 'request_id': 'req-0d990532-ee50-40b4-8225-83974c7a125f'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:34.830024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:34.834091 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0d990532-ee50-40b4-8225-83974c7a125f admin admin] The token cache is being invalidate because project 2b9b7cfcb0084cbdbc8ffcd78f6e1028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:34.834402 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0d990532-ee50-40b4-8225-83974c7a125f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:34.835071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-0d990532-ee50-40b4-8225-83974c7a125f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:34.836645 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1365/2697] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:12:34 2022] DELETE /identity/v3/projects/2b9b7cfcb0084cbdbc8ffcd78f6e1028 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:34.841138 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070ad6a-881c-474b-ba71-026a0520811e service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:34.851726 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070ad6a-881c-474b-ba71-026a0520811e service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:34.911411 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:34.931858 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca804b-4898-437b-bdd2-f2809294a88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:34.932930 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca804b-4898-437b-bdd2-f2809294a88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:34.933330 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca804b-4898-437b-bdd2-f2809294a88c admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:34.934470 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca804b-4898-437b-bdd2-f2809294a88c admin admin] PATH_INFO: `/v3/users/7e9e3b90ecac4216ac403ae2f1248080` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:34.935779 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca804b-4898-437b-bdd2-f2809294a88c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e9e3b90ecac4216ac403ae2f1248080)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:34.937806 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca804b-4898-437b-bdd2-f2809294a88c admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:35.494393 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-71ca804b-4898-437b-bdd2-f2809294a88c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e9e3b90ecac4216ac403ae2f1248080'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:35.495051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-71ca804b-4898-437b-bdd2-f2809294a88c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e9e3b90ecac4216ac403ae2f1248080'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:35.496188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-71ca804b-4898-437b-bdd2-f2809294a88c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e9e3b90ecac4216ac403ae2f1248080'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:35.575807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-71ca804b-4898-437b-bdd2-f2809294a88c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e9e3b90ecac4216ac403ae2f1248080'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:35.595448 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-71ca804b-4898-437b-bdd2-f2809294a88c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e9e3b90ecac4216ac403ae2f1248080'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:35.618245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1333/2698] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:12:34 2022] DELETE /identity/v3/users/7e9e3b90ecac4216ac403ae2f1248080 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:36.367429 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d990532-ee50-40b4-8225-83974c7a125f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:36.369299 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0d990532-ee50-40b4-8225-83974c7a125f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:36.382630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d990532-ee50-40b4-8225-83974c7a125f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:36.446141 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd20e33-0387-4e88-ab11-628b38e21aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:36.447047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd20e33-0387-4e88-ab11-628b38e21aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:36.447341 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd20e33-0387-4e88-ab11-628b38e21aed admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:36.447622 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd20e33-0387-4e88-ab11-628b38e21aed admin admin] PATH_INFO: `/v3/projects/d48f3b3d9a7c45a8b8c80555cc065ad9` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:36.448834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd20e33-0387-4e88-ab11-628b38e21aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d48f3b3d9a7c45a8b8c80555cc065ad9)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:36.450766 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd20e33-0387-4e88-ab11-628b38e21aed admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:36.559829 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca804b-4898-437b-bdd2-f2809294a88c admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:36.561694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-71ca804b-4898-437b-bdd2-f2809294a88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:36.581761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca804b-4898-437b-bdd2-f2809294a88c admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:36.591126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-efd20e33-0387-4e88-ab11-628b38e21aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd48f3b3d9a7c45a8b8c80555cc065ad9', 'request_id': 'req-efd20e33-0387-4e88-ab11-628b38e21aed'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:36.654629 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d0f05-59e3-4ce7-a250-cdbf36360b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:36.655631 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d0f05-59e3-4ce7-a250-cdbf36360b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:36.655921 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d0f05-59e3-4ce7-a250-cdbf36360b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:36.656206 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d0f05-59e3-4ce7-a250-cdbf36360b20 admin admin] PATH_INFO: `/v3/users/530b2b1951644755afd1432381cf37f9` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:36.657833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d0f05-59e3-4ce7-a250-cdbf36360b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=530b2b1951644755afd1432381cf37f9)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:36.661193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d0f05-59e3-4ce7-a250-cdbf36360b20 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:36.676713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-efd20e33-0387-4e88-ab11-628b38e21aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd48f3b3d9a7c45a8b8c80555cc065ad9', 'request_id': 'req-efd20e33-0387-4e88-ab11-628b38e21aed'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:36.688064 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-efd20e33-0387-4e88-ab11-628b38e21aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd48f3b3d9a7c45a8b8c80555cc065ad9', 'request_id': 'req-efd20e33-0387-4e88-ab11-628b38e21aed'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:36.706778 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-efd20e33-0387-4e88-ab11-628b38e21aed admin admin] The token cache is being invalidate because project d48f3b3d9a7c45a8b8c80555cc065ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:36.707482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-efd20e33-0387-4e88-ab11-628b38e21aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:36.708372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-efd20e33-0387-4e88-ab11-628b38e21aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:36.711158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1366/2699] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:12:36 2022] DELETE /identity/v3/projects/d48f3b3d9a7c45a8b8c80555cc065ad9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:36.718190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31c45b-d6f7-49ba-8991-cb2773d7eb74 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:36.718546 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31c45b-d6f7-49ba-8991-cb2773d7eb74 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:36.718832 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31c45b-d6f7-49ba-8991-cb2773d7eb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:36.739987 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-1c31c45b-d6f7-49ba-8991-cb2773d7eb74 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:36.741246 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1c31c45b-d6f7-49ba-8991-cb2773d7eb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:36.752327 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1367/2700] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:36.759894 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc35136-cdb6-43a7-9deb-1ffa096eb536 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:36.760264 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc35136-cdb6-43a7-9deb-1ffa096eb536 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:36.760475 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc35136-cdb6-43a7-9deb-1ffa096eb536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:36.802727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-0bc35136-cdb6-43a7-9deb-1ffa096eb536 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:36.805006 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-0bc35136-cdb6-43a7-9deb-1ffa096eb536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:36.818372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1368/2701] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:36.825805 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc35136-cdb6-43a7-9deb-1ffa096eb536 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:36.844388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc35136-cdb6-43a7-9deb-1ffa096eb536 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:36.849474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacf324-c855-40be-b28b-8155a98b3536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:36.850144 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacf324-c855-40be-b28b-8155a98b3536 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:36.850455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacf324-c855-40be-b28b-8155a98b3536 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:36.850737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacf324-c855-40be-b28b-8155a98b3536 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:36.851456 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacf324-c855-40be-b28b-8155a98b3536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:36.851762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacf324-c855-40be-b28b-8155a98b3536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:36.853380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacf324-c855-40be-b28b-8155a98b3536 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:36.866720 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1369/2702] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:12:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:12:36.876127 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacf324-c855-40be-b28b-8155a98b3536 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:36.887225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacf324-c855-40be-b28b-8155a98b3536 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:36.892475 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e72b10-67c7-466d-9730-a95e1030441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:36.893159 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e72b10-67c7-466d-9730-a95e1030441d admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:36.893449 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e72b10-67c7-466d-9730-a95e1030441d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:36.893816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e72b10-67c7-466d-9730-a95e1030441d admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:36.894457 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e72b10-67c7-466d-9730-a95e1030441d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:36.900087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e72b10-67c7-466d-9730-a95e1030441d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:36.938701 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f84d0f05-59e3-4ce7-a250-cdbf36360b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530b2b1951644755afd1432381cf37f9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:36.941484 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f84d0f05-59e3-4ce7-a250-cdbf36360b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530b2b1951644755afd1432381cf37f9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:36.942191 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f84d0f05-59e3-4ce7-a250-cdbf36360b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530b2b1951644755afd1432381cf37f9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:37.175685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f84d0f05-59e3-4ce7-a250-cdbf36360b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530b2b1951644755afd1432381cf37f9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:37.183012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1370/2703] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:12:36 2022] POST /identity/v3/projects => generated 408 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:37.187380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e72b10-67c7-466d-9730-a95e1030441d admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:37.190007 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-29e72b10-67c7-466d-9730-a95e1030441d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:37.192072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f84d0f05-59e3-4ce7-a250-cdbf36360b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530b2b1951644755afd1432381cf37f9'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:37.201776 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:37.221385 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1334/2704] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:12:36 2022] DELETE /identity/v3/users/530b2b1951644755afd1432381cf37f9 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:37.269700 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:37.296690 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e72b10-67c7-466d-9730-a95e1030441d admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:37.361069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693cd05-63b0-4eac-8995-1ed622f9804e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:37.367031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693cd05-63b0-4eac-8995-1ed622f9804e admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:37.367031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693cd05-63b0-4eac-8995-1ed622f9804e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:37.367031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693cd05-63b0-4eac-8995-1ed622f9804e admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:37.367031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693cd05-63b0-4eac-8995-1ed622f9804e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:37.367031 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693cd05-63b0-4eac-8995-1ed622f9804e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:37.506556 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1371/2705] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:12:37 2022] POST /identity/v3/users => generated 305 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:37.510679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d0f05-59e3-4ce7-a250-cdbf36360b20 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:37.521308 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d0f05-59e3-4ce7-a250-cdbf36360b20 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:37.526789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8617f-3625-4b1f-a7d8-268a950f387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:37.527893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8617f-3625-4b1f-a7d8-268a950f387c admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:37.528255 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8617f-3625-4b1f-a7d8-268a950f387c admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:37.528581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8617f-3625-4b1f-a7d8-268a950f387c admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:37.529244 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8617f-3625-4b1f-a7d8-268a950f387c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:37.530912 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8617f-3625-4b1f-a7d8-268a950f387c admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:37.544168 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693cd05-63b0-4eac-8995-1ed622f9804e admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:37.547051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1335/2706] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:37 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:37.550410 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8617f-3625-4b1f-a7d8-268a950f387c admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:37.560647 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-8693cd05-63b0-4eac-8995-1ed622f9804e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:37.561800 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8617f-3625-4b1f-a7d8-268a950f387c admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:37.566572 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0a200-33c9-4992-bb0d-a7e05abf93fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:37.567247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0a200-33c9-4992-bb0d-a7e05abf93fd admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:37.567884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0a200-33c9-4992-bb0d-a7e05abf93fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:37.568170 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0a200-33c9-4992-bb0d-a7e05abf93fd admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:37.568902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0a200-33c9-4992-bb0d-a7e05abf93fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:37.573512 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0a200-33c9-4992-bb0d-a7e05abf93fd admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:37.576113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693cd05-63b0-4eac-8995-1ed622f9804e admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:37.581059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23852500-b99e-4813-85b1-53082d3b9ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:37.582198 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23852500-b99e-4813-85b1-53082d3b9ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:37.582530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23852500-b99e-4813-85b1-53082d3b9ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:37.582808 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23852500-b99e-4813-85b1-53082d3b9ea6 admin admin] PATH_INFO: `/v3/projects/ed4f536fcafe46b5ae159b93acb7e041` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:37.583046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1336/2707] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:37 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:37.587015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23852500-b99e-4813-85b1-53082d3b9ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed4f536fcafe46b5ae159b93acb7e041)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:37.587159 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0a200-33c9-4992-bb0d-a7e05abf93fd admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:37.588916 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23852500-b99e-4813-85b1-53082d3b9ea6 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:37.597246 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0a200-33c9-4992-bb0d-a7e05abf93fd admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:37.602400 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892a927-f0db-46ff-b3eb-3c4f6332669c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:37.603309 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892a927-f0db-46ff-b3eb-3c4f6332669c admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:37.603598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892a927-f0db-46ff-b3eb-3c4f6332669c admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:37.603881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892a927-f0db-46ff-b3eb-3c4f6332669c admin admin] PATH_INFO: `/v3/projects/487eb83c32754ea2af275fd8a6953328/users/4f38cb2e51cf475aa614cb06d0883e7a/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:37.620174 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892a927-f0db-46ff-b3eb-3c4f6332669c admin admin] RBAC: Authorizing `identity:create_grant(project_id=487eb83c32754ea2af275fd8a6953328, user_id=4f38cb2e51cf475aa614cb06d0883e7a, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:37.624079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892a927-f0db-46ff-b3eb-3c4f6332669c admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:37.762438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1337/2708] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:12:37 2022] PUT /identity/v3/projects/487eb83c32754ea2af275fd8a6953328/users/4f38cb2e51cf475aa614cb06d0883e7a/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:37.773826 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e8eab-0f6c-4c9a-8c26-c059b59670b8 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:37.774250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e8eab-0f6c-4c9a-8c26-c059b59670b8 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:37.774666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e8eab-0f6c-4c9a-8c26-c059b59670b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:37.785834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-23852500-b99e-4813-85b1-53082d3b9ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed4f536fcafe46b5ae159b93acb7e041', 'request_id': 'req-23852500-b99e-4813-85b1-53082d3b9ea6'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:37.808721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-dc9e8eab-0f6c-4c9a-8c26-c059b59670b8 None None] MFA Rules not processed for user `4f38cb2e51cf475aa614cb06d0883e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:37.809943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-dc9e8eab-0f6c-4c9a-8c26-c059b59670b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:37.875807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1338/2709] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:37 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:37.880150 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e8eab-0f6c-4c9a-8c26-c059b59670b8 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:37.911806 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-23852500-b99e-4813-85b1-53082d3b9ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed4f536fcafe46b5ae159b93acb7e041', 'request_id': 'req-23852500-b99e-4813-85b1-53082d3b9ea6'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:37.921340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-23852500-b99e-4813-85b1-53082d3b9ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed4f536fcafe46b5ae159b93acb7e041', 'request_id': 'req-23852500-b99e-4813-85b1-53082d3b9ea6'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:37.932198 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-23852500-b99e-4813-85b1-53082d3b9ea6 admin admin] The token cache is being invalidate because project ed4f536fcafe46b5ae159b93acb7e041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:37.932609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-23852500-b99e-4813-85b1-53082d3b9ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:37.933321 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-23852500-b99e-4813-85b1-53082d3b9ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:37.940902 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1372/2710] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:12:37 2022] DELETE /identity/v3/projects/ed4f536fcafe46b5ae159b93acb7e041 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:37.945146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23852500-b99e-4813-85b1-53082d3b9ea6 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:37.946583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-23852500-b99e-4813-85b1-53082d3b9ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:37.953833 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e8eab-0f6c-4c9a-8c26-c059b59670b8 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:37.959434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140f420-2294-4412-998e-e3245e2f5ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:37.960360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140f420-2294-4412-998e-e3245e2f5ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:37.960658 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140f420-2294-4412-998e-e3245e2f5ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:37.960944 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140f420-2294-4412-998e-e3245e2f5ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:37.961647 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140f420-2294-4412-998e-e3245e2f5ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:37.963628 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140f420-2294-4412-998e-e3245e2f5ed5 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:37.965884 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23852500-b99e-4813-85b1-53082d3b9ea6 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:37.971507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef561d-606c-4703-baab-8876300c800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:37.972392 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef561d-606c-4703-baab-8876300c800b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:37.972679 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef561d-606c-4703-baab-8876300c800b admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:37.972980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef561d-606c-4703-baab-8876300c800b admin admin] PATH_INFO: `/v3/users/dfa767a4b12e41d5a4e6653eb559f9f7` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:37.990470 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef561d-606c-4703-baab-8876300c800b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa767a4b12e41d5a4e6653eb559f9f7)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:37.992406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef561d-606c-4703-baab-8876300c800b admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:38.132167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1339/2711] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:12:37 2022] POST /identity/v3/projects => generated 410 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:38.132167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140f420-2294-4412-998e-e3245e2f5ed5 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:38.132167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-8140f420-2294-4412-998e-e3245e2f5ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:38.198122 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140f420-2294-4412-998e-e3245e2f5ed5 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:38.205900 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2589e-215a-4abe-9340-c9db716475c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:38.207096 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2589e-215a-4abe-9340-c9db716475c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.207428 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2589e-215a-4abe-9340-c9db716475c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.207710 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2589e-215a-4abe-9340-c9db716475c1 admin admin] PATH_INFO: `/v3/users/dc6631265db34f35b732e5142627f661` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.208937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2589e-215a-4abe-9340-c9db716475c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6631265db34f35b732e5142627f661)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:38.210961 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2589e-215a-4abe-9340-c9db716475c1 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:38.348988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-fdef561d-606c-4703-baab-8876300c800b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa767a4b12e41d5a4e6653eb559f9f7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:38.349651 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-fdef561d-606c-4703-baab-8876300c800b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa767a4b12e41d5a4e6653eb559f9f7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:38.362462 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-fdef561d-606c-4703-baab-8876300c800b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa767a4b12e41d5a4e6653eb559f9f7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:38.500696 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-fdef561d-606c-4703-baab-8876300c800b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa767a4b12e41d5a4e6653eb559f9f7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:38.508401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-fdef561d-606c-4703-baab-8876300c800b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa767a4b12e41d5a4e6653eb559f9f7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:38.515322 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1373/2712] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:12:37 2022] DELETE /identity/v3/users/dfa767a4b12e41d5a4e6653eb559f9f7 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:38.516092 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef561d-606c-4703-baab-8876300c800b admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:38.517748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-fdef561d-606c-4703-baab-8876300c800b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:38.539242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-86f2589e-215a-4abe-9340-c9db716475c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6631265db34f35b732e5142627f661'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:38.540049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-86f2589e-215a-4abe-9340-c9db716475c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6631265db34f35b732e5142627f661'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:38.540758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-86f2589e-215a-4abe-9340-c9db716475c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6631265db34f35b732e5142627f661'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:38.603733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef561d-606c-4703-baab-8876300c800b admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:38.616765 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f3b1e-5e0f-4041-a3b2-7f30ce574733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:38.617423 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f3b1e-5e0f-4041-a3b2-7f30ce574733 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.617709 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f3b1e-5e0f-4041-a3b2-7f30ce574733 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.617988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f3b1e-5e0f-4041-a3b2-7f30ce574733 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.618762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f3b1e-5e0f-4041-a3b2-7f30ce574733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:38.620998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f3b1e-5e0f-4041-a3b2-7f30ce574733 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:38.678076 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-86f2589e-215a-4abe-9340-c9db716475c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6631265db34f35b732e5142627f661'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:38.691098 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-86f2589e-215a-4abe-9340-c9db716475c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6631265db34f35b732e5142627f661'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:38.703619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1340/2713] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:12:38 2022] DELETE /identity/v3/users/dc6631265db34f35b732e5142627f661 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:38.708247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc7d4c-43a6-4622-bbaa-3afef892ab03 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.708538 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc7d4c-43a6-4622-bbaa-3afef892ab03 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.708822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc7d4c-43a6-4622-bbaa-3afef892ab03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.728547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-72bc7d4c-43a6-4622-bbaa-3afef892ab03 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:38.730700 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-72bc7d4c-43a6-4622-bbaa-3afef892ab03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:38.802907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1341/2714] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:38.816286 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1374/2715] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:12:38 2022] POST /identity/v3/users => generated 312 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:38.818924 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f3b1e-5e0f-4041-a3b2-7f30ce574733 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:38.819106 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc7d4c-43a6-4622-bbaa-3afef892ab03 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:38.820880 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-72bc7d4c-43a6-4622-bbaa-3afef892ab03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:38.821212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-3c3f3b1e-5e0f-4041-a3b2-7f30ce574733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:38.834533 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f3b1e-5e0f-4041-a3b2-7f30ce574733 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:38.842674 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab9bfa-3ef8-4653-bcc5-3fa13f08a6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:38.843630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab9bfa-3ef8-4653-bcc5-3fa13f08a6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.843890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab9bfa-3ef8-4653-bcc5-3fa13f08a6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.844169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab9bfa-3ef8-4653-bcc5-3fa13f08a6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.845104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab9bfa-3ef8-4653-bcc5-3fa13f08a6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:38.846747 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab9bfa-3ef8-4653-bcc5-3fa13f08a6a4 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:38.862623 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1375/2716] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:38 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:38.863905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab9bfa-3ef8-4653-bcc5-3fa13f08a6a4 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:38.868114 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ddab9bfa-3ef8-4653-bcc5-3fa13f08a6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:38.884629 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab9bfa-3ef8-4653-bcc5-3fa13f08a6a4 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:38.890672 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc7d4c-43a6-4622-bbaa-3afef892ab03 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:38.890863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562097b5-eeba-4f90-a1f0-2020a47b2775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:38.891617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562097b5-eeba-4f90-a1f0-2020a47b2775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.892094 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562097b5-eeba-4f90-a1f0-2020a47b2775 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.892372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562097b5-eeba-4f90-a1f0-2020a47b2775 admin admin] PATH_INFO: `/v3/projects/6b8a6bd0c7274c68b1eb6d40d20b2eb1` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.896295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c4e3c-da36-495d-8c64-7eac9a157caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:38.896900 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c4e3c-da36-495d-8c64-7eac9a157caf service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.897194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c4e3c-da36-495d-8c64-7eac9a157caf service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.897594 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c4e3c-da36-495d-8c64-7eac9a157caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.908337 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c4e3c-da36-495d-8c64-7eac9a157caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:38.910043 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c4e3c-da36-495d-8c64-7eac9a157caf service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:38.915721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562097b5-eeba-4f90-a1f0-2020a47b2775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8a6bd0c7274c68b1eb6d40d20b2eb1)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:38.918966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562097b5-eeba-4f90-a1f0-2020a47b2775 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:38.921306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1342/2717] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:38.922234 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c4e3c-da36-495d-8c64-7eac9a157caf service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:38.932357 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c4e3c-da36-495d-8c64-7eac9a157caf service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:38.937895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4c1ed-1972-4581-8d4c-50744d088b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:38.938923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c1ed-1972-4581-8d4c-50744d088b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.939305 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c1ed-1972-4581-8d4c-50744d088b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.939666 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c1ed-1972-4581-8d4c-50744d088b88 admin admin] PATH_INFO: `/v3/projects/08f88b54b6d14d75aeee85c5fa3b607f/users/310ffa694dc149bbaab36e764a46cb29/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.957126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4c1ed-1972-4581-8d4c-50744d088b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f88b54b6d14d75aeee85c5fa3b607f, user_id=310ffa694dc149bbaab36e764a46cb29, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:38.960013 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4c1ed-1972-4581-8d4c-50744d088b88 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:39.138366 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1343/2718] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:12:38 2022] PUT /identity/v3/projects/08f88b54b6d14d75aeee85c5fa3b607f/users/310ffa694dc149bbaab36e764a46cb29/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:39.142420 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4c1ed-1972-4581-8d4c-50744d088b88 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:39.153753 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-562097b5-eeba-4f90-a1f0-2020a47b2775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8a6bd0c7274c68b1eb6d40d20b2eb1', 'request_id': 'req-562097b5-eeba-4f90-a1f0-2020a47b2775'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:39.220697 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-562097b5-eeba-4f90-a1f0-2020a47b2775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8a6bd0c7274c68b1eb6d40d20b2eb1', 'request_id': 'req-562097b5-eeba-4f90-a1f0-2020a47b2775'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:39.228104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-562097b5-eeba-4f90-a1f0-2020a47b2775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8a6bd0c7274c68b1eb6d40d20b2eb1', 'request_id': 'req-562097b5-eeba-4f90-a1f0-2020a47b2775'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:39.230885 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4c1ed-1972-4581-8d4c-50744d088b88 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:39.240701 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-562097b5-eeba-4f90-a1f0-2020a47b2775 admin admin] The token cache is being invalidate because project 6b8a6bd0c7274c68b1eb6d40d20b2eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:39.241288 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-562097b5-eeba-4f90-a1f0-2020a47b2775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:39.242274 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-562097b5-eeba-4f90-a1f0-2020a47b2775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:39.244515 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1376/2719] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:12:38 2022] DELETE /identity/v3/projects/6b8a6bd0c7274c68b1eb6d40d20b2eb1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:39.311860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ce852-8291-4512-9d0c-8473c5496aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:39.312590 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ce852-8291-4512-9d0c-8473c5496aec admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:39.312980 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ce852-8291-4512-9d0c-8473c5496aec admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:39.313379 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ce852-8291-4512-9d0c-8473c5496aec admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:39.314225 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ce852-8291-4512-9d0c-8473c5496aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:39.316001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ce852-8291-4512-9d0c-8473c5496aec admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:39.351734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562097b5-eeba-4f90-a1f0-2020a47b2775 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:39.353673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-562097b5-eeba-4f90-a1f0-2020a47b2775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:39.363935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1344/2720] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:39 2022] GET /identity/v3/roles => generated 1427 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:39.384833 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562097b5-eeba-4f90-a1f0-2020a47b2775 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:39.412349 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09943f9e-f732-4dec-8fb4-30f4f194de83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:39.413719 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09943f9e-f732-4dec-8fb4-30f4f194de83 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:39.414008 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09943f9e-f732-4dec-8fb4-30f4f194de83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:39.414292 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09943f9e-f732-4dec-8fb4-30f4f194de83 admin admin] PATH_INFO: `/v3/projects/08f88b54b6d14d75aeee85c5fa3b607f/users/310ffa694dc149bbaab36e764a46cb29/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:39.416737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09943f9e-f732-4dec-8fb4-30f4f194de83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f88b54b6d14d75aeee85c5fa3b607f, user_id=310ffa694dc149bbaab36e764a46cb29, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:39.420443 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09943f9e-f732-4dec-8fb4-30f4f194de83 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:39.462853 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1377/2721] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:12:39 2022] PUT /identity/v3/projects/08f88b54b6d14d75aeee85c5fa3b607f/users/310ffa694dc149bbaab36e764a46cb29/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:39.472901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c75720-ef75-4ab3-83f2-104d598e9133 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:39.472901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c75720-ef75-4ab3-83f2-104d598e9133 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:39.473289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c75720-ef75-4ab3-83f2-104d598e9133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:39.520263 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-c6c75720-ef75-4ab3-83f2-104d598e9133 None None] MFA Rules not processed for user `310ffa694dc149bbaab36e764a46cb29`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:39.521586 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-c6c75720-ef75-4ab3-83f2-104d598e9133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:39.613199 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1345/2722] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:39 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:39.625587 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09943f9e-f732-4dec-8fb4-30f4f194de83 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:39.632382 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-09943f9e-f732-4dec-8fb4-30f4f194de83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:39.689386 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09943f9e-f732-4dec-8fb4-30f4f194de83 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:39.693076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0751c-f082-4290-bca8-b25692ae771e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:39.693725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0751c-f082-4290-bca8-b25692ae771e service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:39.694013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0751c-f082-4290-bca8-b25692ae771e service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:39.694289 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0751c-f082-4290-bca8-b25692ae771e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:39.703624 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0751c-f082-4290-bca8-b25692ae771e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:39.705053 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0751c-f082-4290-bca8-b25692ae771e service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:39.715280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1378/2723] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:39 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:39.795353 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c75720-ef75-4ab3-83f2-104d598e9133 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:39.797006 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-c6c75720-ef75-4ab3-83f2-104d598e9133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:39.867407 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c75720-ef75-4ab3-83f2-104d598e9133 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:39.873209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff6fb1-5b73-4fa8-85e5-312943e4c6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:39.874079 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff6fb1-5b73-4fa8-85e5-312943e4c6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:39.874399 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff6fb1-5b73-4fa8-85e5-312943e4c6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:39.874680 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff6fb1-5b73-4fa8-85e5-312943e4c6eb admin admin] PATH_INFO: `/v3/projects/f027e44cc89d4809ba00bf76e4679274` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:39.875877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff6fb1-5b73-4fa8-85e5-312943e4c6eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f027e44cc89d4809ba00bf76e4679274)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:39.877817 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff6fb1-5b73-4fa8-85e5-312943e4c6eb admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:39.935407 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:40.012886 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-93ff6fb1-5b73-4fa8-85e5-312943e4c6eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f027e44cc89d4809ba00bf76e4679274', 'request_id': 'req-93ff6fb1-5b73-4fa8-85e5-312943e4c6eb'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:40.030096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:40.152532 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-93ff6fb1-5b73-4fa8-85e5-312943e4c6eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f027e44cc89d4809ba00bf76e4679274', 'request_id': 'req-93ff6fb1-5b73-4fa8-85e5-312943e4c6eb'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:40.156462 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0751c-f082-4290-bca8-b25692ae771e service cinder] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:40.163347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-93ff6fb1-5b73-4fa8-85e5-312943e4c6eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f027e44cc89d4809ba00bf76e4679274', 'request_id': 'req-93ff6fb1-5b73-4fa8-85e5-312943e4c6eb'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:40.165319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0751c-f082-4290-bca8-b25692ae771e service cinder] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:40.170843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-93ff6fb1-5b73-4fa8-85e5-312943e4c6eb admin admin] The token cache is being invalidate because project f027e44cc89d4809ba00bf76e4679274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:40.171125 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-93ff6fb1-5b73-4fa8-85e5-312943e4c6eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:40.171780 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-93ff6fb1-5b73-4fa8-85e5-312943e4c6eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:40.173602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1346/2724] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:12:39 2022] DELETE /identity/v3/projects/f027e44cc89d4809ba00bf76e4679274 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:40.178097 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c075ba-739f-4d13-9e3d-98da44ed6e38 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:40.178531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c075ba-739f-4d13-9e3d-98da44ed6e38 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:40.178819 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c075ba-739f-4d13-9e3d-98da44ed6e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:40.196921 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-78c075ba-739f-4d13-9e3d-98da44ed6e38 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:40.198134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-78c075ba-739f-4d13-9e3d-98da44ed6e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:40.224559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824c523-c172-4741-b5f4-c1c3e5ceb260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:40.225207 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824c523-c172-4741-b5f4-c1c3e5ceb260 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:40.225492 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824c523-c172-4741-b5f4-c1c3e5ceb260 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:40.225780 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824c523-c172-4741-b5f4-c1c3e5ceb260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:40.227628 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a824c523-c172-4741-b5f4-c1c3e5ceb260 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:40.259811 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1347/2725] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:40.268311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdfa0f-0234-40d7-b88a-004f52eb2159 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:40.268554 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdfa0f-0234-40d7-b88a-004f52eb2159 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:40.268810 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdfa0f-0234-40d7-b88a-004f52eb2159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:40.287137 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824c523-c172-4741-b5f4-c1c3e5ceb260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:40.288566 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824c523-c172-4741-b5f4-c1c3e5ceb260 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:40.288708 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-3ffdfa0f-0234-40d7-b88a-004f52eb2159 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:40.289873 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-3ffdfa0f-0234-40d7-b88a-004f52eb2159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:40.297362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1379/2726] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:40 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:40.298347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1348/2727] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:40.302473 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824c523-c172-4741-b5f4-c1c3e5ceb260 service cinder] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:40.315993 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824c523-c172-4741-b5f4-c1c3e5ceb260 service cinder] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:40.318057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762b1a8-d733-4cbb-8159-dfcce0588cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:40.318752 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762b1a8-d733-4cbb-8159-dfcce0588cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:40.319034 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762b1a8-d733-4cbb-8159-dfcce0588cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:40.319309 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762b1a8-d733-4cbb-8159-dfcce0588cf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:40.320022 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762b1a8-d733-4cbb-8159-dfcce0588cf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:40.320326 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762b1a8-d733-4cbb-8159-dfcce0588cf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:40.321892 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762b1a8-d733-4cbb-8159-dfcce0588cf2 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:40.334310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1380/2728] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:12:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:12:40.338825 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdfa0f-0234-40d7-b88a-004f52eb2159 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:40.349042 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdfa0f-0234-40d7-b88a-004f52eb2159 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:40.354194 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137172c-dd36-4296-ad9f-d78757435a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:40.355483 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137172c-dd36-4296-ad9f-d78757435a6f admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:40.355875 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137172c-dd36-4296-ad9f-d78757435a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:40.356157 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137172c-dd36-4296-ad9f-d78757435a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:40.356844 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137172c-dd36-4296-ad9f-d78757435a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:40.359014 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137172c-dd36-4296-ad9f-d78757435a6f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:40.467635 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1349/2729] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:12:40 2022] POST /identity/v3/projects => generated 372 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:40.471804 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762b1a8-d733-4cbb-8159-dfcce0588cf2 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:40.482280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762b1a8-d733-4cbb-8159-dfcce0588cf2 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:40.537919 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c3c7a-e025-4b38-85fc-a42e741b5aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:40.538545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c3c7a-e025-4b38-85fc-a42e741b5aca admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:40.538836 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c3c7a-e025-4b38-85fc-a42e741b5aca admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:40.539117 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c3c7a-e025-4b38-85fc-a42e741b5aca admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:40.539841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c3c7a-e025-4b38-85fc-a42e741b5aca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:40.541759 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c3c7a-e025-4b38-85fc-a42e741b5aca admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:40.659872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1381/2730] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:12:40 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:40.661113 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137172c-dd36-4296-ad9f-d78757435a6f admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:40.672945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137172c-dd36-4296-ad9f-d78757435a6f admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:40.681805 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642194b7-3796-4b53-98dd-cda0e333c7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:40.682739 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642194b7-3796-4b53-98dd-cda0e333c7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:40.687021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642194b7-3796-4b53-98dd-cda0e333c7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:40.687021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642194b7-3796-4b53-98dd-cda0e333c7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:40.687021 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642194b7-3796-4b53-98dd-cda0e333c7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:40.687823 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642194b7-3796-4b53-98dd-cda0e333c7a4 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:40.705067 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1350/2731] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:40 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:40.706895 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c3c7a-e025-4b38-85fc-a42e741b5aca admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:40.717764 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c3c7a-e025-4b38-85fc-a42e741b5aca admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:40.725418 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1a5cb-bcc8-46c0-9d9e-f78a2c2ba38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:40.726305 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1a5cb-bcc8-46c0-9d9e-f78a2c2ba38f admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:40.726612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1a5cb-bcc8-46c0-9d9e-f78a2c2ba38f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:40.727072 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1a5cb-bcc8-46c0-9d9e-f78a2c2ba38f admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:40.728017 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1a5cb-bcc8-46c0-9d9e-f78a2c2ba38f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:40.729496 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1a5cb-bcc8-46c0-9d9e-f78a2c2ba38f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:40.740278 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1382/2732] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:40 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:40.744312 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642194b7-3796-4b53-98dd-cda0e333c7a4 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:40.755185 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642194b7-3796-4b53-98dd-cda0e333c7a4 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:40.759876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff55d3-a3fc-4bda-837d-0b2b604dae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:40.760759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff55d3-a3fc-4bda-837d-0b2b604dae19 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:40.761046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff55d3-a3fc-4bda-837d-0b2b604dae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:40.762019 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff55d3-a3fc-4bda-837d-0b2b604dae19 admin admin] PATH_INFO: `/v3/projects/3789eeb98a0442309812ca2989f83379/users/f2741830101944f9934633cb94cf846d/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:40.779446 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff55d3-a3fc-4bda-837d-0b2b604dae19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3789eeb98a0442309812ca2989f83379, user_id=f2741830101944f9934633cb94cf846d, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:40.781157 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff55d3-a3fc-4bda-837d-0b2b604dae19 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:40.900864 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1351/2733] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:12:40 2022] PUT /identity/v3/projects/3789eeb98a0442309812ca2989f83379/users/f2741830101944f9934633cb94cf846d/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:40.920921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52012cda-39c8-40e2-8857-2795f60ec674 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:40.921215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52012cda-39c8-40e2-8857-2795f60ec674 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:40.921496 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52012cda-39c8-40e2-8857-2795f60ec674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:40.949019 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-52012cda-39c8-40e2-8857-2795f60ec674 None None] MFA Rules not processed for user `f2741830101944f9934633cb94cf846d`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:40.950395 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-52012cda-39c8-40e2-8857-2795f60ec674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:41.028874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1383/2734] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:41.032479 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:41.039245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff55d3-a3fc-4bda-837d-0b2b604dae19 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:41.105051 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff55d3-a3fc-4bda-837d-0b2b604dae19 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:41.110453 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215ffd6-6e2e-4b5a-a064-fa13f0de4a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:41.111203 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215ffd6-6e2e-4b5a-a064-fa13f0de4a06 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:41.111496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215ffd6-6e2e-4b5a-a064-fa13f0de4a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:41.111779 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215ffd6-6e2e-4b5a-a064-fa13f0de4a06 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:41.112477 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215ffd6-6e2e-4b5a-a064-fa13f0de4a06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:41.114396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215ffd6-6e2e-4b5a-a064-fa13f0de4a06 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:41.248656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1352/2735] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:12:41 2022] POST /identity/v3/projects => generated 374 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:41.252717 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52012cda-39c8-40e2-8857-2795f60ec674 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:41.263857 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52012cda-39c8-40e2-8857-2795f60ec674 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:41.333712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a04ff-a9aa-43c8-9e18-e46c7a037a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:41.334308 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a04ff-a9aa-43c8-9e18-e46c7a037a3d admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:41.334631 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a04ff-a9aa-43c8-9e18-e46c7a037a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:41.334908 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a04ff-a9aa-43c8-9e18-e46c7a037a3d admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:41.335605 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a04ff-a9aa-43c8-9e18-e46c7a037a3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:41.337516 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a04ff-a9aa-43c8-9e18-e46c7a037a3d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:41.489519 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1384/2736] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:12:41 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:41.493122 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215ffd6-6e2e-4b5a-a064-fa13f0de4a06 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:41.503809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215ffd6-6e2e-4b5a-a064-fa13f0de4a06 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:41.508304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d7bf2-5b6f-4626-b4d1-43cf0cfc7caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:41.508962 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d7bf2-5b6f-4626-b4d1-43cf0cfc7caa admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:41.509248 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d7bf2-5b6f-4626-b4d1-43cf0cfc7caa admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:41.509535 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d7bf2-5b6f-4626-b4d1-43cf0cfc7caa admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:41.510236 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d7bf2-5b6f-4626-b4d1-43cf0cfc7caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:41.512437 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d7bf2-5b6f-4626-b4d1-43cf0cfc7caa admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:41.523200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1353/2737] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:41 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:41.527369 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a04ff-a9aa-43c8-9e18-e46c7a037a3d admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:41.537538 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a04ff-a9aa-43c8-9e18-e46c7a037a3d admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:41.546929 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1552a-e38a-4b54-9e5d-6bb12bd75929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:41.546929 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1552a-e38a-4b54-9e5d-6bb12bd75929 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:41.546929 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1552a-e38a-4b54-9e5d-6bb12bd75929 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:41.546929 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1552a-e38a-4b54-9e5d-6bb12bd75929 admin admin] PATH_INFO: `/v3/projects/df107c16e52b4946abe222ad3f9df33b/users/5b6f8459f28c4c058e08a8a4d3e28f72/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:41.559362 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1552a-e38a-4b54-9e5d-6bb12bd75929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df107c16e52b4946abe222ad3f9df33b, user_id=5b6f8459f28c4c058e08a8a4d3e28f72, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:41.561984 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1552a-e38a-4b54-9e5d-6bb12bd75929 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:41.639087 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1385/2738] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:12:41 2022] PUT /identity/v3/projects/df107c16e52b4946abe222ad3f9df33b/users/5b6f8459f28c4c058e08a8a4d3e28f72/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:41.643126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d7bf2-5b6f-4626-b4d1-43cf0cfc7caa admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:41.653819 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d7bf2-5b6f-4626-b4d1-43cf0cfc7caa admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:41.711277 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b45a68-7540-4f93-b184-3bdcff84d9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:41.711987 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b45a68-7540-4f93-b184-3bdcff84d9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:41.712285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b45a68-7540-4f93-b184-3bdcff84d9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:41.712696 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b45a68-7540-4f93-b184-3bdcff84d9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:41.713764 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b45a68-7540-4f93-b184-3bdcff84d9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:41.715531 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b45a68-7540-4f93-b184-3bdcff84d9f7 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:41.726101 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1354/2739] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:12:41 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:41.727222 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=6 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:41.730490 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1552a-e38a-4b54-9e5d-6bb12bd75929 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:41.740571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1552a-e38a-4b54-9e5d-6bb12bd75929 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:41.745282 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdbf2c-c3fc-440b-84d9-cef429661fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:41.746806 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdbf2c-c3fc-440b-84d9-cef429661fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:41.747116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdbf2c-c3fc-440b-84d9-cef429661fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:41.747482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdbf2c-c3fc-440b-84d9-cef429661fa9 admin admin] PATH_INFO: `/v3/projects/df107c16e52b4946abe222ad3f9df33b/users/5b6f8459f28c4c058e08a8a4d3e28f72/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:41.749429 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdbf2c-c3fc-440b-84d9-cef429661fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df107c16e52b4946abe222ad3f9df33b, user_id=5b6f8459f28c4c058e08a8a4d3e28f72, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:41.752487 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdbf2c-c3fc-440b-84d9-cef429661fa9 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:41.762534 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1386/2740] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:12:41 2022] PUT /identity/v3/projects/df107c16e52b4946abe222ad3f9df33b/users/5b6f8459f28c4c058e08a8a4d3e28f72/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:41.772522 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d44fd-ac7a-4f7e-866e-41d2d945b0e2 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:41.772820 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d44fd-ac7a-4f7e-866e-41d2d945b0e2 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:41.773108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d44fd-ac7a-4f7e-866e-41d2d945b0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:41.802719 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-057d44fd-ac7a-4f7e-866e-41d2d945b0e2 None None] MFA Rules not processed for user `5b6f8459f28c4c058e08a8a4d3e28f72`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:41.803957 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-057d44fd-ac7a-4f7e-866e-41d2d945b0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:41.877380 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1355/2741] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:41.888987 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdbf2c-c3fc-440b-84d9-cef429661fa9 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:41.890744 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-99cdbf2c-c3fc-440b-84d9-cef429661fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:41.951391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdbf2c-c3fc-440b-84d9-cef429661fa9 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:41.955179 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ab287-0e39-4d9f-8b86-eba22fdc4367 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:41.955910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ab287-0e39-4d9f-8b86-eba22fdc4367 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:41.956205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ab287-0e39-4d9f-8b86-eba22fdc4367 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:41.956935 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ab287-0e39-4d9f-8b86-eba22fdc4367 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:41.967242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ab287-0e39-4d9f-8b86-eba22fdc4367 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:41.968673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ab287-0e39-4d9f-8b86-eba22fdc4367 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:41.978283 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1387/2742] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:42.129432 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:42.266131 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d44fd-ac7a-4f7e-866e-41d2d945b0e2 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:42.267686 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-057d44fd-ac7a-4f7e-866e-41d2d945b0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:42.280207 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d44fd-ac7a-4f7e-866e-41d2d945b0e2 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:42.283853 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90528f9-0128-4f12-9211-bbdf3481a087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:42.284502 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90528f9-0128-4f12-9211-bbdf3481a087 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:42.284876 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90528f9-0128-4f12-9211-bbdf3481a087 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:42.291990 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90528f9-0128-4f12-9211-bbdf3481a087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:42.342188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90528f9-0128-4f12-9211-bbdf3481a087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:42.343655 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90528f9-0128-4f12-9211-bbdf3481a087 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:42.353156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1356/2743] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:42.500762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:42.829672 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:42.887361 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:43.677478 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:53.511956 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=23 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:53.602909 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ab287-0e39-4d9f-8b86-eba22fdc4367 service cinder] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:53.604314 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1a2ab287-0e39-4d9f-8b86-eba22fdc4367 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:53.663968 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ab287-0e39-4d9f-8b86-eba22fdc4367 service cinder] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:53.667623 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4111c-ac29-451b-b9c8-5d29bf34f839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:53.668275 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4111c-ac29-451b-b9c8-5d29bf34f839 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:53.668595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4111c-ac29-451b-b9c8-5d29bf34f839 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:53.668862 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4111c-ac29-451b-b9c8-5d29bf34f839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:53.671175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1cf4111c-ac29-451b-b9c8-5d29bf34f839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:53.743789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4111c-ac29-451b-b9c8-5d29bf34f839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:53.745244 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4111c-ac29-451b-b9c8-5d29bf34f839 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:53.757905 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1388/2744] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:54.569487 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=49 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:59.239735 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90528f9-0128-4f12-9211-bbdf3481a087 service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:59.241227 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-e90528f9-0128-4f12-9211-bbdf3481a087 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:59.254291 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90528f9-0128-4f12-9211-bbdf3481a087 service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:59.257937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442eb2c-06fb-4e47-ac62-6354735e4eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:59.258638 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442eb2c-06fb-4e47-ac62-6354735e4eba service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:59.258929 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442eb2c-06fb-4e47-ac62-6354735e4eba service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:59.259215 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442eb2c-06fb-4e47-ac62-6354735e4eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:59.261003 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f442eb2c-06fb-4e47-ac62-6354735e4eba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:59.278603 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442eb2c-06fb-4e47-ac62-6354735e4eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:59.280082 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442eb2c-06fb-4e47-ac62-6354735e4eba service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:59.291963 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1357/2745] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:59.491021 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4111c-ac29-451b-b9c8-5d29bf34f839 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:59.493026 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1cf4111c-ac29-451b-b9c8-5d29bf34f839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:59.560660 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4111c-ac29-451b-b9c8-5d29bf34f839 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:59.566026 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaafac8-56fa-4bb4-b9e2-e71c840d1b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:59.566945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaafac8-56fa-4bb4-b9e2-e71c840d1b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:59.567228 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaafac8-56fa-4bb4-b9e2-e71c840d1b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:59.567511 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaafac8-56fa-4bb4-b9e2-e71c840d1b74 admin admin] PATH_INFO: `/v3/users/4f38cb2e51cf475aa614cb06d0883e7a` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:59.568711 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaafac8-56fa-4bb4-b9e2-e71c840d1b74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f38cb2e51cf475aa614cb06d0883e7a)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:59.570662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaafac8-56fa-4bb4-b9e2-e71c840d1b74 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:59.775590 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:59.778452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6eaafac8-56fa-4bb4-b9e2-e71c840d1b74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f38cb2e51cf475aa614cb06d0883e7a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:59.779141 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6eaafac8-56fa-4bb4-b9e2-e71c840d1b74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f38cb2e51cf475aa614cb06d0883e7a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:59.791507 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6eaafac8-56fa-4bb4-b9e2-e71c840d1b74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f38cb2e51cf475aa614cb06d0883e7a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:59.886804 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6eaafac8-56fa-4bb4-b9e2-e71c840d1b74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f38cb2e51cf475aa614cb06d0883e7a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:59.894201 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-6eaafac8-56fa-4bb4-b9e2-e71c840d1b74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f38cb2e51cf475aa614cb06d0883e7a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:59.900204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1389/2746] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:12:59 2022] DELETE /identity/v3/users/4f38cb2e51cf475aa614cb06d0883e7a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:59.904696 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5b750-25f6-4f24-9f25-8da1a1b386f1 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:59.905050 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5b750-25f6-4f24-9f25-8da1a1b386f1 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:59.905368 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5b750-25f6-4f24-9f25-8da1a1b386f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:59.923156 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-add5b750-25f6-4f24-9f25-8da1a1b386f1 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:59.924419 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-add5b750-25f6-4f24-9f25-8da1a1b386f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:59.982648 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1358/2747] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:59.993284 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaafac8-56fa-4bb4-b9e2-e71c840d1b74 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:59.994708 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6eaafac8-56fa-4bb4-b9e2-e71c840d1b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:00.054553 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaafac8-56fa-4bb4-b9e2-e71c840d1b74 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:00.058178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a47f0-00c9-46c9-8017-b4778ee96fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:00.058907 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a47f0-00c9-46c9-8017-b4778ee96fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:00.059193 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a47f0-00c9-46c9-8017-b4778ee96fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:00.059475 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a47f0-00c9-46c9-8017-b4778ee96fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:00.068982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a47f0-00c9-46c9-8017-b4778ee96fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:00.070462 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a47f0-00c9-46c9-8017-b4778ee96fc2 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:00.080096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1390/2748] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:00.518226 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5b750-25f6-4f24-9f25-8da1a1b386f1 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:00.522766 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-add5b750-25f6-4f24-9f25-8da1a1b386f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:00.535515 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5b750-25f6-4f24-9f25-8da1a1b386f1 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:00.540889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df1876-9b39-4321-bc38-440bc5cc924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:00.543084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df1876-9b39-4321-bc38-440bc5cc924f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:00.543688 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df1876-9b39-4321-bc38-440bc5cc924f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:00.544395 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df1876-9b39-4321-bc38-440bc5cc924f admin admin] PATH_INFO: `/v3/projects/487eb83c32754ea2af275fd8a6953328` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:00.545581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df1876-9b39-4321-bc38-440bc5cc924f admin admin] RBAC: Authorizing `identity:delete_project(project_id=487eb83c32754ea2af275fd8a6953328)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:00.547902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df1876-9b39-4321-bc38-440bc5cc924f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:00.701714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-76df1876-9b39-4321-bc38-440bc5cc924f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487eb83c32754ea2af275fd8a6953328', 'request_id': 'req-76df1876-9b39-4321-bc38-440bc5cc924f'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:00.818513 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-76df1876-9b39-4321-bc38-440bc5cc924f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487eb83c32754ea2af275fd8a6953328', 'request_id': 'req-76df1876-9b39-4321-bc38-440bc5cc924f'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:00.825860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-76df1876-9b39-4321-bc38-440bc5cc924f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487eb83c32754ea2af275fd8a6953328', 'request_id': 'req-76df1876-9b39-4321-bc38-440bc5cc924f'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:00.842663 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-76df1876-9b39-4321-bc38-440bc5cc924f admin admin] The token cache is being invalidate because project 487eb83c32754ea2af275fd8a6953328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:13:00.842985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-76df1876-9b39-4321-bc38-440bc5cc924f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:00.843797 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-76df1876-9b39-4321-bc38-440bc5cc924f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:00.845375 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1359/2749] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:13:00 2022] DELETE /identity/v3/projects/487eb83c32754ea2af275fd8a6953328 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:00.849594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a47f0-00c9-46c9-8017-b4778ee96fc2 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:00.859575 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a47f0-00c9-46c9-8017-b4778ee96fc2 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:00.915321 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ac322-e451-4a7f-8b3f-f255e940eabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:00.916183 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ac322-e451-4a7f-8b3f-f255e940eabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:00.916465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ac322-e451-4a7f-8b3f-f255e940eabb admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:00.916740 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ac322-e451-4a7f-8b3f-f255e940eabb admin admin] PATH_INFO: `/v3/users/310ffa694dc149bbaab36e764a46cb29` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:00.917901 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ac322-e451-4a7f-8b3f-f255e940eabb admin admin] RBAC: Authorizing `identity:delete_user(user_id=310ffa694dc149bbaab36e764a46cb29)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:00.919829 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ac322-e451-4a7f-8b3f-f255e940eabb admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:01.194627 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-292ac322-e451-4a7f-8b3f-f255e940eabb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '310ffa694dc149bbaab36e764a46cb29'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:01.195281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-292ac322-e451-4a7f-8b3f-f255e940eabb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '310ffa694dc149bbaab36e764a46cb29'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:01.215557 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-292ac322-e451-4a7f-8b3f-f255e940eabb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '310ffa694dc149bbaab36e764a46cb29'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:01.217254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:01.340703 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-292ac322-e451-4a7f-8b3f-f255e940eabb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '310ffa694dc149bbaab36e764a46cb29'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:01.348558 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-292ac322-e451-4a7f-8b3f-f255e940eabb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '310ffa694dc149bbaab36e764a46cb29'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:01.354993 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1391/2750] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:13:00 2022] DELETE /identity/v3/users/310ffa694dc149bbaab36e764a46cb29 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:01.844313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df1876-9b39-4321-bc38-440bc5cc924f admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:01.847790 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-76df1876-9b39-4321-bc38-440bc5cc924f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:01.862055 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df1876-9b39-4321-bc38-440bc5cc924f admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:01.921576 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab0639-5416-4e61-9e23-77f6066c7881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:01.922579 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab0639-5416-4e61-9e23-77f6066c7881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:01.922865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab0639-5416-4e61-9e23-77f6066c7881 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:01.923144 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab0639-5416-4e61-9e23-77f6066c7881 admin admin] PATH_INFO: `/v3/projects/08f88b54b6d14d75aeee85c5fa3b607f` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:01.924317 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab0639-5416-4e61-9e23-77f6066c7881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f88b54b6d14d75aeee85c5fa3b607f)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:01.926248 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab0639-5416-4e61-9e23-77f6066c7881 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:01.937713 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:02.068285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4eab0639-5416-4e61-9e23-77f6066c7881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f88b54b6d14d75aeee85c5fa3b607f', 'request_id': 'req-4eab0639-5416-4e61-9e23-77f6066c7881'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:02.198401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4eab0639-5416-4e61-9e23-77f6066c7881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f88b54b6d14d75aeee85c5fa3b607f', 'request_id': 'req-4eab0639-5416-4e61-9e23-77f6066c7881'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:02.208099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4eab0639-5416-4e61-9e23-77f6066c7881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f88b54b6d14d75aeee85c5fa3b607f', 'request_id': 'req-4eab0639-5416-4e61-9e23-77f6066c7881'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:02.221151 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4eab0639-5416-4e61-9e23-77f6066c7881 admin admin] The token cache is being invalidate because project 08f88b54b6d14d75aeee85c5fa3b607f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:13:02.221438 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4eab0639-5416-4e61-9e23-77f6066c7881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:02.222111 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-4eab0639-5416-4e61-9e23-77f6066c7881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:02.225105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1360/2751] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:13:01 2022] DELETE /identity/v3/projects/08f88b54b6d14d75aeee85c5fa3b607f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:02.230578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc817f-9065-4716-afd5-155b9d557385 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.231122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc817f-9065-4716-afd5-155b9d557385 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.231267 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc817f-9065-4716-afd5-155b9d557385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:02.252856 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-75fc817f-9065-4716-afd5-155b9d557385 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:02.254104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-75fc817f-9065-4716-afd5-155b9d557385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:02.325503 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1392/2752] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:13:02.336336 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868456ea-fb50-4c23-a2d5-9306f31dca15 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.336623 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868456ea-fb50-4c23-a2d5-9306f31dca15 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.336906 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868456ea-fb50-4c23-a2d5-9306f31dca15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:02.359080 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-868456ea-fb50-4c23-a2d5-9306f31dca15 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:02.364504 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-868456ea-fb50-4c23-a2d5-9306f31dca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:02.375718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1361/2753] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:02.380040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc817f-9065-4716-afd5-155b9d557385 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:02.391926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc817f-9065-4716-afd5-155b9d557385 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:02.396970 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e7bc3-74f3-4d27-99f9-d440765136f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:02.397685 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e7bc3-74f3-4d27-99f9-d440765136f0 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.397966 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e7bc3-74f3-4d27-99f9-d440765136f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.398242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e7bc3-74f3-4d27-99f9-d440765136f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:02.399025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e7bc3-74f3-4d27-99f9-d440765136f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:13:02.399336 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e7bc3-74f3-4d27-99f9-d440765136f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:02.400982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e7bc3-74f3-4d27-99f9-d440765136f0 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:02.413469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1393/2754] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:13:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:13:02.417802 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868456ea-fb50-4c23-a2d5-9306f31dca15 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:02.427937 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868456ea-fb50-4c23-a2d5-9306f31dca15 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:02.434128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17fabd-7c6d-451e-b141-8040d0272528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:02.434847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17fabd-7c6d-451e-b141-8040d0272528 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.435139 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17fabd-7c6d-451e-b141-8040d0272528 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.435421 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17fabd-7c6d-451e-b141-8040d0272528 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:02.436120 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17fabd-7c6d-451e-b141-8040d0272528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:02.438717 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17fabd-7c6d-451e-b141-8040d0272528 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:02.564238 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1362/2755] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:13:02 2022] POST /identity/v3/projects => generated 374 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:13:02.568078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e7bc3-74f3-4d27-99f9-d440765136f0 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:02.580366 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e7bc3-74f3-4d27-99f9-d440765136f0 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:02.649173 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e05d5c-523f-4115-bdb7-f6ab1e0904d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:02.649868 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e05d5c-523f-4115-bdb7-f6ab1e0904d8 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.650150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e05d5c-523f-4115-bdb7-f6ab1e0904d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.650459 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e05d5c-523f-4115-bdb7-f6ab1e0904d8 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:02.651175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e05d5c-523f-4115-bdb7-f6ab1e0904d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:02.653155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e05d5c-523f-4115-bdb7-f6ab1e0904d8 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:02.775676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1394/2756] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:13:02 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:13:02.779849 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17fabd-7c6d-451e-b141-8040d0272528 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:02.790575 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17fabd-7c6d-451e-b141-8040d0272528 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:02.795376 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbbeca-a766-42a6-a498-31080bbc0ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:02.796058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbbeca-a766-42a6-a498-31080bbc0ebe admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.796348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbbeca-a766-42a6-a498-31080bbc0ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.797308 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbbeca-a766-42a6-a498-31080bbc0ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:02.798049 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbbeca-a766-42a6-a498-31080bbc0ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:02.799725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbbeca-a766-42a6-a498-31080bbc0ebe admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:02.810847 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1363/2757] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:13:02 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:13:02.819734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e05d5c-523f-4115-bdb7-f6ab1e0904d8 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:02.830499 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e05d5c-523f-4115-bdb7-f6ab1e0904d8 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:02.839270 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c49ebb-91de-4363-8eb2-a46a12cc53df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:02.845574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c49ebb-91de-4363-8eb2-a46a12cc53df admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.845574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c49ebb-91de-4363-8eb2-a46a12cc53df admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.845574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c49ebb-91de-4363-8eb2-a46a12cc53df admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:02.845574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c49ebb-91de-4363-8eb2-a46a12cc53df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:02.845574 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c49ebb-91de-4363-8eb2-a46a12cc53df admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:02.853564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1395/2758] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:13:02 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:13:02.857805 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbbeca-a766-42a6-a498-31080bbc0ebe admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:02.869881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbbeca-a766-42a6-a498-31080bbc0ebe admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:02.876582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85104f-e3ae-4baa-8cf6-63a4524e34aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:02.877612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85104f-e3ae-4baa-8cf6-63a4524e34aa admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.877997 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85104f-e3ae-4baa-8cf6-63a4524e34aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.878418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85104f-e3ae-4baa-8cf6-63a4524e34aa admin admin] PATH_INFO: `/v3/projects/b139020ba98e45ffa206b4931a880121/users/0d333fbe08cd43a5a798755bbcdac7c0/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:02.903496 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85104f-e3ae-4baa-8cf6-63a4524e34aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b139020ba98e45ffa206b4931a880121, user_id=0d333fbe08cd43a5a798755bbcdac7c0, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:02.906673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85104f-e3ae-4baa-8cf6-63a4524e34aa admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:03.053667 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1364/2759] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:13:02 2022] PUT /identity/v3/projects/b139020ba98e45ffa206b4931a880121/users/0d333fbe08cd43a5a798755bbcdac7c0/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:13:03.059291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027767ba-d162-43f5-8224-57e344a470a1 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:03.059588 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027767ba-d162-43f5-8224-57e344a470a1 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:03.059896 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027767ba-d162-43f5-8224-57e344a470a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:03.078054 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-027767ba-d162-43f5-8224-57e344a470a1 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:03.079199 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-027767ba-d162-43f5-8224-57e344a470a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:03.124568 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:03.139357 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1396/2760] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:03.149285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85104f-e3ae-4baa-8cf6-63a4524e34aa admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:03.151038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4f85104f-e3ae-4baa-8cf6-63a4524e34aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:03.214695 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85104f-e3ae-4baa-8cf6-63a4524e34aa admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:03.219007 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90aec9d-5de2-4c06-ac8d-ca0cd27c50e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:03.220254 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90aec9d-5de2-4c06-ac8d-ca0cd27c50e5 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:03.220545 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90aec9d-5de2-4c06-ac8d-ca0cd27c50e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:03.220830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90aec9d-5de2-4c06-ac8d-ca0cd27c50e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:03.230061 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90aec9d-5de2-4c06-ac8d-ca0cd27c50e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:03.231528 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90aec9d-5de2-4c06-ac8d-ca0cd27c50e5 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:03.242138 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1365/2761] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:04.831658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5231d-e84d-4122-801b-24c6ee9ca5d9 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:04.833071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5231d-e84d-4122-801b-24c6ee9ca5d9 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:04.833933 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5231d-e84d-4122-801b-24c6ee9ca5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:04.867798 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-30a5231d-e84d-4122-801b-24c6ee9ca5d9 None None] MFA Rules not processed for user `0d333fbe08cd43a5a798755bbcdac7c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:04.869274 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-30a5231d-e84d-4122-801b-24c6ee9ca5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:04.956980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1397/2762] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:13:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:04.959907 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90aec9d-5de2-4c06-ac8d-ca0cd27c50e5 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:04.973450 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90aec9d-5de2-4c06-ac8d-ca0cd27c50e5 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:04.978501 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fd426-543a-4038-b132-1bb7fa97ee69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:04.979402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fd426-543a-4038-b132-1bb7fa97ee69 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:04.979848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fd426-543a-4038-b132-1bb7fa97ee69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:04.980138 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fd426-543a-4038-b132-1bb7fa97ee69 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:04.980846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fd426-543a-4038-b132-1bb7fa97ee69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:04.982841 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fd426-543a-4038-b132-1bb7fa97ee69 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:05.146311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1366/2763] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:13:04 2022] POST /identity/v3/projects => generated 374 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:13:05.147302 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5231d-e84d-4122-801b-24c6ee9ca5d9 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:05.162363 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5231d-e84d-4122-801b-24c6ee9ca5d9 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:05.234089 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3a90e-858e-489b-b598-b0892b0fd7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:05.235769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3a90e-858e-489b-b598-b0892b0fd7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:05.235769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3a90e-858e-489b-b598-b0892b0fd7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:05.236148 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3a90e-858e-489b-b598-b0892b0fd7a9 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:05.237307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3a90e-858e-489b-b598-b0892b0fd7a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:05.240923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3a90e-858e-489b-b598-b0892b0fd7a9 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:05.410058 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1398/2764] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:13:05 2022] POST /identity/v3/users => generated 294 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:13:05.414336 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fd426-543a-4038-b132-1bb7fa97ee69 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:05.425487 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fd426-543a-4038-b132-1bb7fa97ee69 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:05.430170 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b3079-9ff8-4705-8a1c-1e818a5b167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:05.430898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b3079-9ff8-4705-8a1c-1e818a5b167f admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:05.431188 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b3079-9ff8-4705-8a1c-1e818a5b167f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:05.431470 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b3079-9ff8-4705-8a1c-1e818a5b167f admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:05.432200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b3079-9ff8-4705-8a1c-1e818a5b167f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:05.433808 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b3079-9ff8-4705-8a1c-1e818a5b167f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:05.449904 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1367/2765] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:13:05 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:13:05.451098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3a90e-858e-489b-b598-b0892b0fd7a9 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:05.463329 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3a90e-858e-489b-b598-b0892b0fd7a9 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:05.468068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335ddc2-e131-4212-bc54-e5226e78390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:05.469113 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335ddc2-e131-4212-bc54-e5226e78390a admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:05.469549 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335ddc2-e131-4212-bc54-e5226e78390a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:05.469843 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335ddc2-e131-4212-bc54-e5226e78390a admin admin] PATH_INFO: `/v3/projects/7a2dc0f2935c49cf991c3b5c05711be7/users/35bfb32727ff4e8bac5d341caba96a95/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:05.485821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335ddc2-e131-4212-bc54-e5226e78390a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2dc0f2935c49cf991c3b5c05711be7, user_id=35bfb32727ff4e8bac5d341caba96a95, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:05.488598 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335ddc2-e131-4212-bc54-e5226e78390a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:05.603986 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1399/2766] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:13:05 2022] PUT /identity/v3/projects/7a2dc0f2935c49cf991c3b5c05711be7/users/35bfb32727ff4e8bac5d341caba96a95/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:05.609016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b3079-9ff8-4705-8a1c-1e818a5b167f admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:05.619625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b3079-9ff8-4705-8a1c-1e818a5b167f admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:05.623119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:05.692069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a645192-0cd9-47fb-abe1-8ba7c0384353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:05.692914 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a645192-0cd9-47fb-abe1-8ba7c0384353 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:05.693293 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a645192-0cd9-47fb-abe1-8ba7c0384353 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:05.693787 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a645192-0cd9-47fb-abe1-8ba7c0384353 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:05.694630 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a645192-0cd9-47fb-abe1-8ba7c0384353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:05.696271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a645192-0cd9-47fb-abe1-8ba7c0384353 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:05.710732 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1368/2767] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:13:05 2022] GET /identity/v3/roles => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:13:05.716028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335ddc2-e131-4212-bc54-e5226e78390a admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:05.729011 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335ddc2-e131-4212-bc54-e5226e78390a admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:05.736332 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a42952-3b79-4d16-bcbf-89691ef2b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:05.737782 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a42952-3b79-4d16-bcbf-89691ef2b653 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:05.738054 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a42952-3b79-4d16-bcbf-89691ef2b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:05.738351 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a42952-3b79-4d16-bcbf-89691ef2b653 admin admin] PATH_INFO: `/v3/projects/7a2dc0f2935c49cf991c3b5c05711be7/users/35bfb32727ff4e8bac5d341caba96a95/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:05.740338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a42952-3b79-4d16-bcbf-89691ef2b653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2dc0f2935c49cf991c3b5c05711be7, user_id=35bfb32727ff4e8bac5d341caba96a95, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:05.743126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a42952-3b79-4d16-bcbf-89691ef2b653 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:05.755219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1400/2768] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:13:05 2022] PUT /identity/v3/projects/7a2dc0f2935c49cf991c3b5c05711be7/users/35bfb32727ff4e8bac5d341caba96a95/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:07.376167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf966bc-1c5a-4ec9-8d6c-add381fb5af2 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:07.376747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf966bc-1c5a-4ec9-8d6c-add381fb5af2 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:07.376747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf966bc-1c5a-4ec9-8d6c-add381fb5af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:07.407431 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-0bf966bc-1c5a-4ec9-8d6c-add381fb5af2 None None] MFA Rules not processed for user `35bfb32727ff4e8bac5d341caba96a95`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:07.408869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0bf966bc-1c5a-4ec9-8d6c-add381fb5af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:07.488183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1369/2769] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:13:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:07.496704 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a42952-3b79-4d16-bcbf-89691ef2b653 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:07.498691 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d0a42952-3b79-4d16-bcbf-89691ef2b653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:07.548448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:07.582814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a42952-3b79-4d16-bcbf-89691ef2b653 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:07.587166 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70146ff-9e8d-4a94-9c7f-20f4df59851f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:07.588128 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70146ff-9e8d-4a94-9c7f-20f4df59851f service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:07.588582 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70146ff-9e8d-4a94-9c7f-20f4df59851f service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:07.589035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70146ff-9e8d-4a94-9c7f-20f4df59851f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:07.655057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70146ff-9e8d-4a94-9c7f-20f4df59851f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:07.657175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70146ff-9e8d-4a94-9c7f-20f4df59851f service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:07.668452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1401/2770] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:13:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:12.027074 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5dde7-68d4-4838-a795-1328bcf5a531 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:12.027565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5dde7-68d4-4838-a795-1328bcf5a531 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:12.027670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5dde7-68d4-4838-a795-1328bcf5a531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:12.046315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-cbb5dde7-68d4-4838-a795-1328bcf5a531 None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:12.050921 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-cbb5dde7-68d4-4838-a795-1328bcf5a531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:12.102759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1370/2771] 10.222.0.112 () {58 vars in 1014 bytes} [Thu May 26 17:13:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:12.320197 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70146ff-9e8d-4a94-9c7f-20f4df59851f service cinder] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:12.321665 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d70146ff-9e8d-4a94-9c7f-20f4df59851f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:12.408235 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70146ff-9e8d-4a94-9c7f-20f4df59851f service cinder] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:12.414057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6f812-324c-4d7c-ab45-78b399939207 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:12.414771 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6f812-324c-4d7c-ab45-78b399939207 service swift] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:12.419167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6f812-324c-4d7c-ab45-78b399939207 service swift] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:12.419167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6f812-324c-4d7c-ab45-78b399939207 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:12.424463 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6f812-324c-4d7c-ab45-78b399939207 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:12.426047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6f812-324c-4d7c-ab45-78b399939207 service swift] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:12.434219 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1402/2772] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 17:13:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:13:12.642237 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5dde7-68d4-4838-a795-1328bcf5a531 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:12.652442 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5dde7-68d4-4838-a795-1328bcf5a531 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:12.657789 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce33fb-1ff2-45cc-a55d-8cc3327cb85f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:12.658665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce33fb-1ff2-45cc-a55d-8cc3327cb85f service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:12.658958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce33fb-1ff2-45cc-a55d-8cc3327cb85f service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:12.659239 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce33fb-1ff2-45cc-a55d-8cc3327cb85f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:12.679382 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce33fb-1ff2-45cc-a55d-8cc3327cb85f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:12.680862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce33fb-1ff2-45cc-a55d-8cc3327cb85f service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:12.706922 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1371/2773] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:13:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:21.487691 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6f812-324c-4d7c-ab45-78b399939207 service swift] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:21.547146 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6f812-324c-4d7c-ab45-78b399939207 service swift] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:21.550945 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeaf843-a793-4c85-afc0-f4a694ab26ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:21.551591 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaf843-a793-4c85-afc0-f4a694ab26ea service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:21.551892 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaf843-a793-4c85-afc0-f4a694ab26ea service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:21.552158 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaf843-a793-4c85-afc0-f4a694ab26ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:21.553934 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7eeaf843-a793-4c85-afc0-f4a694ab26ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:21.572644 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:21.627952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeaf843-a793-4c85-afc0-f4a694ab26ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:21.629562 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeaf843-a793-4c85-afc0-f4a694ab26ea service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:21.639124 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1403/2774] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:13:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:22.695997 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=91 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:31.658513 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=19 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:38.242260 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce33fb-1ff2-45cc-a55d-8cc3327cb85f service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:38.252883 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce33fb-1ff2-45cc-a55d-8cc3327cb85f service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:38.256908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde62b8f-cfa5-47bc-bda4-ae33242c28b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:38.257555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde62b8f-cfa5-47bc-bda4-ae33242c28b4 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:38.257842 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde62b8f-cfa5-47bc-bda4-ae33242c28b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:38.258124 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde62b8f-cfa5-47bc-bda4-ae33242c28b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:38.259976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-fde62b8f-cfa5-47bc-bda4-ae33242c28b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:38.332318 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde62b8f-cfa5-47bc-bda4-ae33242c28b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:38.334064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde62b8f-cfa5-47bc-bda4-ae33242c28b4 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:38.344510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1372/2775] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:39.548077 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a293f-07cb-47d9-8893-7e753db8e60c None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:39.548600 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a293f-07cb-47d9-8893-7e753db8e60c None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:39.548725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a293f-07cb-47d9-8893-7e753db8e60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:39.571024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-b76a293f-07cb-47d9-8893-7e753db8e60c None None] MFA Rules not processed for user `06f2efcb8c6646658934a3ab55ab5744`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:39.572294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b76a293f-07cb-47d9-8893-7e753db8e60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:39.581388 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1404/2776] 10.222.0.112 () {58 vars in 972 bytes} [Thu May 26 17:13:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:39.600891 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde62b8f-cfa5-47bc-bda4-ae33242c28b4 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:39.616815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde62b8f-cfa5-47bc-bda4-ae33242c28b4 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:39.631407 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e4a97-e556-492d-9d75-b80564629601 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465b269fc6ee415b8f5715843468d089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:39.632831 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e4a97-e556-492d-9d75-b80564629601 service swift] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:39.633285 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e4a97-e556-492d-9d75-b80564629601 service swift] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:39.633815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e4a97-e556-492d-9d75-b80564629601 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:39.649970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e4a97-e556-492d-9d75-b80564629601 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:39.652781 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e4a97-e556-492d-9d75-b80564629601 service swift] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:39.688851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1373/2777] 10.222.0.112 () {60 vars in 1389 bytes} [Thu May 26 17:13:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:13:43.476099 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a293f-07cb-47d9-8893-7e753db8e60c None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:43.478094 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b76a293f-07cb-47d9-8893-7e753db8e60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:43.496926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a293f-07cb-47d9-8893-7e753db8e60c None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:43.510024 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f84df7-9371-42a2-9fe0-1df0e3e287bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:43.510958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f84df7-9371-42a2-9fe0-1df0e3e287bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:43.511242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f84df7-9371-42a2-9fe0-1df0e3e287bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:43.511515 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f84df7-9371-42a2-9fe0-1df0e3e287bc admin admin] PATH_INFO: `/v3/users/21c11bd00fde4b6a914ce707a502784a` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:43.514579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f84df7-9371-42a2-9fe0-1df0e3e287bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c11bd00fde4b6a914ce707a502784a)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:43.523979 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f84df7-9371-42a2-9fe0-1df0e3e287bc admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:43.771952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-34f84df7-9371-42a2-9fe0-1df0e3e287bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c11bd00fde4b6a914ce707a502784a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:43.772521 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-34f84df7-9371-42a2-9fe0-1df0e3e287bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c11bd00fde4b6a914ce707a502784a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:43.785022 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-34f84df7-9371-42a2-9fe0-1df0e3e287bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c11bd00fde4b6a914ce707a502784a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:43.894954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-34f84df7-9371-42a2-9fe0-1df0e3e287bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c11bd00fde4b6a914ce707a502784a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:43.904214 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-34f84df7-9371-42a2-9fe0-1df0e3e287bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c11bd00fde4b6a914ce707a502784a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:43.911787 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1405/2778] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:13:43 2022] DELETE /identity/v3/users/21c11bd00fde4b6a914ce707a502784a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:44.238678 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e4a97-e556-492d-9d75-b80564629601 service swift] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:44.250073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e4a97-e556-492d-9d75-b80564629601 service swift] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:44.331322 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd87670-ccc1-412f-afd3-bc4cf61bb6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:44.333386 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd87670-ccc1-412f-afd3-bc4cf61bb6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:44.334145 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd87670-ccc1-412f-afd3-bc4cf61bb6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:44.334598 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd87670-ccc1-412f-afd3-bc4cf61bb6fc admin admin] PATH_INFO: `/v3/users/0d333fbe08cd43a5a798755bbcdac7c0` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:44.336749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd87670-ccc1-412f-afd3-bc4cf61bb6fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d333fbe08cd43a5a798755bbcdac7c0)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:44.340467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd87670-ccc1-412f-afd3-bc4cf61bb6fc admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:44.468834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f84df7-9371-42a2-9fe0-1df0e3e287bc admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:44.470963 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-34f84df7-9371-42a2-9fe0-1df0e3e287bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:44.495482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f84df7-9371-42a2-9fe0-1df0e3e287bc admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:44.504699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666b3d0-d35d-4250-a053-6552cf9d55a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:44.506180 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666b3d0-d35d-4250-a053-6552cf9d55a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:44.506661 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666b3d0-d35d-4250-a053-6552cf9d55a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:44.508037 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666b3d0-d35d-4250-a053-6552cf9d55a7 admin admin] PATH_INFO: `/v3/projects/3511d2b2c4014889ae449a05344ff57d` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:44.509715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666b3d0-d35d-4250-a053-6552cf9d55a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3511d2b2c4014889ae449a05344ff57d)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:44.522311 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666b3d0-d35d-4250-a053-6552cf9d55a7 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:44.579612 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3fd87670-ccc1-412f-afd3-bc4cf61bb6fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d333fbe08cd43a5a798755bbcdac7c0'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:44.580367 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3fd87670-ccc1-412f-afd3-bc4cf61bb6fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d333fbe08cd43a5a798755bbcdac7c0'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:44.581534 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3fd87670-ccc1-412f-afd3-bc4cf61bb6fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d333fbe08cd43a5a798755bbcdac7c0'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:44.641980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e666b3d0-d35d-4250-a053-6552cf9d55a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3511d2b2c4014889ae449a05344ff57d', 'request_id': 'req-e666b3d0-d35d-4250-a053-6552cf9d55a7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:44.647541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3fd87670-ccc1-412f-afd3-bc4cf61bb6fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d333fbe08cd43a5a798755bbcdac7c0'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:44.663488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3fd87670-ccc1-412f-afd3-bc4cf61bb6fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d333fbe08cd43a5a798755bbcdac7c0'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:44.673360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:44.681264 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1374/2779] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:13:44 2022] DELETE /identity/v3/users/0d333fbe08cd43a5a798755bbcdac7c0 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:44.734835 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e666b3d0-d35d-4250-a053-6552cf9d55a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3511d2b2c4014889ae449a05344ff57d', 'request_id': 'req-e666b3d0-d35d-4250-a053-6552cf9d55a7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:44.741728 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e666b3d0-d35d-4250-a053-6552cf9d55a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3511d2b2c4014889ae449a05344ff57d', 'request_id': 'req-e666b3d0-d35d-4250-a053-6552cf9d55a7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:44.752763 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e666b3d0-d35d-4250-a053-6552cf9d55a7 admin admin] The token cache is being invalidate because project 3511d2b2c4014889ae449a05344ff57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:13:44.753003 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e666b3d0-d35d-4250-a053-6552cf9d55a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:44.753694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-e666b3d0-d35d-4250-a053-6552cf9d55a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:44.755343 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1406/2780] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:13:44 2022] DELETE /identity/v3/projects/3511d2b2c4014889ae449a05344ff57d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:13:44.760562 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf69400-b036-426f-b4d8-9a7b5d63799b None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:44.760881 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf69400-b036-426f-b4d8-9a7b5d63799b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:44.761168 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf69400-b036-426f-b4d8-9a7b5d63799b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:44.781312 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-fcf69400-b036-426f-b4d8-9a7b5d63799b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:44.783276 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-fcf69400-b036-426f-b4d8-9a7b5d63799b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:44.861572 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1375/2781] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:13:44.863828 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261d325-17b9-4ac1-9c65-cd7e1fce7998 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:44.864352 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261d325-17b9-4ac1-9c65-cd7e1fce7998 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:44.864636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261d325-17b9-4ac1-9c65-cd7e1fce7998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:44.883890 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-f261d325-17b9-4ac1-9c65-cd7e1fce7998 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:44.889292 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-f261d325-17b9-4ac1-9c65-cd7e1fce7998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:44.893887 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1407/2782] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:44.898210 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf69400-b036-426f-b4d8-9a7b5d63799b None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:44.908441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf69400-b036-426f-b4d8-9a7b5d63799b None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:44.913401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce264400-5651-42d5-932d-d92ecfb819f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:44.914071 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce264400-5651-42d5-932d-d92ecfb819f0 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:44.914401 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce264400-5651-42d5-932d-d92ecfb819f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:44.914685 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce264400-5651-42d5-932d-d92ecfb819f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:44.915443 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce264400-5651-42d5-932d-d92ecfb819f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:13:44.915733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce264400-5651-42d5-932d-d92ecfb819f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:44.917331 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce264400-5651-42d5-932d-d92ecfb819f0 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:44.931903 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1376/2783] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:13:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:13:44.934346 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261d325-17b9-4ac1-9c65-cd7e1fce7998 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:44.944342 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261d325-17b9-4ac1-9c65-cd7e1fce7998 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:44.949118 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e6504-1de0-413f-9339-57b2d7af0f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:44.952412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e6504-1de0-413f-9339-57b2d7af0f07 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:44.952412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e6504-1de0-413f-9339-57b2d7af0f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:44.952412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e6504-1de0-413f-9339-57b2d7af0f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:44.952412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e6504-1de0-413f-9339-57b2d7af0f07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:44.952903 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e6504-1de0-413f-9339-57b2d7af0f07 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:45.061418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce264400-5651-42d5-932d-d92ecfb819f0 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:45.065287 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-ce264400-5651-42d5-932d-d92ecfb819f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:45.127569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce264400-5651-42d5-932d-d92ecfb819f0 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:45.127569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a2c8b-39bc-4bec-9f16-84fc1986b797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:45.127569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a2c8b-39bc-4bec-9f16-84fc1986b797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:45.127569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a2c8b-39bc-4bec-9f16-84fc1986b797 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:45.128460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a2c8b-39bc-4bec-9f16-84fc1986b797 admin admin] PATH_INFO: `/v3/projects/b139020ba98e45ffa206b4931a880121` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:45.128460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a2c8b-39bc-4bec-9f16-84fc1986b797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b139020ba98e45ffa206b4931a880121)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:45.128460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a2c8b-39bc-4bec-9f16-84fc1986b797 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:45.129075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1408/2784] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:13:44 2022] POST /identity/v3/projects => generated 374 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:13:45.133346 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e6504-1de0-413f-9339-57b2d7af0f07 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:45.163096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:45.210681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e6504-1de0-413f-9339-57b2d7af0f07 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:45.215791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b61cf-2270-4bdb-bbad-79c233f3019e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:45.216484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b61cf-2270-4bdb-bbad-79c233f3019e admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:45.216772 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b61cf-2270-4bdb-bbad-79c233f3019e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:45.217054 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b61cf-2270-4bdb-bbad-79c233f3019e admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:45.217750 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b61cf-2270-4bdb-bbad-79c233f3019e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:45.219795 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b61cf-2270-4bdb-bbad-79c233f3019e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:45.273791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c62a2c8b-39bc-4bec-9f16-84fc1986b797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b139020ba98e45ffa206b4931a880121', 'request_id': 'req-c62a2c8b-39bc-4bec-9f16-84fc1986b797'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:45.336473 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1409/2785] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:13:45 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:13:45.340396 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b61cf-2270-4bdb-bbad-79c233f3019e admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:45.350140 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b61cf-2270-4bdb-bbad-79c233f3019e admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:45.352729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c62a2c8b-39bc-4bec-9f16-84fc1986b797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b139020ba98e45ffa206b4931a880121', 'request_id': 'req-c62a2c8b-39bc-4bec-9f16-84fc1986b797'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:45.361578 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c62a2c8b-39bc-4bec-9f16-84fc1986b797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b139020ba98e45ffa206b4931a880121', 'request_id': 'req-c62a2c8b-39bc-4bec-9f16-84fc1986b797'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:45.381849 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c62a2c8b-39bc-4bec-9f16-84fc1986b797 admin admin] The token cache is being invalidate because project b139020ba98e45ffa206b4931a880121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:13:45.382389 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c62a2c8b-39bc-4bec-9f16-84fc1986b797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:45.383165 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c62a2c8b-39bc-4bec-9f16-84fc1986b797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:45.384970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1377/2786] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:13:45 2022] DELETE /identity/v3/projects/b139020ba98e45ffa206b4931a880121 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:45.388900 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a2c8b-39bc-4bec-9f16-84fc1986b797 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:45.390606 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-c62a2c8b-39bc-4bec-9f16-84fc1986b797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:45.442367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db231c-b4f0-4975-ba09-61ed49557714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:45.442367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db231c-b4f0-4975-ba09-61ed49557714 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:45.442367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db231c-b4f0-4975-ba09-61ed49557714 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:45.442367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db231c-b4f0-4975-ba09-61ed49557714 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:45.442974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db231c-b4f0-4975-ba09-61ed49557714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:45.445120 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db231c-b4f0-4975-ba09-61ed49557714 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:45.459149 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1410/2787] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:13:45 2022] GET /identity/v3/roles => generated 1427 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:13:45.463128 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db231c-b4f0-4975-ba09-61ed49557714 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:45.465687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-94db231c-b4f0-4975-ba09-61ed49557714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:45.478445 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db231c-b4f0-4975-ba09-61ed49557714 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:45.483398 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f85aa9-64a2-4ace-aaab-467fe1d4b13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:45.484134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f85aa9-64a2-4ace-aaab-467fe1d4b13d admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:45.484359 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f85aa9-64a2-4ace-aaab-467fe1d4b13d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:45.484643 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f85aa9-64a2-4ace-aaab-467fe1d4b13d admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:45.485962 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f85aa9-64a2-4ace-aaab-467fe1d4b13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:45.487611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f85aa9-64a2-4ace-aaab-467fe1d4b13d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:45.489414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a2c8b-39bc-4bec-9f16-84fc1986b797 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:45.495017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd5c58-8141-4f18-8bc8-4d7fb856a8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:45.496215 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd5c58-8141-4f18-8bc8-4d7fb856a8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:45.496435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd5c58-8141-4f18-8bc8-4d7fb856a8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:45.496779 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd5c58-8141-4f18-8bc8-4d7fb856a8d6 admin admin] PATH_INFO: `/v3/users/35bfb32727ff4e8bac5d341caba96a95` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:45.498072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd5c58-8141-4f18-8bc8-4d7fb856a8d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35bfb32727ff4e8bac5d341caba96a95)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:45.502760 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1411/2788] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:13:45 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:13:45.503260 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd5c58-8141-4f18-8bc8-4d7fb856a8d6 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:45.504854 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f85aa9-64a2-4ace-aaab-467fe1d4b13d admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:45.515090 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f85aa9-64a2-4ace-aaab-467fe1d4b13d admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:45.516848 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:45.522675 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be7b4f-ab2f-48e0-b9f0-b955790641b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:45.530165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be7b4f-ab2f-48e0-b9f0-b955790641b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:45.530165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be7b4f-ab2f-48e0-b9f0-b955790641b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:45.530165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be7b4f-ab2f-48e0-b9f0-b955790641b0 admin admin] PATH_INFO: `/v3/projects/b86fc104b6ff4c76b993dc837abc46c9/users/f821af93f8a441b5ab018b9d5f3c712a/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:45.541757 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be7b4f-ab2f-48e0-b9f0-b955790641b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86fc104b6ff4c76b993dc837abc46c9, user_id=f821af93f8a441b5ab018b9d5f3c712a, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:45.544530 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be7b4f-ab2f-48e0-b9f0-b955790641b0 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:45.659473 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1412/2789] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:13:45 2022] PUT /identity/v3/projects/b86fc104b6ff4c76b993dc837abc46c9/users/f821af93f8a441b5ab018b9d5f3c712a/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:13:45.661959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552daa94-f814-47d3-b213-a33a976d51d5 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:45.662313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552daa94-f814-47d3-b213-a33a976d51d5 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:45.662705 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552daa94-f814-47d3-b213-a33a976d51d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:45.702096 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-552daa94-f814-47d3-b213-a33a976d51d5 None None] MFA Rules not processed for user `f821af93f8a441b5ab018b9d5f3c712a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:45.703595 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-552daa94-f814-47d3-b213-a33a976d51d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:45.739041 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d9cd5c58-8141-4f18-8bc8-4d7fb856a8d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35bfb32727ff4e8bac5d341caba96a95'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:45.743982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d9cd5c58-8141-4f18-8bc8-4d7fb856a8d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35bfb32727ff4e8bac5d341caba96a95'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:45.744662 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d9cd5c58-8141-4f18-8bc8-4d7fb856a8d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35bfb32727ff4e8bac5d341caba96a95'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:45.796720 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:45.801256 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1413/2790] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:13:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:13:45.812194 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552daa94-f814-47d3-b213-a33a976d51d5 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:45.813554 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-552daa94-f814-47d3-b213-a33a976d51d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:45.861418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d9cd5c58-8141-4f18-8bc8-4d7fb856a8d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35bfb32727ff4e8bac5d341caba96a95'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:45.873771 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552daa94-f814-47d3-b213-a33a976d51d5 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:45.878278 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-d9cd5c58-8141-4f18-8bc8-4d7fb856a8d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35bfb32727ff4e8bac5d341caba96a95'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:45.878484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f5a4d-759f-47a7-983f-f56fc075b4dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:45.879093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f5a4d-759f-47a7-983f-f56fc075b4dc service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:45.879397 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f5a4d-759f-47a7-983f-f56fc075b4dc service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:45.879669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f5a4d-759f-47a7-983f-f56fc075b4dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:45.888394 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f5a4d-759f-47a7-983f-f56fc075b4dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:45.889826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f5a4d-759f-47a7-983f-f56fc075b4dc service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:45.891259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1378/2791] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:13:45 2022] DELETE /identity/v3/users/35bfb32727ff4e8bac5d341caba96a95 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:13:45.900303 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1414/2792] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:13:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:13:46.260128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd5c58-8141-4f18-8bc8-4d7fb856a8d6 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:46.261767 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d9cd5c58-8141-4f18-8bc8-4d7fb856a8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:46.339361 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd5c58-8141-4f18-8bc8-4d7fb856a8d6 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:46.344217 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982a52d-3daa-475f-9774-176857daa8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:46.345798 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982a52d-3daa-475f-9774-176857daa8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:46.346028 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982a52d-3daa-475f-9774-176857daa8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:46.346284 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982a52d-3daa-475f-9774-176857daa8e5 admin admin] PATH_INFO: `/v3/projects/7a2dc0f2935c49cf991c3b5c05711be7` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:46.350692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982a52d-3daa-475f-9774-176857daa8e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a2dc0f2935c49cf991c3b5c05711be7)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:46.350692 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982a52d-3daa-475f-9774-176857daa8e5 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:46.520072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0982a52d-3daa-475f-9774-176857daa8e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a2dc0f2935c49cf991c3b5c05711be7', 'request_id': 'req-0982a52d-3daa-475f-9774-176857daa8e5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:46.586392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0982a52d-3daa-475f-9774-176857daa8e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a2dc0f2935c49cf991c3b5c05711be7', 'request_id': 'req-0982a52d-3daa-475f-9774-176857daa8e5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:46.593327 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0982a52d-3daa-475f-9774-176857daa8e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a2dc0f2935c49cf991c3b5c05711be7', 'request_id': 'req-0982a52d-3daa-475f-9774-176857daa8e5'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:46.605445 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0982a52d-3daa-475f-9774-176857daa8e5 admin admin] The token cache is being invalidate because project 7a2dc0f2935c49cf991c3b5c05711be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:13:46.605855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0982a52d-3daa-475f-9774-176857daa8e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:46.606548 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-0982a52d-3daa-475f-9774-176857daa8e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:46.608099 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1379/2793] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:13:46 2022] DELETE /identity/v3/projects/7a2dc0f2935c49cf991c3b5c05711be7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:46.613635 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7d608-c385-4098-8c18-85617a534d03 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:46.614155 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7d608-c385-4098-8c18-85617a534d03 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:46.614265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7d608-c385-4098-8c18-85617a534d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:46.631578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-d4c7d608-c385-4098-8c18-85617a534d03 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:46.632762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d4c7d608-c385-4098-8c18-85617a534d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:46.699261 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982a52d-3daa-475f-9774-176857daa8e5 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:46.699900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1415/2794] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:13:46.706909 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-0982a52d-3daa-475f-9774-176857daa8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:46.709012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e26992-cf85-4ae9-9147-054f2ea7e022 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:46.709306 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e26992-cf85-4ae9-9147-054f2ea7e022 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:46.709599 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e26992-cf85-4ae9-9147-054f2ea7e022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:46.721756 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982a52d-3daa-475f-9774-176857daa8e5 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:46.726536 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2a739-0ba6-4fd4-a008-0fcd089178f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:46.727524 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2a739-0ba6-4fd4-a008-0fcd089178f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:46.727815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2a739-0ba6-4fd4-a008-0fcd089178f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:46.728094 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2a739-0ba6-4fd4-a008-0fcd089178f6 admin admin] PATH_INFO: `/v3/users/caebb88017f94b25bbbac26be1218bc3` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:46.729284 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2a739-0ba6-4fd4-a008-0fcd089178f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caebb88017f94b25bbbac26be1218bc3)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:46.730758 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-18e26992-cf85-4ae9-9147-054f2ea7e022 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:46.731422 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2a739-0ba6-4fd4-a008-0fcd089178f6 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:46.731946 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-18e26992-cf85-4ae9-9147-054f2ea7e022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:46.743075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1416/2795] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:13:46.747027 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e26992-cf85-4ae9-9147-054f2ea7e022 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:46.748396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:46.756554 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e26992-cf85-4ae9-9147-054f2ea7e022 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:46.761329 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396ded4-1ad4-41f7-abf4-734ff208da1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:46.761980 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396ded4-1ad4-41f7-abf4-734ff208da1a admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:46.762268 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396ded4-1ad4-41f7-abf4-734ff208da1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:46.762658 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396ded4-1ad4-41f7-abf4-734ff208da1a admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:46.763377 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396ded4-1ad4-41f7-abf4-734ff208da1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:13:46.763686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396ded4-1ad4-41f7-abf4-734ff208da1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:46.765281 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396ded4-1ad4-41f7-abf4-734ff208da1a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:46.777041 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1417/2796] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:13:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:13:46.781340 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396ded4-1ad4-41f7-abf4-734ff208da1a admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:46.791465 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396ded4-1ad4-41f7-abf4-734ff208da1a admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:46.796082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bc6f3-b22b-433d-bf48-1f0659003f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:46.796712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bc6f3-b22b-433d-bf48-1f0659003f7e admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:46.797000 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bc6f3-b22b-433d-bf48-1f0659003f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:46.797276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bc6f3-b22b-433d-bf48-1f0659003f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:46.798650 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bc6f3-b22b-433d-bf48-1f0659003f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:46.800630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bc6f3-b22b-433d-bf48-1f0659003f7e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:46.914382 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1418/2797] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:13:46 2022] POST /identity/v3/projects => generated 372 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:13:46.917897 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bc6f3-b22b-433d-bf48-1f0659003f7e admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:46.943807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b1b2a739-0ba6-4fd4-a008-0fcd089178f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caebb88017f94b25bbbac26be1218bc3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:46.944488 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b1b2a739-0ba6-4fd4-a008-0fcd089178f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caebb88017f94b25bbbac26be1218bc3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:46.945126 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b1b2a739-0ba6-4fd4-a008-0fcd089178f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caebb88017f94b25bbbac26be1218bc3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:47.019964 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bc6f3-b22b-433d-bf48-1f0659003f7e admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:47.024925 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40285655-f96a-4838-9798-a7d0926ca8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:47.025642 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40285655-f96a-4838-9798-a7d0926ca8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:47.025882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40285655-f96a-4838-9798-a7d0926ca8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:47.026164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40285655-f96a-4838-9798-a7d0926ca8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:47.026897 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40285655-f96a-4838-9798-a7d0926ca8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:47.028821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40285655-f96a-4838-9798-a7d0926ca8a9 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:47.034977 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b1b2a739-0ba6-4fd4-a008-0fcd089178f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caebb88017f94b25bbbac26be1218bc3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:47.037198 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:47.047910 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b1b2a739-0ba6-4fd4-a008-0fcd089178f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caebb88017f94b25bbbac26be1218bc3'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:47.060416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1380/2798] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:13:46 2022] DELETE /identity/v3/users/caebb88017f94b25bbbac26be1218bc3 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:47.133548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1419/2799] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:13:46 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:13:47.140392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2a739-0ba6-4fd4-a008-0fcd089178f6 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:47.142584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b1b2a739-0ba6-4fd4-a008-0fcd089178f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:47.208673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2a739-0ba6-4fd4-a008-0fcd089178f6 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:47.213519 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351cc6e-82da-46f4-a2ea-56f1e88193ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:47.214198 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351cc6e-82da-46f4-a2ea-56f1e88193ca admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:47.214580 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351cc6e-82da-46f4-a2ea-56f1e88193ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:47.214796 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351cc6e-82da-46f4-a2ea-56f1e88193ca admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:47.215523 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351cc6e-82da-46f4-a2ea-56f1e88193ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:47.217141 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351cc6e-82da-46f4-a2ea-56f1e88193ca admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:47.227349 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1381/2800] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:13:47 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:13:47.231581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40285655-f96a-4838-9798-a7d0926ca8a9 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:47.241952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40285655-f96a-4838-9798-a7d0926ca8a9 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:47.246583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c477a0c-e908-40a3-b3c9-6cf04f3917b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:47.247240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c477a0c-e908-40a3-b3c9-6cf04f3917b3 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:47.247520 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c477a0c-e908-40a3-b3c9-6cf04f3917b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:47.247793 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c477a0c-e908-40a3-b3c9-6cf04f3917b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:47.248506 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c477a0c-e908-40a3-b3c9-6cf04f3917b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:47.250081 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c477a0c-e908-40a3-b3c9-6cf04f3917b3 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:47.260648 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1420/2801] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:13:47 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:13:47.264805 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351cc6e-82da-46f4-a2ea-56f1e88193ca admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:47.275300 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351cc6e-82da-46f4-a2ea-56f1e88193ca admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:47.280608 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed090ded-702d-41e7-b711-f0bec175dc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:47.281565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed090ded-702d-41e7-b711-f0bec175dc3d admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:47.281961 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed090ded-702d-41e7-b711-f0bec175dc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:47.282476 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed090ded-702d-41e7-b711-f0bec175dc3d admin admin] PATH_INFO: `/v3/projects/c8e91adca189492b8098f2d642205705/users/81ed6cd46fd9441cbdc99d56fdb03a99/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:47.298373 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed090ded-702d-41e7-b711-f0bec175dc3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e91adca189492b8098f2d642205705, user_id=81ed6cd46fd9441cbdc99d56fdb03a99, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:47.300994 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed090ded-702d-41e7-b711-f0bec175dc3d admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:47.353916 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c477a0c-e908-40a3-b3c9-6cf04f3917b3 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:47.355737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6c477a0c-e908-40a3-b3c9-6cf04f3917b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:47.369488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c477a0c-e908-40a3-b3c9-6cf04f3917b3 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:47.378184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1382/2802] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:13:47 2022] PUT /identity/v3/projects/c8e91adca189492b8098f2d642205705/users/81ed6cd46fd9441cbdc99d56fdb03a99/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:47.388116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d0905-e4ad-4b4b-b940-da8f91c210f4 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:47.388415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d0905-e4ad-4b4b-b940-da8f91c210f4 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:47.388696 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d0905-e4ad-4b4b-b940-da8f91c210f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:47.416190 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-5d4d0905-e4ad-4b4b-b940-da8f91c210f4 None None] MFA Rules not processed for user `81ed6cd46fd9441cbdc99d56fdb03a99`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:47.417417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5d4d0905-e4ad-4b4b-b940-da8f91c210f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:47.440023 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77266587-d3bc-4a24-b947-867d29df1169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:47.441900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77266587-d3bc-4a24-b947-867d29df1169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:47.441900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77266587-d3bc-4a24-b947-867d29df1169 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:47.441900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77266587-d3bc-4a24-b947-867d29df1169 admin admin] PATH_INFO: `/v3/projects/ac969ae313524a28b6635d82db310f97` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:47.442973 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77266587-d3bc-4a24-b947-867d29df1169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac969ae313524a28b6635d82db310f97)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:47.445141 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77266587-d3bc-4a24-b947-867d29df1169 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:47.493152 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1383/2803] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:13:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:13:47.504190 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d0905-e4ad-4b4b-b940-da8f91c210f4 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:47.505555 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5d4d0905-e4ad-4b4b-b940-da8f91c210f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:47.558624 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-77266587-d3bc-4a24-b947-867d29df1169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac969ae313524a28b6635d82db310f97', 'request_id': 'req-77266587-d3bc-4a24-b947-867d29df1169'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:47.562409 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d0905-e4ad-4b4b-b940-da8f91c210f4 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:47.564800 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:47.612587 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbab7a-29e6-49e9-ad53-9b9a81097aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:47.613166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbab7a-29e6-49e9-ad53-9b9a81097aae service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:47.613454 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbab7a-29e6-49e9-ad53-9b9a81097aae service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:47.613732 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbab7a-29e6-49e9-ad53-9b9a81097aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:47.629330 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-77266587-d3bc-4a24-b947-867d29df1169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac969ae313524a28b6635d82db310f97', 'request_id': 'req-77266587-d3bc-4a24-b947-867d29df1169'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:47.636204 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-77266587-d3bc-4a24-b947-867d29df1169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac969ae313524a28b6635d82db310f97', 'request_id': 'req-77266587-d3bc-4a24-b947-867d29df1169'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:47.647347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-77266587-d3bc-4a24-b947-867d29df1169 admin admin] The token cache is being invalidate because project ac969ae313524a28b6635d82db310f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:13:47.647633 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-77266587-d3bc-4a24-b947-867d29df1169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:47.648304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-77266587-d3bc-4a24-b947-867d29df1169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:47.649929 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1421/2804] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:13:47 2022] DELETE /identity/v3/projects/ac969ae313524a28b6635d82db310f97 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:13:47.653790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77266587-d3bc-4a24-b947-867d29df1169 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:47.655130 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-77266587-d3bc-4a24-b947-867d29df1169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:47.674399 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbab7a-29e6-49e9-ad53-9b9a81097aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:47.675855 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbab7a-29e6-49e9-ad53-9b9a81097aae service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:47.684990 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1384/2805] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:13:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:13:47.706176 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbab7a-29e6-49e9-ad53-9b9a81097aae service cinder] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:47.722617 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77266587-d3bc-4a24-b947-867d29df1169 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:47.727581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c6ffe-c7f2-4969-94ae-70fec0502b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:47.728460 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c6ffe-c7f2-4969-94ae-70fec0502b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:47.728748 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c6ffe-c7f2-4969-94ae-70fec0502b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:47.729026 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c6ffe-c7f2-4969-94ae-70fec0502b94 admin admin] PATH_INFO: `/v3/users/ac696abfab6943cb9efbf7bdd385d010` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:47.730241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c6ffe-c7f2-4969-94ae-70fec0502b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac696abfab6943cb9efbf7bdd385d010)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:47.732324 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c6ffe-c7f2-4969-94ae-70fec0502b94 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:47.745696 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:47.772121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbab7a-29e6-49e9-ad53-9b9a81097aae service cinder] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:47.776783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f9961-6ca4-48e3-afc5-7e50d73348af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:47.777662 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f9961-6ca4-48e3-afc5-7e50d73348af admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:47.777950 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f9961-6ca4-48e3-afc5-7e50d73348af admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:47.778229 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f9961-6ca4-48e3-afc5-7e50d73348af admin admin] PATH_INFO: `/v3/users/81ed6cd46fd9441cbdc99d56fdb03a99` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:47.779474 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f9961-6ca4-48e3-afc5-7e50d73348af admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ed6cd46fd9441cbdc99d56fdb03a99)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:47.781409 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f9961-6ca4-48e3-afc5-7e50d73348af admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:47.786641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=100 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:47.926505 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a33c6ffe-c7f2-4969-94ae-70fec0502b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac696abfab6943cb9efbf7bdd385d010'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:47.927285 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a33c6ffe-c7f2-4969-94ae-70fec0502b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac696abfab6943cb9efbf7bdd385d010'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:47.939401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a33c6ffe-c7f2-4969-94ae-70fec0502b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac696abfab6943cb9efbf7bdd385d010'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:47.988895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f58f9961-6ca4-48e3-afc5-7e50d73348af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ed6cd46fd9441cbdc99d56fdb03a99'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:47.997982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f58f9961-6ca4-48e3-afc5-7e50d73348af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ed6cd46fd9441cbdc99d56fdb03a99'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:47.997982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f58f9961-6ca4-48e3-afc5-7e50d73348af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ed6cd46fd9441cbdc99d56fdb03a99'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:48.021312 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a33c6ffe-c7f2-4969-94ae-70fec0502b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac696abfab6943cb9efbf7bdd385d010'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:48.029865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-a33c6ffe-c7f2-4969-94ae-70fec0502b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac696abfab6943cb9efbf7bdd385d010'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:48.037012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1422/2806] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:13:47 2022] DELETE /identity/v3/users/ac696abfab6943cb9efbf7bdd385d010 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:13:48.134895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f58f9961-6ca4-48e3-afc5-7e50d73348af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ed6cd46fd9441cbdc99d56fdb03a99'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:48.148363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f58f9961-6ca4-48e3-afc5-7e50d73348af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ed6cd46fd9441cbdc99d56fdb03a99'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:48.162046 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1385/2807] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:13:47 2022] DELETE /identity/v3/users/81ed6cd46fd9441cbdc99d56fdb03a99 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:13:48.166809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415b2d6-3a9c-4eaa-acec-a93bba48f724 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:48.168071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415b2d6-3a9c-4eaa-acec-a93bba48f724 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:48.168071 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415b2d6-3a9c-4eaa-acec-a93bba48f724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:48.185508 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-7415b2d6-3a9c-4eaa-acec-a93bba48f724 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:48.186669 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7415b2d6-3a9c-4eaa-acec-a93bba48f724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:48.250393 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1423/2808] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:13:48.260059 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f9961-6ca4-48e3-afc5-7e50d73348af admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:48.261446 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f58f9961-6ca4-48e3-afc5-7e50d73348af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:48.305851 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415b2d6-3a9c-4eaa-acec-a93bba48f724 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:48.307675 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7415b2d6-3a9c-4eaa-acec-a93bba48f724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:48.322570 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415b2d6-3a9c-4eaa-acec-a93bba48f724 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:48.328200 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f9961-6ca4-48e3-afc5-7e50d73348af admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:48.328412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57279d30-d30e-42b5-9082-6b656485cec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:48.328412 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57279d30-d30e-42b5-9082-6b656485cec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:48.330186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57279d30-d30e-42b5-9082-6b656485cec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:48.330277 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57279d30-d30e-42b5-9082-6b656485cec8 admin admin] PATH_INFO: `/v3/projects/e37ac11ecdf1411a843beab041b60409` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:48.331521 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57279d30-d30e-42b5-9082-6b656485cec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e37ac11ecdf1411a843beab041b60409)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:48.332456 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70bb7b-522d-4bd9-ba05-8fd26df09f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:48.333313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70bb7b-522d-4bd9-ba05-8fd26df09f57 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:48.333566 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70bb7b-522d-4bd9-ba05-8fd26df09f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:48.333780 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57279d30-d30e-42b5-9082-6b656485cec8 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:48.333923 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70bb7b-522d-4bd9-ba05-8fd26df09f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:48.345480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70bb7b-522d-4bd9-ba05-8fd26df09f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:48.346959 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70bb7b-522d-4bd9-ba05-8fd26df09f57 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:48.356655 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1386/2809] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:48.428847 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-57279d30-d30e-42b5-9082-6b656485cec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e37ac11ecdf1411a843beab041b60409', 'request_id': 'req-57279d30-d30e-42b5-9082-6b656485cec8'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:48.523379 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-57279d30-d30e-42b5-9082-6b656485cec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e37ac11ecdf1411a843beab041b60409', 'request_id': 'req-57279d30-d30e-42b5-9082-6b656485cec8'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:48.530098 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-57279d30-d30e-42b5-9082-6b656485cec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e37ac11ecdf1411a843beab041b60409', 'request_id': 'req-57279d30-d30e-42b5-9082-6b656485cec8'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:48.541108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-57279d30-d30e-42b5-9082-6b656485cec8 admin admin] The token cache is being invalidate because project e37ac11ecdf1411a843beab041b60409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:13:48.541389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-57279d30-d30e-42b5-9082-6b656485cec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:48.542059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-57279d30-d30e-42b5-9082-6b656485cec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:48.543636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1424/2810] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:13:48 2022] DELETE /identity/v3/projects/e37ac11ecdf1411a843beab041b60409 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:48.843214 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70bb7b-522d-4bd9-ba05-8fd26df09f57 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:48.844974 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-6b70bb7b-522d-4bd9-ba05-8fd26df09f57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:48.859863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70bb7b-522d-4bd9-ba05-8fd26df09f57 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:48.920749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27222e5c-391d-4706-8cf6-f82a79898617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:48.921623 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27222e5c-391d-4706-8cf6-f82a79898617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:48.921908 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27222e5c-391d-4706-8cf6-f82a79898617 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:48.922187 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27222e5c-391d-4706-8cf6-f82a79898617 admin admin] PATH_INFO: `/v3/projects/c8e91adca189492b8098f2d642205705` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:48.923976 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27222e5c-391d-4706-8cf6-f82a79898617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e91adca189492b8098f2d642205705)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:48.925889 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27222e5c-391d-4706-8cf6-f82a79898617 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:49.152271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:49.168306 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-27222e5c-391d-4706-8cf6-f82a79898617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e91adca189492b8098f2d642205705', 'request_id': 'req-27222e5c-391d-4706-8cf6-f82a79898617'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:49.286334 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-27222e5c-391d-4706-8cf6-f82a79898617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e91adca189492b8098f2d642205705', 'request_id': 'req-27222e5c-391d-4706-8cf6-f82a79898617'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:49.293105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-27222e5c-391d-4706-8cf6-f82a79898617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e91adca189492b8098f2d642205705', 'request_id': 'req-27222e5c-391d-4706-8cf6-f82a79898617'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:49.303671 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-27222e5c-391d-4706-8cf6-f82a79898617 admin admin] The token cache is being invalidate because project c8e91adca189492b8098f2d642205705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:13:49.303959 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-27222e5c-391d-4706-8cf6-f82a79898617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:49.304581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-27222e5c-391d-4706-8cf6-f82a79898617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:49.306172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1387/2811] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:13:48 2022] DELETE /identity/v3/projects/c8e91adca189492b8098f2d642205705 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:49.310959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8473599-dbac-41d6-86c0-67d891ba7422 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:49.311448 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8473599-dbac-41d6-86c0-67d891ba7422 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:49.311555 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8473599-dbac-41d6-86c0-67d891ba7422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:49.330769 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-d8473599-dbac-41d6-86c0-67d891ba7422 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:49.331957 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-d8473599-dbac-41d6-86c0-67d891ba7422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:49.340433 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:49.390626 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1425/2812] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:49.399020 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135ce3e-107d-42ee-8852-38af238c9e53 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:49.399311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135ce3e-107d-42ee-8852-38af238c9e53 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:49.399590 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135ce3e-107d-42ee-8852-38af238c9e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:49.419519 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-a135ce3e-107d-42ee-8852-38af238c9e53 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:49.420655 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a135ce3e-107d-42ee-8852-38af238c9e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:49.430020 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1388/2813] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:49.434469 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8473599-dbac-41d6-86c0-67d891ba7422 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:49.448477 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8473599-dbac-41d6-86c0-67d891ba7422 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:49.453881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f179b76-9baf-41b7-b0c3-db3032acedef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:49.454631 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f179b76-9baf-41b7-b0c3-db3032acedef admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:49.454917 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f179b76-9baf-41b7-b0c3-db3032acedef admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:49.455191 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f179b76-9baf-41b7-b0c3-db3032acedef admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:49.455913 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f179b76-9baf-41b7-b0c3-db3032acedef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:13:49.457154 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f179b76-9baf-41b7-b0c3-db3032acedef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:49.458210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f179b76-9baf-41b7-b0c3-db3032acedef admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:49.471217 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1426/2814] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:13:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:13:49.475499 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135ce3e-107d-42ee-8852-38af238c9e53 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:49.485417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135ce3e-107d-42ee-8852-38af238c9e53 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:49.491335 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878078d-1bd8-4d82-8ed1-daad9a68d53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:49.492100 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878078d-1bd8-4d82-8ed1-daad9a68d53f admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:49.492303 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878078d-1bd8-4d82-8ed1-daad9a68d53f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:49.492582 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878078d-1bd8-4d82-8ed1-daad9a68d53f admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:49.493268 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878078d-1bd8-4d82-8ed1-daad9a68d53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:49.495225 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878078d-1bd8-4d82-8ed1-daad9a68d53f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:49.585314 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1389/2815] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:13:49 2022] POST /identity/v3/projects => generated 384 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:13:49.589441 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f179b76-9baf-41b7-b0c3-db3032acedef admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:49.600200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f179b76-9baf-41b7-b0c3-db3032acedef admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:49.655606 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdad07-2c0f-45cb-8c75-201af237cb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:49.656279 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdad07-2c0f-45cb-8c75-201af237cb06 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:49.656577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdad07-2c0f-45cb-8c75-201af237cb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:49.656836 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdad07-2c0f-45cb-8c75-201af237cb06 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:49.658035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdad07-2c0f-45cb-8c75-201af237cb06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:49.659995 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdad07-2c0f-45cb-8c75-201af237cb06 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:49.771212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1427/2816] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:13:49 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:13:49.775253 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878078d-1bd8-4d82-8ed1-daad9a68d53f admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:49.787484 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878078d-1bd8-4d82-8ed1-daad9a68d53f admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:49.792355 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c633abf-28c9-4edd-a504-2959568fd9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:49.793017 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c633abf-28c9-4edd-a504-2959568fd9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:49.793304 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c633abf-28c9-4edd-a504-2959568fd9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:49.793584 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c633abf-28c9-4edd-a504-2959568fd9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:49.794485 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c633abf-28c9-4edd-a504-2959568fd9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:49.796090 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c633abf-28c9-4edd-a504-2959568fd9a1 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:49.808302 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1390/2817] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:13:49 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:13:49.812630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdad07-2c0f-45cb-8c75-201af237cb06 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:49.823171 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdad07-2c0f-45cb-8c75-201af237cb06 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:49.827762 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90425a56-4796-4ecd-8759-42bf73b63272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:49.828404 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90425a56-4796-4ecd-8759-42bf73b63272 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:49.828686 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90425a56-4796-4ecd-8759-42bf73b63272 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:49.828959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90425a56-4796-4ecd-8759-42bf73b63272 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:49.830229 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90425a56-4796-4ecd-8759-42bf73b63272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:49.831971 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90425a56-4796-4ecd-8759-42bf73b63272 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:49.843814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1428/2818] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:13:49 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:13:49.850728 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c633abf-28c9-4edd-a504-2959568fd9a1 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:49.861433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c633abf-28c9-4edd-a504-2959568fd9a1 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:49.866119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ae374-ce60-467e-a10b-864ddee012a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:49.867035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ae374-ce60-467e-a10b-864ddee012a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:49.867322 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ae374-ce60-467e-a10b-864ddee012a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:49.867605 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ae374-ce60-467e-a10b-864ddee012a2 admin admin] PATH_INFO: `/v3/projects/834c739682ea4ad3b3c46e186f614da0/users/bfc44704d2a748878e651b6f44284673/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:49.883078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ae374-ce60-467e-a10b-864ddee012a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=834c739682ea4ad3b3c46e186f614da0, user_id=bfc44704d2a748878e651b6f44284673, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:49.885901 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ae374-ce60-467e-a10b-864ddee012a2 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:49.951819 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1391/2819] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:13:49 2022] PUT /identity/v3/projects/834c739682ea4ad3b3c46e186f614da0/users/bfc44704d2a748878e651b6f44284673/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:49.963398 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6abde5-f494-47c2-849c-f8042da8c0a3 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:49.963671 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6abde5-f494-47c2-849c-f8042da8c0a3 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:49.964001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6abde5-f494-47c2-849c-f8042da8c0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:49.990996 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-7c6abde5-f494-47c2-849c-f8042da8c0a3 None None] MFA Rules not processed for user `bfc44704d2a748878e651b6f44284673`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:49.992222 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7c6abde5-f494-47c2-849c-f8042da8c0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:50.059616 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1429/2820] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:13:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:50.070633 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ae374-ce60-467e-a10b-864ddee012a2 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:50.072348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d76ae374-ce60-467e-a10b-864ddee012a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:50.130655 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ae374-ce60-467e-a10b-864ddee012a2 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:50.134278 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b199af-3186-4890-a156-3a52ef38a1b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:50.134962 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b199af-3186-4890-a156-3a52ef38a1b2 service cinder] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:50.135250 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b199af-3186-4890-a156-3a52ef38a1b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:50.135529 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b199af-3186-4890-a156-3a52ef38a1b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:50.144560 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b199af-3186-4890-a156-3a52ef38a1b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:50.145993 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b199af-3186-4890-a156-3a52ef38a1b2 service cinder] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:50.154851 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1392/2821] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:13:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:14:00.056187 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:00.150812 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=67,keystone:DELETE=5,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:00.589176 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6abde5-f494-47c2-849c-f8042da8c0a3 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:00.590705 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-7c6abde5-f494-47c2-849c-f8042da8c0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:00.658165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6abde5-f494-47c2-849c-f8042da8c0a3 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:00.663159 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3ccf6-d3cb-46ab-9a53-3ec1f456aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:00.664052 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3ccf6-d3cb-46ab-9a53-3ec1f456aaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:00.664338 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3ccf6-d3cb-46ab-9a53-3ec1f456aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:00.664626 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3ccf6-d3cb-46ab-9a53-3ec1f456aaa8 admin admin] PATH_INFO: `/v3/users/f2741830101944f9934633cb94cf846d` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:00.665821 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3ccf6-d3cb-46ab-9a53-3ec1f456aaa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2741830101944f9934633cb94cf846d)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:00.667816 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3ccf6-d3cb-46ab-9a53-3ec1f456aaa8 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:00.897564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-baa3ccf6-d3cb-46ab-9a53-3ec1f456aaa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2741830101944f9934633cb94cf846d'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:00.898258 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-baa3ccf6-d3cb-46ab-9a53-3ec1f456aaa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2741830101944f9934633cb94cf846d'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:00.910344 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-baa3ccf6-d3cb-46ab-9a53-3ec1f456aaa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2741830101944f9934633cb94cf846d'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:01.054713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-baa3ccf6-d3cb-46ab-9a53-3ec1f456aaa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2741830101944f9934633cb94cf846d'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:01.061761 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-baa3ccf6-d3cb-46ab-9a53-3ec1f456aaa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2741830101944f9934633cb94cf846d'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:01.068375 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1430/2822] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:14:00 2022] DELETE /identity/v3/users/f2741830101944f9934633cb94cf846d => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:14:01.073154 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd366eb-7812-4fbf-be6a-a7760f772367 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:01.073450 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd366eb-7812-4fbf-be6a-a7760f772367 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:01.073733 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd366eb-7812-4fbf-be6a-a7760f772367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:01.091283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-5fd366eb-7812-4fbf-be6a-a7760f772367 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:01.092482 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5fd366eb-7812-4fbf-be6a-a7760f772367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:01.153260 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1393/2823] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:14:01.163121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3ccf6-d3cb-46ab-9a53-3ec1f456aaa8 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:01.164733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-baa3ccf6-d3cb-46ab-9a53-3ec1f456aaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:01.225354 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3ccf6-d3cb-46ab-9a53-3ec1f456aaa8 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:01.228961 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7273aa4-c2c5-4e17-913c-48a5962d6517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:01.229642 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7273aa4-c2c5-4e17-913c-48a5962d6517 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:01.229929 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7273aa4-c2c5-4e17-913c-48a5962d6517 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:01.230210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7273aa4-c2c5-4e17-913c-48a5962d6517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:01.240015 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7273aa4-c2c5-4e17-913c-48a5962d6517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:01.241433 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7273aa4-c2c5-4e17-913c-48a5962d6517 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:01.250826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1431/2824] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:14:01.713874 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd366eb-7812-4fbf-be6a-a7760f772367 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:01.715360 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5fd366eb-7812-4fbf-be6a-a7760f772367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:01.728737 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd366eb-7812-4fbf-be6a-a7760f772367 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:01.733396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:01.734311 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:01.734632 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:01.734917 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529 admin admin] PATH_INFO: `/v3/projects/3789eeb98a0442309812ca2989f83379` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:01.736112 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3789eeb98a0442309812ca2989f83379)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:01.738036 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:01.854676 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3789eeb98a0442309812ca2989f83379', 'request_id': 'req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:01.937435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3789eeb98a0442309812ca2989f83379', 'request_id': 'req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:01.944660 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3789eeb98a0442309812ca2989f83379', 'request_id': 'req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:01.956243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529 admin admin] The token cache is being invalidate because project 3789eeb98a0442309812ca2989f83379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:14:01.956565 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:01.957355 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:01.961996 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1394/2825] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:14:01 2022] DELETE /identity/v3/projects/3789eeb98a0442309812ca2989f83379 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:14:01.964726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7273aa4-c2c5-4e17-913c-48a5962d6517 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:01.975091 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7273aa4-c2c5-4e17-913c-48a5962d6517 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:01.993906 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:02.033427 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7a0f0-5ad7-4198-9d17-d60f5c9a44a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:02.034560 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7a0f0-5ad7-4198-9d17-d60f5c9a44a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:02.035014 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7a0f0-5ad7-4198-9d17-d60f5c9a44a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:02.035662 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7a0f0-5ad7-4198-9d17-d60f5c9a44a9 admin admin] PATH_INFO: `/v3/users/5b6f8459f28c4c058e08a8a4d3e28f72` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:02.037858 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7a0f0-5ad7-4198-9d17-d60f5c9a44a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6f8459f28c4c058e08a8a4d3e28f72)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:02.039904 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7a0f0-5ad7-4198-9d17-d60f5c9a44a9 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:02.269451 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9ba7a0f0-5ad7-4198-9d17-d60f5c9a44a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6f8459f28c4c058e08a8a4d3e28f72'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:02.271192 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9ba7a0f0-5ad7-4198-9d17-d60f5c9a44a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6f8459f28c4c058e08a8a4d3e28f72'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:02.284280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9ba7a0f0-5ad7-4198-9d17-d60f5c9a44a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6f8459f28c4c058e08a8a4d3e28f72'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:02.343304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9ba7a0f0-5ad7-4198-9d17-d60f5c9a44a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6f8459f28c4c058e08a8a4d3e28f72'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:02.351086 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9ba7a0f0-5ad7-4198-9d17-d60f5c9a44a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6f8459f28c4c058e08a8a4d3e28f72'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:02.357529 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1432/2826] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:14:01 2022] DELETE /identity/v3/users/5b6f8459f28c4c058e08a8a4d3e28f72 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:14:02.459498 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:02.459498 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:02.471347 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0283faa-35b7-4ddb-a1e8-62ab8cd7b529 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:02.538895 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a215ac2-6b4e-4322-b0ff-4c17cec26b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:02.539793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a215ac2-6b4e-4322-b0ff-4c17cec26b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:02.540084 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a215ac2-6b4e-4322-b0ff-4c17cec26b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:02.540366 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a215ac2-6b4e-4322-b0ff-4c17cec26b2f admin admin] PATH_INFO: `/v3/users/bfc44704d2a748878e651b6f44284673` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:02.541715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a215ac2-6b4e-4322-b0ff-4c17cec26b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc44704d2a748878e651b6f44284673)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:02.543899 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a215ac2-6b4e-4322-b0ff-4c17cec26b2f admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:02.633396 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:02.762221 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-8a215ac2-6b4e-4322-b0ff-4c17cec26b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc44704d2a748878e651b6f44284673'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:02.765023 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-8a215ac2-6b4e-4322-b0ff-4c17cec26b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc44704d2a748878e651b6f44284673'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:02.765705 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-8a215ac2-6b4e-4322-b0ff-4c17cec26b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc44704d2a748878e651b6f44284673'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:02.802874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7a0f0-5ad7-4198-9d17-d60f5c9a44a9 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:02.804564 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-9ba7a0f0-5ad7-4198-9d17-d60f5c9a44a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:02.818355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7a0f0-5ad7-4198-9d17-d60f5c9a44a9 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:02.823888 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3fdb7-7f10-4a70-8672-e6179532f23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:02.824820 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3fdb7-7f10-4a70-8672-e6179532f23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:02.825112 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3fdb7-7f10-4a70-8672-e6179532f23c admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:02.825415 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3fdb7-7f10-4a70-8672-e6179532f23c admin admin] PATH_INFO: `/v3/projects/df107c16e52b4946abe222ad3f9df33b` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:02.826741 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3fdb7-7f10-4a70-8672-e6179532f23c admin admin] RBAC: Authorizing `identity:delete_project(project_id=df107c16e52b4946abe222ad3f9df33b)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:02.828727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3fdb7-7f10-4a70-8672-e6179532f23c admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:02.868363 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-8a215ac2-6b4e-4322-b0ff-4c17cec26b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc44704d2a748878e651b6f44284673'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:02.877362 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-8a215ac2-6b4e-4322-b0ff-4c17cec26b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc44704d2a748878e651b6f44284673'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:02.894040 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1395/2827] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:14:02 2022] DELETE /identity/v3/users/bfc44704d2a748878e651b6f44284673 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:14:02.896148 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadae89-2c37-44c5-9186-8db47c816c2f None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:02.897458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadae89-2c37-44c5-9186-8db47c816c2f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:02.897458 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadae89-2c37-44c5-9186-8db47c816c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:02.916783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-4dadae89-2c37-44c5-9186-8db47c816c2f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:02.917986 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4dadae89-2c37-44c5-9186-8db47c816c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:02.966230 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f3f3fdb7-7f10-4a70-8672-e6179532f23c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df107c16e52b4946abe222ad3f9df33b', 'request_id': 'req-f3f3fdb7-7f10-4a70-8672-e6179532f23c'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:02.981511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1396/2828] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:14:02.991407 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadae89-2c37-44c5-9186-8db47c816c2f None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:02.994245 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-4dadae89-2c37-44c5-9186-8db47c816c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:03.048681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f3f3fdb7-7f10-4a70-8672-e6179532f23c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df107c16e52b4946abe222ad3f9df33b', 'request_id': 'req-f3f3fdb7-7f10-4a70-8672-e6179532f23c'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:03.057642 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f3f3fdb7-7f10-4a70-8672-e6179532f23c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df107c16e52b4946abe222ad3f9df33b', 'request_id': 'req-f3f3fdb7-7f10-4a70-8672-e6179532f23c'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:03.057858 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadae89-2c37-44c5-9186-8db47c816c2f None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:03.070988 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f3f3fdb7-7f10-4a70-8672-e6179532f23c admin admin] The token cache is being invalidate because project df107c16e52b4946abe222ad3f9df33b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:14:03.071315 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f3f3fdb7-7f10-4a70-8672-e6179532f23c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:03.072313 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-f3f3fdb7-7f10-4a70-8672-e6179532f23c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:03.073897 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1433/2829] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:14:02 2022] DELETE /identity/v3/projects/df107c16e52b4946abe222ad3f9df33b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:14:03.078885 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4bbf7-5cd1-4b6c-85f7-23a0eeb48f6b None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:03.079365 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4bbf7-5cd1-4b6c-85f7-23a0eeb48f6b None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:03.079656 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4bbf7-5cd1-4b6c-85f7-23a0eeb48f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:03.100139 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-89d4bbf7-5cd1-4b6c-85f7-23a0eeb48f6b None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:03.101367 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-89d4bbf7-5cd1-4b6c-85f7-23a0eeb48f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:03.128580 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cfd8e-1910-40a0-8b5e-1a971ec0dd18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:03.129269 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cfd8e-1910-40a0-8b5e-1a971ec0dd18 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:03.130193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cfd8e-1910-40a0-8b5e-1a971ec0dd18 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:03.130564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cfd8e-1910-40a0-8b5e-1a971ec0dd18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:03.132152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:03.133630 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-365cfd8e-1910-40a0-8b5e-1a971ec0dd18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:03.152115 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:03.193100 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1434/2830] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:14:03.202380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faceab-137c-42ef-a447-eebabd9459a1 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:03.202380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faceab-137c-42ef-a447-eebabd9459a1 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:03.202380 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faceab-137c-42ef-a447-eebabd9459a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:03.227336 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-a5faceab-137c-42ef-a447-eebabd9459a1 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:03.229630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-a5faceab-137c-42ef-a447-eebabd9459a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:03.234103 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365cfd8e-1910-40a0-8b5e-1a971ec0dd18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:03.235822 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365cfd8e-1910-40a0-8b5e-1a971ec0dd18 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:03.241696 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1435/2831] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:14:03.246167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5faceab-137c-42ef-a447-eebabd9459a1 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:03.253723 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1397/2832] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:14:03.257422 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5faceab-137c-42ef-a447-eebabd9459a1 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:03.265486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ecb65-2889-4f61-b114-d950d4384b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:03.266676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ecb65-2889-4f61-b114-d950d4384b9e admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:03.267044 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ecb65-2889-4f61-b114-d950d4384b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:03.267640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ecb65-2889-4f61-b114-d950d4384b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:03.268468 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ecb65-2889-4f61-b114-d950d4384b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:14:03.268858 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ecb65-2889-4f61-b114-d950d4384b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:03.270734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ecb65-2889-4f61-b114-d950d4384b9e admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:03.293329 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1436/2833] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:14:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:14:03.299209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cfd8e-1910-40a0-8b5e-1a971ec0dd18 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:03.310769 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cfd8e-1910-40a0-8b5e-1a971ec0dd18 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:03.316035 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6424a0b-9a61-4017-8c3f-ea531f4e4fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:03.316656 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6424a0b-9a61-4017-8c3f-ea531f4e4fed admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:03.318052 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6424a0b-9a61-4017-8c3f-ea531f4e4fed admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:03.318391 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6424a0b-9a61-4017-8c3f-ea531f4e4fed admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:03.319243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6424a0b-9a61-4017-8c3f-ea531f4e4fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:03.321294 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6424a0b-9a61-4017-8c3f-ea531f4e4fed admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:03.471837 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1398/2834] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:14:03 2022] POST /identity/v3/projects => generated 364 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:14:03.476482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ecb65-2889-4f61-b114-d950d4384b9e admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:03.496165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ecb65-2889-4f61-b114-d950d4384b9e admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:03.579540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6c232-1571-4919-8e3a-53b7e667e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:03.580364 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6c232-1571-4919-8e3a-53b7e667e7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:03.580708 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6c232-1571-4919-8e3a-53b7e667e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:03.581101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6c232-1571-4919-8e3a-53b7e667e7b2 admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:03.581936 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6c232-1571-4919-8e3a-53b7e667e7b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:03.584881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6c232-1571-4919-8e3a-53b7e667e7b2 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:03.684759 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1437/2835] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:14:03 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:14:03.688783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6424a0b-9a61-4017-8c3f-ea531f4e4fed admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:03.702862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6424a0b-9a61-4017-8c3f-ea531f4e4fed admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:03.710313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94109667-0282-4bed-8fc5-1cb934251e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:03.711542 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94109667-0282-4bed-8fc5-1cb934251e47 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:03.712085 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94109667-0282-4bed-8fc5-1cb934251e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:03.712758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94109667-0282-4bed-8fc5-1cb934251e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:03.714145 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94109667-0282-4bed-8fc5-1cb934251e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:03.716749 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94109667-0282-4bed-8fc5-1cb934251e47 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:03.729507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1399/2836] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:14:03 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:14:03.733789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6c232-1571-4919-8e3a-53b7e667e7b2 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:03.747547 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6c232-1571-4919-8e3a-53b7e667e7b2 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:03.753785 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770ae27-2f75-4db7-9acf-ab4a9d706a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:03.755381 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ae27-2f75-4db7-9acf-ab4a9d706a87 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:03.755738 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ae27-2f75-4db7-9acf-ab4a9d706a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:03.757163 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ae27-2f75-4db7-9acf-ab4a9d706a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:03.757163 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770ae27-2f75-4db7-9acf-ab4a9d706a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:03.761049 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770ae27-2f75-4db7-9acf-ab4a9d706a87 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:03.762117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94109667-0282-4bed-8fc5-1cb934251e47 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:03.764335 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-94109667-0282-4bed-8fc5-1cb934251e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:03.776150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1438/2837] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:14:03 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:14:03.787178 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770ae27-2f75-4db7-9acf-ab4a9d706a87 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:03.800974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770ae27-2f75-4db7-9acf-ab4a9d706a87 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:03.808969 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94109667-0282-4bed-8fc5-1cb934251e47 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:03.812725 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dbd0e-80af-45f6-aa62-0e38005ffa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:03.813836 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dbd0e-80af-45f6-aa62-0e38005ffa52 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:03.814117 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dbd0e-80af-45f6-aa62-0e38005ffa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:03.814578 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dbd0e-80af-45f6-aa62-0e38005ffa52 admin admin] PATH_INFO: `/v3/projects/f67ec01e17cb4a0ea715a23130e3aab7/users/81dc8525d48e41a3b831987d581e03d9/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:03.815116 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f6352-fb1f-4d65-b6f5-ba7fbfe2375e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:03.816014 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f6352-fb1f-4d65-b6f5-ba7fbfe2375e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:03.816283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f6352-fb1f-4d65-b6f5-ba7fbfe2375e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:03.816581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f6352-fb1f-4d65-b6f5-ba7fbfe2375e admin admin] PATH_INFO: `/v3/projects/834c739682ea4ad3b3c46e186f614da0` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:03.818172 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f6352-fb1f-4d65-b6f5-ba7fbfe2375e admin admin] RBAC: Authorizing `identity:delete_project(project_id=834c739682ea4ad3b3c46e186f614da0)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:03.821426 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f6352-fb1f-4d65-b6f5-ba7fbfe2375e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:03.836126 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743dbd0e-80af-45f6-aa62-0e38005ffa52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67ec01e17cb4a0ea715a23130e3aab7, user_id=81dc8525d48e41a3b831987d581e03d9, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:03.839581 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743dbd0e-80af-45f6-aa62-0e38005ffa52 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:03.916215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1439/2838] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:14:03 2022] PUT /identity/v3/projects/f67ec01e17cb4a0ea715a23130e3aab7/users/81dc8525d48e41a3b831987d581e03d9/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:14:03.929066 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8097dd8-cd4e-455f-8ad2-6d73294430d5 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:03.929381 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8097dd8-cd4e-455f-8ad2-6d73294430d5 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:03.929923 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8097dd8-cd4e-455f-8ad2-6d73294430d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:03.964819 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-dc0f6352-fb1f-4d65-b6f5-ba7fbfe2375e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '834c739682ea4ad3b3c46e186f614da0', 'request_id': 'req-dc0f6352-fb1f-4d65-b6f5-ba7fbfe2375e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:03.969453 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-e8097dd8-cd4e-455f-8ad2-6d73294430d5 None None] MFA Rules not processed for user `81dc8525d48e41a3b831987d581e03d9`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:03.970750 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e8097dd8-cd4e-455f-8ad2-6d73294430d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:04.024553 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:04.029109 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-dc0f6352-fb1f-4d65-b6f5-ba7fbfe2375e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '834c739682ea4ad3b3c46e186f614da0', 'request_id': 'req-dc0f6352-fb1f-4d65-b6f5-ba7fbfe2375e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:04.038241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-dc0f6352-fb1f-4d65-b6f5-ba7fbfe2375e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '834c739682ea4ad3b3c46e186f614da0', 'request_id': 'req-dc0f6352-fb1f-4d65-b6f5-ba7fbfe2375e'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:04.044283 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1440/2839] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:14:04.048787 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8097dd8-cd4e-455f-8ad2-6d73294430d5 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:04.053742 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-dc0f6352-fb1f-4d65-b6f5-ba7fbfe2375e admin admin] The token cache is being invalidate because project 834c739682ea4ad3b3c46e186f614da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:14:04.054761 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-dc0f6352-fb1f-4d65-b6f5-ba7fbfe2375e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:04.056404 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-dc0f6352-fb1f-4d65-b6f5-ba7fbfe2375e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:04.058134 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1400/2840] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:14:03 2022] DELETE /identity/v3/projects/834c739682ea4ad3b3c46e186f614da0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:14:04.071519 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26450dfa-0ddc-45b5-81b0-0976bfb4c570 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:04.071820 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26450dfa-0ddc-45b5-81b0-0976bfb4c570 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:04.072108 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26450dfa-0ddc-45b5-81b0-0976bfb4c570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:04.094539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-26450dfa-0ddc-45b5-81b0-0976bfb4c570 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:04.095836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-26450dfa-0ddc-45b5-81b0-0976bfb4c570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:04.124594 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8097dd8-cd4e-455f-8ad2-6d73294430d5 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:04.131335 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b4057-406b-4a98-8531-898faf4f23a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:04.133142 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b4057-406b-4a98-8531-898faf4f23a9 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:04.133432 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b4057-406b-4a98-8531-898faf4f23a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:04.133710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b4057-406b-4a98-8531-898faf4f23a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:04.134467 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b4057-406b-4a98-8531-898faf4f23a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:04.138352 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b4057-406b-4a98-8531-898faf4f23a9 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:04.164416 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:04.172843 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1401/2841] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:14:04.181175 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a7127-2e52-4cec-9447-cfcdf6bc5f15 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:04.181465 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a7127-2e52-4cec-9447-cfcdf6bc5f15 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:04.181747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a7127-2e52-4cec-9447-cfcdf6bc5f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:04.202720 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-647a7127-2e52-4cec-9447-cfcdf6bc5f15 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:04.203941 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-647a7127-2e52-4cec-9447-cfcdf6bc5f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:04.218174 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1402/2842] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:14:04.222282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a7127-2e52-4cec-9447-cfcdf6bc5f15 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:04.231869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a7127-2e52-4cec-9447-cfcdf6bc5f15 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:04.236581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8f74c-5fb6-44d5-b66b-df4506123f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:04.237251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8f74c-5fb6-44d5-b66b-df4506123f6e admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:04.237541 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8f74c-5fb6-44d5-b66b-df4506123f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:04.237827 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8f74c-5fb6-44d5-b66b-df4506123f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:04.238610 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8f74c-5fb6-44d5-b66b-df4506123f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:14:04.239511 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8f74c-5fb6-44d5-b66b-df4506123f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:04.241130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8f74c-5fb6-44d5-b66b-df4506123f6e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:04.246599 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1441/2843] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:14:04 2022] POST /identity/v3/projects => generated 366 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:14:04.251251 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b4057-406b-4a98-8531-898faf4f23a9 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:04.253486 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-4e1b4057-406b-4a98-8531-898faf4f23a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:04.262703 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1403/2844] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:14:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:14:04.264830 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8f74c-5fb6-44d5-b66b-df4506123f6e admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:04.275601 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8f74c-5fb6-44d5-b66b-df4506123f6e admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:04.336269 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b4057-406b-4a98-8531-898faf4f23a9 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:04.341652 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574f558-64d8-455d-aedf-2a848cd869ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:04.342567 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574f558-64d8-455d-aedf-2a848cd869ce admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:04.342997 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574f558-64d8-455d-aedf-2a848cd869ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:04.343090 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574f558-64d8-455d-aedf-2a848cd869ce admin admin] PATH_INFO: `/v3/users` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:04.343540 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c12f3-786b-4fbb-8619-d63e0e7bc7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:04.343773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574f558-64d8-455d-aedf-2a848cd869ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:04.344192 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c12f3-786b-4fbb-8619-d63e0e7bc7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:04.344467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c12f3-786b-4fbb-8619-d63e0e7bc7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:04.344884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c12f3-786b-4fbb-8619-d63e0e7bc7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:04.345581 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c12f3-786b-4fbb-8619-d63e0e7bc7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:04.345699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574f558-64d8-455d-aedf-2a848cd869ce admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:04.347547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c12f3-786b-4fbb-8619-d63e0e7bc7d3 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:04.440906 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1442/2845] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:14:04 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:14:04.445436 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574f558-64d8-455d-aedf-2a848cd869ce admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:04.455646 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1404/2846] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:14:04 2022] POST /identity/v3/projects => generated 370 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:14:04.456303 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574f558-64d8-455d-aedf-2a848cd869ce admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:04.461068 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c12f3-786b-4fbb-8619-d63e0e7bc7d3 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:04.533291 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f511ad1-a601-46fd-abec-6b53a0d9d1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:04.534002 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f511ad1-a601-46fd-abec-6b53a0d9d1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:04.534421 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c12f3-786b-4fbb-8619-d63e0e7bc7d3 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:04.534872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f511ad1-a601-46fd-abec-6b53a0d9d1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:04.534872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f511ad1-a601-46fd-abec-6b53a0d9d1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:04.535476 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f511ad1-a601-46fd-abec-6b53a0d9d1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:04.537998 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f511ad1-a601-46fd-abec-6b53a0d9d1b2 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:04.541083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d099ba2-8e7a-44dd-8641-673d77d07a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:04.541759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d099ba2-8e7a-44dd-8641-673d77d07a1e admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:04.552752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d099ba2-8e7a-44dd-8641-673d77d07a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:04.552752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d099ba2-8e7a-44dd-8641-673d77d07a1e admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:04.552752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d099ba2-8e7a-44dd-8641-673d77d07a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:04.552752 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d099ba2-8e7a-44dd-8641-673d77d07a1e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:04.553227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:04.553227 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1443/2847] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:14:04 2022] GET /identity/v3/roles => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:14:04.555084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f511ad1-a601-46fd-abec-6b53a0d9d1b2 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:04.565090 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f511ad1-a601-46fd-abec-6b53a0d9d1b2 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:04.569790 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c985be-2798-4157-9b5d-1e7ca159f8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:04.570733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c985be-2798-4157-9b5d-1e7ca159f8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:04.570992 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c985be-2798-4157-9b5d-1e7ca159f8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:04.575664 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c985be-2798-4157-9b5d-1e7ca159f8cf admin admin] PATH_INFO: `/v3/projects/6a17ceb4336340ff9c75b06e62ee8069/users/ce265f965d2747bb990cea7b555fa365/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:04.586269 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c985be-2798-4157-9b5d-1e7ca159f8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a17ceb4336340ff9c75b06e62ee8069, user_id=ce265f965d2747bb990cea7b555fa365, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:04.588999 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c985be-2798-4157-9b5d-1e7ca159f8cf admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:04.682255 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1444/2848] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:14:04 2022] PUT /identity/v3/projects/6a17ceb4336340ff9c75b06e62ee8069/users/ce265f965d2747bb990cea7b555fa365/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:14:04.686689 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1405/2849] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:14:04 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:14:04.686863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c985be-2798-4157-9b5d-1e7ca159f8cf admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:04.687986 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d099ba2-8e7a-44dd-8641-673d77d07a1e admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:04.698870 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d099ba2-8e7a-44dd-8641-673d77d07a1e admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:04.749231 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c985be-2798-4157-9b5d-1e7ca159f8cf admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:04.753052 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:04.754506 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd400e-4570-4861-80b9-659ba8dfe835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:04.755206 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd400e-4570-4861-80b9-659ba8dfe835 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:04.755640 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd400e-4570-4861-80b9-659ba8dfe835 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:04.755926 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd400e-4570-4861-80b9-659ba8dfe835 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:04.756636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd400e-4570-4861-80b9-659ba8dfe835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:04.758280 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd400e-4570-4861-80b9-659ba8dfe835 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:04.761673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06595e11-fa69-439e-90dc-a58150b5a648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:04.762493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06595e11-fa69-439e-90dc-a58150b5a648 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:04.762874 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06595e11-fa69-439e-90dc-a58150b5a648 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:04.763120 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06595e11-fa69-439e-90dc-a58150b5a648 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:04.763882 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06595e11-fa69-439e-90dc-a58150b5a648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:04.765707 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06595e11-fa69-439e-90dc-a58150b5a648 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:04.769138 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1445/2850] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:14:04 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:14:04.779562 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd400e-4570-4861-80b9-659ba8dfe835 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:04.784798 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1406/2851] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:14:04 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:14:04.786400 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06595e11-fa69-439e-90dc-a58150b5a648 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:04.793208 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd400e-4570-4861-80b9-659ba8dfe835 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:04.797142 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06595e11-fa69-439e-90dc-a58150b5a648 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:04.798418 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370f9f7-59ec-45f8-a7e4-1e8cc514b705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:04.799506 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370f9f7-59ec-45f8-a7e4-1e8cc514b705 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:04.799737 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370f9f7-59ec-45f8-a7e4-1e8cc514b705 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:04.800018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370f9f7-59ec-45f8-a7e4-1e8cc514b705 admin admin] PATH_INFO: `/v3/projects/6a17ceb4336340ff9c75b06e62ee8069/users/ce265f965d2747bb990cea7b555fa365/roles/232cb450030f4f48943ecfcb88dcd7d2` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:04.802018 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be024df0-fbda-4d4f-9ce6-1527ad01f632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:04.802719 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370f9f7-59ec-45f8-a7e4-1e8cc514b705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a17ceb4336340ff9c75b06e62ee8069, user_id=ce265f965d2747bb990cea7b555fa365, role_id=232cb450030f4f48943ecfcb88dcd7d2)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:04.802832 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be024df0-fbda-4d4f-9ce6-1527ad01f632 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:04.803066 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be024df0-fbda-4d4f-9ce6-1527ad01f632 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:04.803352 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be024df0-fbda-4d4f-9ce6-1527ad01f632 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:04.804157 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be024df0-fbda-4d4f-9ce6-1527ad01f632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:04.805699 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370f9f7-59ec-45f8-a7e4-1e8cc514b705 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:04.805835 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be024df0-fbda-4d4f-9ce6-1527ad01f632 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:04.817106 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1407/2852] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:14:04 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:14:04.818712 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1446/2853] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:14:04 2022] PUT /identity/v3/projects/6a17ceb4336340ff9c75b06e62ee8069/users/ce265f965d2747bb990cea7b555fa365/roles/232cb450030f4f48943ecfcb88dcd7d2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:14:04.821085 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be024df0-fbda-4d4f-9ce6-1527ad01f632 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:04.829506 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bec68-9fb5-481e-aedb-077919220203 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:04.829797 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bec68-9fb5-481e-aedb-077919220203 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:04.830075 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bec68-9fb5-481e-aedb-077919220203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:04.831431 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be024df0-fbda-4d4f-9ce6-1527ad01f632 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:04.861063 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-093bec68-9fb5-481e-aedb-077919220203 None None] MFA Rules not processed for user `ce265f965d2747bb990cea7b555fa365`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:04.862433 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-093bec68-9fb5-481e-aedb-077919220203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:04.893615 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53f8db-11fd-4d7f-b80d-63dd9c8e3bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:04.895037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53f8db-11fd-4d7f-b80d-63dd9c8e3bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:04.895037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53f8db-11fd-4d7f-b80d-63dd9c8e3bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:04.895884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53f8db-11fd-4d7f-b80d-63dd9c8e3bf0 admin admin] PATH_INFO: `/v3/projects/5ccafd174969473e84d5767dcd7ba93c/users/c1ad5ff12e1d43f49275f5b8f1fc5293/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:04.911343 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53f8db-11fd-4d7f-b80d-63dd9c8e3bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccafd174969473e84d5767dcd7ba93c, user_id=c1ad5ff12e1d43f49275f5b8f1fc5293, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:04.914260 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53f8db-11fd-4d7f-b80d-63dd9c8e3bf0 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:04.933457 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1447/2854] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:14:04.944834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bec68-9fb5-481e-aedb-077919220203 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:04.946190 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-093bec68-9fb5-481e-aedb-077919220203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:04.993579 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:05.004223 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bec68-9fb5-481e-aedb-077919220203 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:05.008374 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7757d-32af-447c-9d5e-f84b94ce2dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:05.009025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7757d-32af-447c-9d5e-f84b94ce2dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:05.009407 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7757d-32af-447c-9d5e-f84b94ce2dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:05.009691 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7757d-32af-447c-9d5e-f84b94ce2dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:05.018872 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7757d-32af-447c-9d5e-f84b94ce2dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:05.021389 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7757d-32af-447c-9d5e-f84b94ce2dc5 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:05.030959 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1448/2855] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:14:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:14:05.060618 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1408/2856] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:14:04 2022] PUT /identity/v3/projects/5ccafd174969473e84d5767dcd7ba93c/users/c1ad5ff12e1d43f49275f5b8f1fc5293/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:14:05.072447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd0d80-4120-438c-8bca-20ac547a410a None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:05.072736 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd0d80-4120-438c-8bca-20ac547a410a None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:05.073018 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd0d80-4120-438c-8bca-20ac547a410a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:05.103814 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-c0bd0d80-4120-438c-8bca-20ac547a410a None None] MFA Rules not processed for user `c1ad5ff12e1d43f49275f5b8f1fc5293`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:05.105019 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c0bd0d80-4120-438c-8bca-20ac547a410a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:05.168645 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1449/2857] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:14:05.181530 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53f8db-11fd-4d7f-b80d-63dd9c8e3bf0 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:05.182473 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5e53f8db-11fd-4d7f-b80d-63dd9c8e3bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:05.268354 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53f8db-11fd-4d7f-b80d-63dd9c8e3bf0 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:05.272985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90115ab-e549-47a4-819a-f404b3b63772 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf32c811ead4fd0b69c83890a56509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:05.273644 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90115ab-e549-47a4-819a-f404b3b63772 service glance] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:05.273933 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90115ab-e549-47a4-819a-f404b3b63772 service glance] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:05.274224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90115ab-e549-47a4-819a-f404b3b63772 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:05.286659 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90115ab-e549-47a4-819a-f404b3b63772 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:05.288147 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90115ab-e549-47a4-819a-f404b3b63772 service glance] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:05.300041 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1409/2858] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:14:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:14:05.314276 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd0d80-4120-438c-8bca-20ac547a410a None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:05.375461 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd0d80-4120-438c-8bca-20ac547a410a None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:05.384355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3fd51-1610-46c7-89b7-b69a4177bc35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:05.384355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3fd51-1610-46c7-89b7-b69a4177bc35 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:05.384355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3fd51-1610-46c7-89b7-b69a4177bc35 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:05.384355 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3fd51-1610-46c7-89b7-b69a4177bc35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:05.384747 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-4bb3fd51-1610-46c7-89b7-b69a4177bc35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:05.445525 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3fd51-1610-46c7-89b7-b69a4177bc35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:05.447165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3fd51-1610-46c7-89b7-b69a4177bc35 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:05.459035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1450/2859] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:14:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:14:08.525836 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90115ab-e549-47a4-819a-f404b3b63772 service glance] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:08.527339 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-c90115ab-e549-47a4-819a-f404b3b63772 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:08.580009 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:08.596467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90115ab-e549-47a4-819a-f404b3b63772 service glance] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:08.601083 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4d963-52a8-47c1-8845-e263c67947b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:08.601962 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4d963-52a8-47c1-8845-e263c67947b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:08.602247 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4d963-52a8-47c1-8845-e263c67947b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:08.602557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4d963-52a8-47c1-8845-e263c67947b2 admin admin] PATH_INFO: `/v3/users/f821af93f8a441b5ab018b9d5f3c712a` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:08.603744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4d963-52a8-47c1-8845-e263c67947b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f821af93f8a441b5ab018b9d5f3c712a)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:08.605670 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4d963-52a8-47c1-8845-e263c67947b2 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:08.779725 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b4d4d963-52a8-47c1-8845-e263c67947b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f821af93f8a441b5ab018b9d5f3c712a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:08.780313 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b4d4d963-52a8-47c1-8845-e263c67947b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f821af93f8a441b5ab018b9d5f3c712a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:08.780892 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b4d4d963-52a8-47c1-8845-e263c67947b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f821af93f8a441b5ab018b9d5f3c712a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:08.843291 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b4d4d963-52a8-47c1-8845-e263c67947b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f821af93f8a441b5ab018b9d5f3c712a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:08.857376 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-b4d4d963-52a8-47c1-8845-e263c67947b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f821af93f8a441b5ab018b9d5f3c712a'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:08.870486 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1410/2860] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:14:08 2022] DELETE /identity/v3/users/f821af93f8a441b5ab018b9d5f3c712a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:14:08.875200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a638fd-a85d-4e72-a114-a56da7a466ee None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:08.875682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a638fd-a85d-4e72-a114-a56da7a466ee None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:08.875811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a638fd-a85d-4e72-a114-a56da7a466ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:08.892702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-06a638fd-a85d-4e72-a114-a56da7a466ee None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:08.893891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-06a638fd-a85d-4e72-a114-a56da7a466ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:08.920038 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=100 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:08.958778 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1451/2861] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:14:08.968902 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4d963-52a8-47c1-8845-e263c67947b2 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:08.970420 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-b4d4d963-52a8-47c1-8845-e263c67947b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:09.028583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4d963-52a8-47c1-8845-e263c67947b2 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:09.031809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac607a-a5f7-4716-8228-ccf98e2b440a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:09.032606 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac607a-a5f7-4716-8228-ccf98e2b440a service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:09.032893 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac607a-a5f7-4716-8228-ccf98e2b440a service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:09.033184 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac607a-a5f7-4716-8228-ccf98e2b440a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:09.046421 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac607a-a5f7-4716-8228-ccf98e2b440a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:09.047936 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac607a-a5f7-4716-8228-ccf98e2b440a service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:09.059191 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1411/2862] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:14:09.175177 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a638fd-a85d-4e72-a114-a56da7a466ee None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:09.176655 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-06a638fd-a85d-4e72-a114-a56da7a466ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:09.191721 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a638fd-a85d-4e72-a114-a56da7a466ee None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:09.197134 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c501a-eeec-4c0a-9428-53c209606d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:09.198084 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c501a-eeec-4c0a-9428-53c209606d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:09.198391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c501a-eeec-4c0a-9428-53c209606d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:09.198673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c501a-eeec-4c0a-9428-53c209606d26 admin admin] PATH_INFO: `/v3/users/81dc8525d48e41a3b831987d581e03d9` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:09.199950 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c501a-eeec-4c0a-9428-53c209606d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81dc8525d48e41a3b831987d581e03d9)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:09.201964 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c501a-eeec-4c0a-9428-53c209606d26 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:09.457652 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-b81c501a-eeec-4c0a-9428-53c209606d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81dc8525d48e41a3b831987d581e03d9'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:09.458611 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-b81c501a-eeec-4c0a-9428-53c209606d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81dc8525d48e41a3b831987d581e03d9'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:09.472690 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-b81c501a-eeec-4c0a-9428-53c209606d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81dc8525d48e41a3b831987d581e03d9'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:09.572336 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-b81c501a-eeec-4c0a-9428-53c209606d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81dc8525d48e41a3b831987d581e03d9'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:09.580032 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-b81c501a-eeec-4c0a-9428-53c209606d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81dc8525d48e41a3b831987d581e03d9'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:09.587347 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1452/2863] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:14:09 2022] DELETE /identity/v3/users/81dc8525d48e41a3b831987d581e03d9 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:14:09.591982 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c5d35-e99e-443b-8ada-cffb936eb248 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:09.592514 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c5d35-e99e-443b-8ada-cffb936eb248 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:09.592641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c5d35-e99e-443b-8ada-cffb936eb248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:09.610095 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-9b6c5d35-e99e-443b-8ada-cffb936eb248 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:09.611119 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9b6c5d35-e99e-443b-8ada-cffb936eb248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:09.676058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1412/2864] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:14:09.686136 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c501a-eeec-4c0a-9428-53c209606d26 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:09.687713 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-b81c501a-eeec-4c0a-9428-53c209606d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:09.746577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c501a-eeec-4c0a-9428-53c209606d26 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:09.750804 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f3520-5a8c-4405-b825-9344735a5575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:09.751572 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f3520-5a8c-4405-b825-9344735a5575 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:09.751954 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f3520-5a8c-4405-b825-9344735a5575 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:09.752236 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f3520-5a8c-4405-b825-9344735a5575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:09.764548 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f3520-5a8c-4405-b825-9344735a5575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:09.766205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f3520-5a8c-4405-b825-9344735a5575 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:09.777415 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1453/2865] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:14:09.811038 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c5d35-e99e-443b-8ada-cffb936eb248 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:09.812714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-9b6c5d35-e99e-443b-8ada-cffb936eb248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:09.825863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c5d35-e99e-443b-8ada-cffb936eb248 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:09.830985 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c689de9-5e19-40ea-a20f-81c709b17657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:09.831877 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c689de9-5e19-40ea-a20f-81c709b17657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:09.832167 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c689de9-5e19-40ea-a20f-81c709b17657 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:09.832450 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c689de9-5e19-40ea-a20f-81c709b17657 admin admin] PATH_INFO: `/v3/projects/b86fc104b6ff4c76b993dc837abc46c9` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:09.833944 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c689de9-5e19-40ea-a20f-81c709b17657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b86fc104b6ff4c76b993dc837abc46c9)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:09.836758 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c689de9-5e19-40ea-a20f-81c709b17657 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:09.843792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:10.024490 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3c689de9-5e19-40ea-a20f-81c709b17657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86fc104b6ff4c76b993dc837abc46c9', 'request_id': 'req-3c689de9-5e19-40ea-a20f-81c709b17657'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:10.122984 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3c689de9-5e19-40ea-a20f-81c709b17657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86fc104b6ff4c76b993dc837abc46c9', 'request_id': 'req-3c689de9-5e19-40ea-a20f-81c709b17657'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:10.130392 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3c689de9-5e19-40ea-a20f-81c709b17657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86fc104b6ff4c76b993dc837abc46c9', 'request_id': 'req-3c689de9-5e19-40ea-a20f-81c709b17657'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:10.146572 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3c689de9-5e19-40ea-a20f-81c709b17657 admin admin] The token cache is being invalidate because project b86fc104b6ff4c76b993dc837abc46c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87034) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:14:10.150926 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3c689de9-5e19-40ea-a20f-81c709b17657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:10.150926 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-3c689de9-5e19-40ea-a20f-81c709b17657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:10.150926 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1413/2866] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:14:09 2022] DELETE /identity/v3/projects/b86fc104b6ff4c76b993dc837abc46c9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:14:10.275200 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f3520-5a8c-4405-b825-9344735a5575 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:10.276768 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-519f3520-5a8c-4405-b825-9344735a5575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:10.291242 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f3520-5a8c-4405-b825-9344735a5575 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:10.357815 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:10.374454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e7869-a57c-4704-99a8-17e956a51771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:10.374454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e7869-a57c-4704-99a8-17e956a51771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:10.374454 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e7869-a57c-4704-99a8-17e956a51771 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:10.374874 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e7869-a57c-4704-99a8-17e956a51771 admin admin] PATH_INFO: `/v3/projects/f67ec01e17cb4a0ea715a23130e3aab7` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:10.376025 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e7869-a57c-4704-99a8-17e956a51771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f67ec01e17cb4a0ea715a23130e3aab7)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:10.378111 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e7869-a57c-4704-99a8-17e956a51771 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:10.501286 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3d2e7869-a57c-4704-99a8-17e956a51771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f67ec01e17cb4a0ea715a23130e3aab7', 'request_id': 'req-3d2e7869-a57c-4704-99a8-17e956a51771'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:10.612046 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3d2e7869-a57c-4704-99a8-17e956a51771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f67ec01e17cb4a0ea715a23130e3aab7', 'request_id': 'req-3d2e7869-a57c-4704-99a8-17e956a51771'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:10.619676 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3d2e7869-a57c-4704-99a8-17e956a51771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f67ec01e17cb4a0ea715a23130e3aab7', 'request_id': 'req-3d2e7869-a57c-4704-99a8-17e956a51771'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:10.631082 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3d2e7869-a57c-4704-99a8-17e956a51771 admin admin] The token cache is being invalidate because project f67ec01e17cb4a0ea715a23130e3aab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:14:10.631304 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3d2e7869-a57c-4704-99a8-17e956a51771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:10.632308 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3d2e7869-a57c-4704-99a8-17e956a51771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:10.633960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1454/2867] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:14:10 2022] DELETE /identity/v3/projects/f67ec01e17cb4a0ea715a23130e3aab7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:14:10.638096 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c689de9-5e19-40ea-a20f-81c709b17657 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:10.639580 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-3c689de9-5e19-40ea-a20f-81c709b17657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:10.655966 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c689de9-5e19-40ea-a20f-81c709b17657 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:10.715062 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f8d0b-faeb-4f8b-893e-3f6e2bfdff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:10.715978 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f8d0b-faeb-4f8b-893e-3f6e2bfdff9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:10.716265 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f8d0b-faeb-4f8b-893e-3f6e2bfdff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:10.716544 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f8d0b-faeb-4f8b-893e-3f6e2bfdff9a admin admin] PATH_INFO: `/v3/users/ce265f965d2747bb990cea7b555fa365` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:10.717723 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f8d0b-faeb-4f8b-893e-3f6e2bfdff9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce265f965d2747bb990cea7b555fa365)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:10.719677 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f8d0b-faeb-4f8b-893e-3f6e2bfdff9a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:10.915004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-cf9f8d0b-faeb-4f8b-893e-3f6e2bfdff9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce265f965d2747bb990cea7b555fa365'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:10.915672 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-cf9f8d0b-faeb-4f8b-893e-3f6e2bfdff9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce265f965d2747bb990cea7b555fa365'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:10.916280 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-cf9f8d0b-faeb-4f8b-893e-3f6e2bfdff9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce265f965d2747bb990cea7b555fa365'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:11.002958 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-cf9f8d0b-faeb-4f8b-893e-3f6e2bfdff9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce265f965d2747bb990cea7b555fa365'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:11.015880 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-cf9f8d0b-faeb-4f8b-893e-3f6e2bfdff9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce265f965d2747bb990cea7b555fa365'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:11.028193 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1414/2868] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:14:10 2022] DELETE /identity/v3/users/ce265f965d2747bb990cea7b555fa365 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:14:11.501441 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e7869-a57c-4704-99a8-17e956a51771 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:11.502911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-3d2e7869-a57c-4704-99a8-17e956a51771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:11.516734 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e7869-a57c-4704-99a8-17e956a51771 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:11.578540 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8918a6d-9314-49a3-9ae4-6b8f66fbd8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:11.579409 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8918a6d-9314-49a3-9ae4-6b8f66fbd8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:11.579695 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8918a6d-9314-49a3-9ae4-6b8f66fbd8af admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:11.579975 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8918a6d-9314-49a3-9ae4-6b8f66fbd8af admin admin] PATH_INFO: `/v3/projects/6a17ceb4336340ff9c75b06e62ee8069` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:11.581164 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8918a6d-9314-49a3-9ae4-6b8f66fbd8af admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a17ceb4336340ff9c75b06e62ee8069)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:11.583387 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8918a6d-9314-49a3-9ae4-6b8f66fbd8af admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:11.695960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-c8918a6d-9314-49a3-9ae4-6b8f66fbd8af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a17ceb4336340ff9c75b06e62ee8069', 'request_id': 'req-c8918a6d-9314-49a3-9ae4-6b8f66fbd8af'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:11.795028 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-c8918a6d-9314-49a3-9ae4-6b8f66fbd8af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a17ceb4336340ff9c75b06e62ee8069', 'request_id': 'req-c8918a6d-9314-49a3-9ae4-6b8f66fbd8af'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:11.802045 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-c8918a6d-9314-49a3-9ae4-6b8f66fbd8af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a17ceb4336340ff9c75b06e62ee8069', 'request_id': 'req-c8918a6d-9314-49a3-9ae4-6b8f66fbd8af'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:11.813029 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-c8918a6d-9314-49a3-9ae4-6b8f66fbd8af admin admin] The token cache is being invalidate because project 6a17ceb4336340ff9c75b06e62ee8069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:14:11.813305 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-c8918a6d-9314-49a3-9ae4-6b8f66fbd8af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:11.813941 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-c8918a6d-9314-49a3-9ae4-6b8f66fbd8af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:14:11.815582 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1455/2869] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:14:11 2022] DELETE /identity/v3/projects/6a17ceb4336340ff9c75b06e62ee8069 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:14:11.823166 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6558750-6606-4e6a-947c-b82badc1f6b9 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:11.823675 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6558750-6606-4e6a-947c-b82badc1f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:11.823791 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6558750-6606-4e6a-947c-b82badc1f6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:11.841890 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-a6558750-6606-4e6a-947c-b82badc1f6b9 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:11.843117 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a6558750-6606-4e6a-947c-b82badc1f6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:11.848279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:11.903374 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1415/2870] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:14:11.911496 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f0297-c03b-4094-b8aa-962d4b29d4cd None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:11.911783 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f0297-c03b-4094-b8aa-962d4b29d4cd None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:11.912059 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f0297-c03b-4094-b8aa-962d4b29d4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:11.924733 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:11.931414 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-911f0297-c03b-4094-b8aa-962d4b29d4cd None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:11.932661 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-911f0297-c03b-4094-b8aa-962d4b29d4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:11.940489 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1456/2871] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:14:11.945295 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6558750-6606-4e6a-947c-b82badc1f6b9 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:11.955346 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6558750-6606-4e6a-947c-b82badc1f6b9 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:11.960402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e516d-1182-4494-ae59-13183b51df90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:11.961058 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e516d-1182-4494-ae59-13183b51df90 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:11.961356 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e516d-1182-4494-ae59-13183b51df90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:11.961641 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e516d-1182-4494-ae59-13183b51df90 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:11.962437 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e516d-1182-4494-ae59-13183b51df90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:14:11.962755 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e516d-1182-4494-ae59-13183b51df90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:11.964383 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e516d-1182-4494-ae59-13183b51df90 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:11.976259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1416/2872] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:14:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:14:11.980618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f0297-c03b-4094-b8aa-962d4b29d4cd None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:11.990452 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f0297-c03b-4094-b8aa-962d4b29d4cd None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:11.996330 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18ac08-ef88-4f2d-aa8a-3b7b6d7a2b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:11.997009 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18ac08-ef88-4f2d-aa8a-3b7b6d7a2b05 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:11.997296 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18ac08-ef88-4f2d-aa8a-3b7b6d7a2b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:11.997577 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18ac08-ef88-4f2d-aa8a-3b7b6d7a2b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:11.998273 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18ac08-ef88-4f2d-aa8a-3b7b6d7a2b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:12.000240 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18ac08-ef88-4f2d-aa8a-3b7b6d7a2b05 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:12.096001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1457/2873] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:14:11 2022] POST /identity/v3/projects => generated 384 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:14:12.100248 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e516d-1182-4494-ae59-13183b51df90 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:12.111547 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e516d-1182-4494-ae59-13183b51df90 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:12.173289 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8043ab6-1a1f-4970-802f-54a4c4ed4cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:12.173970 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8043ab6-1a1f-4970-802f-54a4c4ed4cba admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:12.174262 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8043ab6-1a1f-4970-802f-54a4c4ed4cba admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:12.174579 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8043ab6-1a1f-4970-802f-54a4c4ed4cba admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:12.175284 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8043ab6-1a1f-4970-802f-54a4c4ed4cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:12.177259 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8043ab6-1a1f-4970-802f-54a4c4ed4cba admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:12.296269 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1417/2874] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:14:12 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:14:12.300224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18ac08-ef88-4f2d-aa8a-3b7b6d7a2b05 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:12.311128 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18ac08-ef88-4f2d-aa8a-3b7b6d7a2b05 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:12.315770 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440a642-371f-4177-bca9-5a7fa884e68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:12.316434 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440a642-371f-4177-bca9-5a7fa884e68d admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:12.316723 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440a642-371f-4177-bca9-5a7fa884e68d admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:12.317007 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440a642-371f-4177-bca9-5a7fa884e68d admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:12.317763 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440a642-371f-4177-bca9-5a7fa884e68d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:12.319918 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440a642-371f-4177-bca9-5a7fa884e68d admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:12.336401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1458/2875] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:14:12 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:14:12.340569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8043ab6-1a1f-4970-802f-54a4c4ed4cba admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:12.351214 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8043ab6-1a1f-4970-802f-54a4c4ed4cba admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:12.357153 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d51b51-2edd-481f-95bd-47aa6a0b502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:12.358070 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d51b51-2edd-481f-95bd-47aa6a0b502c admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:12.358583 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d51b51-2edd-481f-95bd-47aa6a0b502c admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:12.358925 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d51b51-2edd-481f-95bd-47aa6a0b502c admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:12.359805 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d51b51-2edd-481f-95bd-47aa6a0b502c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:12.361731 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d51b51-2edd-481f-95bd-47aa6a0b502c admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:12.375759 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1418/2876] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:14:12 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:14:12.383327 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440a642-371f-4177-bca9-5a7fa884e68d admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:12.393391 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440a642-371f-4177-bca9-5a7fa884e68d admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:12.398035 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e30510-7454-4f2c-a5fa-d655a49f20dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:12.399612 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e30510-7454-4f2c-a5fa-d655a49f20dd admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:12.399891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e30510-7454-4f2c-a5fa-d655a49f20dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:12.400161 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e30510-7454-4f2c-a5fa-d655a49f20dd admin admin] PATH_INFO: `/v3/projects/b3bbc230c5914635ba995b16e43059f7/users/80fa321f3ac1448681e4191ff04b47a2/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:12.414455 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e30510-7454-4f2c-a5fa-d655a49f20dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3bbc230c5914635ba995b16e43059f7, user_id=80fa321f3ac1448681e4191ff04b47a2, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:12.440307 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e30510-7454-4f2c-a5fa-d655a49f20dd admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:12.567008 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1459/2877] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:14:12 2022] PUT /identity/v3/projects/b3bbc230c5914635ba995b16e43059f7/users/80fa321f3ac1448681e4191ff04b47a2/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:14:12.573225 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe4ee8-3750-43d6-b13a-c289ac09844f None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:12.573521 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe4ee8-3750-43d6-b13a-c289ac09844f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:12.573807 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe4ee8-3750-43d6-b13a-c289ac09844f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:12.593741 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-f1fe4ee8-3750-43d6-b13a-c289ac09844f None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:12.594460 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-f1fe4ee8-3750-43d6-b13a-c289ac09844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:12.658025 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1419/2878] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:14:12.667703 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e30510-7454-4f2c-a5fa-d655a49f20dd admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:12.669410 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-27e30510-7454-4f2c-a5fa-d655a49f20dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:12.727317 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e30510-7454-4f2c-a5fa-d655a49f20dd admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:12.731143 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7a863-6c59-4fe1-8ffe-b42e31afc784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:12.731809 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7a863-6c59-4fe1-8ffe-b42e31afc784 service neutron] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:12.732095 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7a863-6c59-4fe1-8ffe-b42e31afc784 service neutron] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:12.732378 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7a863-6c59-4fe1-8ffe-b42e31afc784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:12.742955 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7a863-6c59-4fe1-8ffe-b42e31afc784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:12.744401 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7a863-6c59-4fe1-8ffe-b42e31afc784 service neutron] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:12.753882 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1460/2879] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:14:14.073097 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61733677-e922-4fc3-afd7-c2fbcc783a4b None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:14.073621 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61733677-e922-4fc3-afd7-c2fbcc783a4b None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:14.075052 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61733677-e922-4fc3-afd7-c2fbcc783a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:14.102081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-61733677-e922-4fc3-afd7-c2fbcc783a4b None None] MFA Rules not processed for user `80fa321f3ac1448681e4191ff04b47a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:14.103325 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-61733677-e922-4fc3-afd7-c2fbcc783a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:14.108317 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:14.177282 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1420/2880] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:14:14.189538 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7a863-6c59-4fe1-8ffe-b42e31afc784 service neutron] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:14.190993 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-afb7a863-6c59-4fe1-8ffe-b42e31afc784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:14.253464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7a863-6c59-4fe1-8ffe-b42e31afc784 service neutron] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:14.257100 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8eaf93-d868-41f1-a8f5-47a01483eb49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:14.257807 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8eaf93-d868-41f1-a8f5-47a01483eb49 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:14.258091 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8eaf93-d868-41f1-a8f5-47a01483eb49 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:14.258408 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8eaf93-d868-41f1-a8f5-47a01483eb49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:14.266630 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8eaf93-d868-41f1-a8f5-47a01483eb49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:14.268049 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8eaf93-d868-41f1-a8f5-47a01483eb49 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:14.277430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1461/2881] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:14:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:14:17.020037 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dc1ce-203f-487a-be2e-c9b57b404658 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:17.020563 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dc1ce-203f-487a-be2e-c9b57b404658 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:17.020679 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dc1ce-203f-487a-be2e-c9b57b404658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:17.039222 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-807dc1ce-203f-487a-be2e-c9b57b404658 None None] MFA Rules not processed for user `80fa321f3ac1448681e4191ff04b47a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:14:17.040557 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-807dc1ce-203f-487a-be2e-c9b57b404658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:17.047682 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1421/2882] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:14:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:14:18.691432 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8eaf93-d868-41f1-a8f5-47a01483eb49 service cinder] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:18.692921 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ef8eaf93-d868-41f1-a8f5-47a01483eb49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:18.745437 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:18.765826 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8eaf93-d868-41f1-a8f5-47a01483eb49 service cinder] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:18.771040 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd5fcb-4cbd-4573-958b-74852e747451 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:18.771791 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd5fcb-4cbd-4573-958b-74852e747451 service placement] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:18.772091 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd5fcb-4cbd-4573-958b-74852e747451 service placement] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:18.772372 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd5fcb-4cbd-4573-958b-74852e747451 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:18.775001 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c3cd5fcb-4cbd-4573-958b-74852e747451 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:18.787881 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd5fcb-4cbd-4573-958b-74852e747451 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:18.790053 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd5fcb-4cbd-4573-958b-74852e747451 service placement] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:18.801583 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1462/2883] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:14:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:14:25.074569 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dc1ce-203f-487a-be2e-c9b57b404658 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:25.085004 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dc1ce-203f-487a-be2e-c9b57b404658 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:25.089137 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507be2d-f5de-4842-9f71-c39c000f0058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:25.089783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507be2d-f5de-4842-9f71-c39c000f0058 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:25.090069 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507be2d-f5de-4842-9f71-c39c000f0058 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:25.090372 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507be2d-f5de-4842-9f71-c39c000f0058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:25.092539 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5507be2d-f5de-4842-9f71-c39c000f0058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:25.104118 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507be2d-f5de-4842-9f71-c39c000f0058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:25.105601 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507be2d-f5de-4842-9f71-c39c000f0058 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:25.114387 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1422/2884] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:14:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:14:28.817241 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=10 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:34.287046 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd5fcb-4cbd-4573-958b-74852e747451 service placement] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:14:34.288547 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-c3cd5fcb-4cbd-4573-958b-74852e747451 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:34.364078 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd5fcb-4cbd-4573-958b-74852e747451 service placement] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:14:34.369971 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a104014-307b-4a4b-9fa6-a45d9422866e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:14:34.370673 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a104014-307b-4a4b-9fa6-a45d9422866e service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:14:34.371060 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a104014-307b-4a4b-9fa6-a45d9422866e service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:14:34.371345 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a104014-307b-4a4b-9fa6-a45d9422866e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:14:34.373263 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-1a104014-307b-4a4b-9fa6-a45d9422866e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:14:34.386063 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a104014-307b-4a4b-9fa6-a45d9422866e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:14:34.387694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a104014-307b-4a4b-9fa6-a45d9422866e service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:14:34.398841 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1463/2885] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:14:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:14:35.110415 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=33 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:14:44.394012 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=34 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:15:11.180369 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507be2d-f5de-4842-9f71-c39c000f0058 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:11.181874 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-5507be2d-f5de-4842-9f71-c39c000f0058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:15:11.195747 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507be2d-f5de-4842-9f71-c39c000f0058 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:11.201251 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf765-c7c6-4a68-95c0-918ad035bc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:11.202145 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf765-c7c6-4a68-95c0-918ad035bc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:11.202475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf765-c7c6-4a68-95c0-918ad035bc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:11.202756 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf765-c7c6-4a68-95c0-918ad035bc4e admin admin] PATH_INFO: `/v3/users/c1ad5ff12e1d43f49275f5b8f1fc5293` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:11.204000 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bf765-c7c6-4a68-95c0-918ad035bc4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ad5ff12e1d43f49275f5b8f1fc5293)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:11.205972 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bf765-c7c6-4a68-95c0-918ad035bc4e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:11.419526 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-6d7bf765-c7c6-4a68-95c0-918ad035bc4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ad5ff12e1d43f49275f5b8f1fc5293'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:11.420384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-6d7bf765-c7c6-4a68-95c0-918ad035bc4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ad5ff12e1d43f49275f5b8f1fc5293'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:11.420862 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-6d7bf765-c7c6-4a68-95c0-918ad035bc4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ad5ff12e1d43f49275f5b8f1fc5293'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:11.502433 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-6d7bf765-c7c6-4a68-95c0-918ad035bc4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ad5ff12e1d43f49275f5b8f1fc5293'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:11.515898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-6d7bf765-c7c6-4a68-95c0-918ad035bc4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ad5ff12e1d43f49275f5b8f1fc5293'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:11.528527 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1423/2886] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:15:11 2022] DELETE /identity/v3/users/c1ad5ff12e1d43f49275f5b8f1fc5293 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:15:11.533097 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b82d8e-b3dc-4d98-b6f1-26d474addba4 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:11.533582 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b82d8e-b3dc-4d98-b6f1-26d474addba4 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:11.533702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b82d8e-b3dc-4d98-b6f1-26d474addba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:11.551262 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-40b82d8e-b3dc-4d98-b6f1-26d474addba4 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:15:11.552457 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-40b82d8e-b3dc-4d98-b6f1-26d474addba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:15:11.611684 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1464/2887] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:15:11.621783 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf765-c7c6-4a68-95c0-918ad035bc4e admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:11.623224 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-6d7bf765-c7c6-4a68-95c0-918ad035bc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:15:11.678605 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf765-c7c6-4a68-95c0-918ad035bc4e admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:11.682596 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231c26e-de43-4a61-95b6-36b80d274bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:11.683233 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231c26e-de43-4a61-95b6-36b80d274bdc service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:11.683516 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231c26e-de43-4a61-95b6-36b80d274bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:11.683793 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231c26e-de43-4a61-95b6-36b80d274bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:11.692560 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231c26e-de43-4a61-95b6-36b80d274bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:11.693981 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231c26e-de43-4a61-95b6-36b80d274bdc service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:11.703865 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1424/2888] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:15:12.112863 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b82d8e-b3dc-4d98-b6f1-26d474addba4 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:12.114497 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-40b82d8e-b3dc-4d98-b6f1-26d474addba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:15:12.127559 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b82d8e-b3dc-4d98-b6f1-26d474addba4 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:12.132989 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0403ee-6db9-41d4-8986-86b193a70ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:12.134102 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0403ee-6db9-41d4-8986-86b193a70ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:12.134536 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0403ee-6db9-41d4-8986-86b193a70ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:12.134960 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0403ee-6db9-41d4-8986-86b193a70ce7 admin admin] PATH_INFO: `/v3/projects/5ccafd174969473e84d5767dcd7ba93c` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:12.136237 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0403ee-6db9-41d4-8986-86b193a70ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ccafd174969473e84d5767dcd7ba93c)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:12.138150 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0403ee-6db9-41d4-8986-86b193a70ce7 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:12.255310 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3f0403ee-6db9-41d4-8986-86b193a70ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ccafd174969473e84d5767dcd7ba93c', 'request_id': 'req-3f0403ee-6db9-41d4-8986-86b193a70ce7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:12.334888 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3f0403ee-6db9-41d4-8986-86b193a70ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ccafd174969473e84d5767dcd7ba93c', 'request_id': 'req-3f0403ee-6db9-41d4-8986-86b193a70ce7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:12.342683 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3f0403ee-6db9-41d4-8986-86b193a70ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ccafd174969473e84d5767dcd7ba93c', 'request_id': 'req-3f0403ee-6db9-41d4-8986-86b193a70ce7'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:12.354715 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3f0403ee-6db9-41d4-8986-86b193a70ce7 admin admin] The token cache is being invalidate because project 5ccafd174969473e84d5767dcd7ba93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:15:12.355013 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3f0403ee-6db9-41d4-8986-86b193a70ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:12.355726 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-3f0403ee-6db9-41d4-8986-86b193a70ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:12.357337 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1465/2889] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:15:12 2022] DELETE /identity/v3/projects/5ccafd174969473e84d5767dcd7ba93c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:15:12.362487 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4770-e0ee-45a9-bebc-e862d731f7ce None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:12.363938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4770-e0ee-45a9-bebc-e862d731f7ce None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:12.363938 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4770-e0ee-45a9-bebc-e862d731f7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:12.382414 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-08bc4770-e0ee-45a9-bebc-e862d731f7ce None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:15:12.383625 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-08bc4770-e0ee-45a9-bebc-e862d731f7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:15:12.449694 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1425/2890] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:15:12.457818 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef890fa-7031-43f0-895d-93dc9b66f5d3 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:12.458101 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef890fa-7031-43f0-895d-93dc9b66f5d3 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:12.458447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef890fa-7031-43f0-895d-93dc9b66f5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:12.477891 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-6ef890fa-7031-43f0-895d-93dc9b66f5d3 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:15:12.480271 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-6ef890fa-7031-43f0-895d-93dc9b66f5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:15:12.488399 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1466/2891] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:15:12.492718 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc4770-e0ee-45a9-bebc-e862d731f7ce None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:12.503673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc4770-e0ee-45a9-bebc-e862d731f7ce None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:12.508429 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a53bc-dec6-48c3-b598-7f502616a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:12.509064 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a53bc-dec6-48c3-b598-7f502616a598 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:12.510081 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a53bc-dec6-48c3-b598-7f502616a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:12.510371 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a53bc-dec6-48c3-b598-7f502616a598 admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:12.511129 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a53bc-dec6-48c3-b598-7f502616a598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:15:12.511441 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a53bc-dec6-48c3-b598-7f502616a598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:12.513053 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a53bc-dec6-48c3-b598-7f502616a598 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:12.524744 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1426/2892] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:15:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:15:12.529189 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef890fa-7031-43f0-895d-93dc9b66f5d3 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:12.538447 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef890fa-7031-43f0-895d-93dc9b66f5d3 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:12.543265 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6141b-bf70-44b2-a6f4-05c342bfd8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:12.543919 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6141b-bf70-44b2-a6f4-05c342bfd8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:12.544205 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6141b-bf70-44b2-a6f4-05c342bfd8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:12.544482 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6141b-bf70-44b2-a6f4-05c342bfd8f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:12.545165 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6141b-bf70-44b2-a6f4-05c342bfd8f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:12.547109 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6141b-bf70-44b2-a6f4-05c342bfd8f3 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:12.649354 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1467/2893] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:15:12 2022] POST /identity/v3/projects => generated 398 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:15:12.653510 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a53bc-dec6-48c3-b598-7f502616a598 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:12.658810 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:15:12.663891 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a53bc-dec6-48c3-b598-7f502616a598 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:12.722315 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102fa4f-b460-44d4-8963-796c6cdfcabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:12.723054 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102fa4f-b460-44d4-8963-796c6cdfcabb admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:12.723375 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102fa4f-b460-44d4-8963-796c6cdfcabb admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:12.723665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102fa4f-b460-44d4-8963-796c6cdfcabb admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:12.724372 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102fa4f-b460-44d4-8963-796c6cdfcabb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:12.726384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102fa4f-b460-44d4-8963-796c6cdfcabb admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:12.826288 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1427/2894] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:15:12 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:15:12.830430 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6141b-bf70-44b2-a6f4-05c342bfd8f3 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:12.841952 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6141b-bf70-44b2-a6f4-05c342bfd8f3 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:12.846910 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96d393-7183-49fe-b8b7-e7d0a8f51576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:12.847571 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96d393-7183-49fe-b8b7-e7d0a8f51576 admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:12.847860 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96d393-7183-49fe-b8b7-e7d0a8f51576 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:12.848143 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96d393-7183-49fe-b8b7-e7d0a8f51576 admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:12.848861 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96d393-7183-49fe-b8b7-e7d0a8f51576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:12.850532 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96d393-7183-49fe-b8b7-e7d0a8f51576 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:12.860982 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1468/2895] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:15:12 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:15:12.865072 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102fa4f-b460-44d4-8963-796c6cdfcabb admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:12.875241 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102fa4f-b460-44d4-8963-796c6cdfcabb admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:12.879792 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c087800-a59a-4121-8c5d-946994b41826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:12.880444 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087800-a59a-4121-8c5d-946994b41826 admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:12.880729 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087800-a59a-4121-8c5d-946994b41826 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:12.881005 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087800-a59a-4121-8c5d-946994b41826 admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:12.881713 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c087800-a59a-4121-8c5d-946994b41826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:12.883373 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c087800-a59a-4121-8c5d-946994b41826 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:12.894867 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1428/2896] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:15:12 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:15:12.899067 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96d393-7183-49fe-b8b7-e7d0a8f51576 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:12.909614 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96d393-7183-49fe-b8b7-e7d0a8f51576 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:12.914337 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ff9e5-d4eb-4e46-ad5f-4ec2152c0de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:12.915257 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ff9e5-d4eb-4e46-ad5f-4ec2152c0de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:12.915681 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ff9e5-d4eb-4e46-ad5f-4ec2152c0de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:12.915969 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ff9e5-d4eb-4e46-ad5f-4ec2152c0de1 admin admin] PATH_INFO: `/v3/projects/e1b9830b429a4ea6b68db1abcee66e0f/users/5ef80dd6da624dfb998c863b92466405/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:12.930855 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ff9e5-d4eb-4e46-ad5f-4ec2152c0de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b9830b429a4ea6b68db1abcee66e0f, user_id=5ef80dd6da624dfb998c863b92466405, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:12.934068 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ff9e5-d4eb-4e46-ad5f-4ec2152c0de1 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:13.037007 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1469/2897] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:15:12 2022] PUT /identity/v3/projects/e1b9830b429a4ea6b68db1abcee66e0f/users/5ef80dd6da624dfb998c863b92466405/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:15:13.049073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19803298-4a57-44f2-97b7-15421f2e9a56 None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:13.049384 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19803298-4a57-44f2-97b7-15421f2e9a56 None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:13.049684 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19803298-4a57-44f2-97b7-15421f2e9a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:13.077208 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-19803298-4a57-44f2-97b7-15421f2e9a56 None None] MFA Rules not processed for user `5ef80dd6da624dfb998c863b92466405`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:15:13.078351 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-19803298-4a57-44f2-97b7-15421f2e9a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:15:13.145078 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1429/2898] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:15:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:15:13.156760 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ff9e5-d4eb-4e46-ad5f-4ec2152c0de1 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:13.159167 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-fe0ff9e5-d4eb-4e46-ad5f-4ec2152c0de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:15:13.180248 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:15:13.217175 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ff9e5-d4eb-4e46-ad5f-4ec2152c0de1 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:13.220867 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5171e-26d2-4599-a995-26075b3e8bba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:13.221513 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5171e-26d2-4599-a995-26075b3e8bba service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:13.221800 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5171e-26d2-4599-a995-26075b3e8bba service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:13.222080 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5171e-26d2-4599-a995-26075b3e8bba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:13.230789 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5171e-26d2-4599-a995-26075b3e8bba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:13.232225 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5171e-26d2-4599-a995-26075b3e8bba service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:13.241811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1470/2899] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:15:13 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:15:23.142073 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:15:23.262864 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=17 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:15:25.346920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19803298-4a57-44f2-97b7-15421f2e9a56 None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:25.413358 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19803298-4a57-44f2-97b7-15421f2e9a56 None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:25.417999 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe9482-e1bd-4c3e-be66-ffe31524ce20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:25.418919 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe9482-e1bd-4c3e-be66-ffe31524ce20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:25.419209 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe9482-e1bd-4c3e-be66-ffe31524ce20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:25.419995 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe9482-e1bd-4c3e-be66-ffe31524ce20 admin admin] PATH_INFO: `/v3/users/5ef80dd6da624dfb998c863b92466405` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:25.421248 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe9482-e1bd-4c3e-be66-ffe31524ce20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef80dd6da624dfb998c863b92466405)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:25.423252 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe9482-e1bd-4c3e-be66-ffe31524ce20 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:25.656997 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c6fe9482-e1bd-4c3e-be66-ffe31524ce20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef80dd6da624dfb998c863b92466405'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:25.657649 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c6fe9482-e1bd-4c3e-be66-ffe31524ce20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef80dd6da624dfb998c863b92466405'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:25.658253 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c6fe9482-e1bd-4c3e-be66-ffe31524ce20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef80dd6da624dfb998c863b92466405'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:25.742348 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c6fe9482-e1bd-4c3e-be66-ffe31524ce20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef80dd6da624dfb998c863b92466405'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:25.754808 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-c6fe9482-e1bd-4c3e-be66-ffe31524ce20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef80dd6da624dfb998c863b92466405'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:25.767130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1430/2900] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:15:25 2022] DELETE /identity/v3/users/5ef80dd6da624dfb998c863b92466405 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:15:25.771773 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae179f1a-ba05-49bd-95a4-0d77b96a5563 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:25.772552 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae179f1a-ba05-49bd-95a4-0d77b96a5563 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:25.772755 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae179f1a-ba05-49bd-95a4-0d77b96a5563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:25.789911 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-ae179f1a-ba05-49bd-95a4-0d77b96a5563 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:15:25.791121 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ae179f1a-ba05-49bd-95a4-0d77b96a5563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:15:25.850188 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1471/2901] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:15:25.866112 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe9482-e1bd-4c3e-be66-ffe31524ce20 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:25.867552 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-c6fe9482-e1bd-4c3e-be66-ffe31524ce20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:15:25.924107 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe9482-e1bd-4c3e-be66-ffe31524ce20 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:25.927782 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992e4b9-6852-46df-a445-ce05b075ffa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:25.928431 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992e4b9-6852-46df-a445-ce05b075ffa3 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:25.928721 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992e4b9-6852-46df-a445-ce05b075ffa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:25.929001 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992e4b9-6852-46df-a445-ce05b075ffa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:25.938060 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992e4b9-6852-46df-a445-ce05b075ffa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:25.939527 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992e4b9-6852-46df-a445-ce05b075ffa3 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:25.948898 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1431/2902] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:15:26.367213 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae179f1a-ba05-49bd-95a4-0d77b96a5563 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:26.368908 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-ae179f1a-ba05-49bd-95a4-0d77b96a5563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:15:26.381277 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae179f1a-ba05-49bd-95a4-0d77b96a5563 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:26.386033 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eaded-a04b-40a5-bbb4-9d23fec953c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:26.386958 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eaded-a04b-40a5-bbb4-9d23fec953c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:26.387247 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eaded-a04b-40a5-bbb4-9d23fec953c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:26.387526 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eaded-a04b-40a5-bbb4-9d23fec953c1 admin admin] PATH_INFO: `/v3/projects/e1b9830b429a4ea6b68db1abcee66e0f` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:26.389209 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eaded-a04b-40a5-bbb4-9d23fec953c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b9830b429a4ea6b68db1abcee66e0f)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:26.390784 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eaded-a04b-40a5-bbb4-9d23fec953c1 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:26.502995 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-172eaded-a04b-40a5-bbb4-9d23fec953c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b9830b429a4ea6b68db1abcee66e0f', 'request_id': 'req-172eaded-a04b-40a5-bbb4-9d23fec953c1'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:26.565278 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-172eaded-a04b-40a5-bbb4-9d23fec953c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b9830b429a4ea6b68db1abcee66e0f', 'request_id': 'req-172eaded-a04b-40a5-bbb4-9d23fec953c1'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:26.571937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-172eaded-a04b-40a5-bbb4-9d23fec953c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b9830b429a4ea6b68db1abcee66e0f', 'request_id': 'req-172eaded-a04b-40a5-bbb4-9d23fec953c1'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:26.583008 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-172eaded-a04b-40a5-bbb4-9d23fec953c1 admin admin] The token cache is being invalidate because project e1b9830b429a4ea6b68db1abcee66e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:15:26.583294 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-172eaded-a04b-40a5-bbb4-9d23fec953c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:26.584172 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-172eaded-a04b-40a5-bbb4-9d23fec953c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:15:26.585702 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1472/2903] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:15:26 2022] DELETE /identity/v3/projects/e1b9830b429a4ea6b68db1abcee66e0f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:15:35.944710 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:15:36.580105 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:13.312526 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90009c-ef85-4b02-89cd-d3f2bc974bed None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:16:13.313185 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90009c-ef85-4b02-89cd-d3f2bc974bed None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:16:13.313185 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90009c-ef85-4b02-89cd-d3f2bc974bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:16:13.329932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-1b90009c-ef85-4b02-89cd-d3f2bc974bed None None] MFA Rules not processed for user `80fa321f3ac1448681e4191ff04b47a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:16:13.331146 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1b90009c-ef85-4b02-89cd-d3f2bc974bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:16:13.385130 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1432/2904] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:16:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:16:17.626382 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eaded-a04b-40a5-bbb4-9d23fec953c1 admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:16:17.628116 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-172eaded-a04b-40a5-bbb4-9d23fec953c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:16:17.706449 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eaded-a04b-40a5-bbb4-9d23fec953c1 admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:16:17.712212 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc03b57-8ff3-42c8-a5a0-20e100b480b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2ec4c76f8f4d858bce53f30cc198fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:16:17.713100 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc03b57-8ff3-42c8-a5a0-20e100b480b6 service nova] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:16:17.713406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc03b57-8ff3-42c8-a5a0-20e100b480b6 service nova] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:16:17.713687 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc03b57-8ff3-42c8-a5a0-20e100b480b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:16:17.715609 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-adc03b57-8ff3-42c8-a5a0-20e100b480b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:16:17.728133 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc03b57-8ff3-42c8-a5a0-20e100b480b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:16:17.730152 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc03b57-8ff3-42c8-a5a0-20e100b480b6 service nova] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:16:17.741049 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1473/2905] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:16:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:16:23.378550 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=25 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:27.736409 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=34 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:50.841787 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90009c-ef85-4b02-89cd-d3f2bc974bed None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:16:50.843359 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1b90009c-ef85-4b02-89cd-d3f2bc974bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:16:50.917279 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90009c-ef85-4b02-89cd-d3f2bc974bed None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:16:50.922183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2063246-afc9-4290-a5dc-bcf1f28e8d49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:16:50.922920 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2063246-afc9-4290-a5dc-bcf1f28e8d49 service placement] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:16:50.923201 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2063246-afc9-4290-a5dc-bcf1f28e8d49 service placement] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:16:50.923507 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2063246-afc9-4290-a5dc-bcf1f28e8d49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:16:50.925271 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a2063246-afc9-4290-a5dc-bcf1f28e8d49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:16:50.936740 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2063246-afc9-4290-a5dc-bcf1f28e8d49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:16:50.938342 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2063246-afc9-4290-a5dc-bcf1f28e8d49 service placement] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:16:50.949480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1433/2906] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:16:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:17:00.945435 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=32 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:17:34.072484 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc03b57-8ff3-42c8-a5a0-20e100b480b6 service nova] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:34.082580 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc03b57-8ff3-42c8-a5a0-20e100b480b6 service nova] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:34.087985 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e809309-559a-42bb-aee8-ba10c78c6288 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:34.088642 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e809309-559a-42bb-aee8-ba10c78c6288 service placement] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:34.088940 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e809309-559a-42bb-aee8-ba10c78c6288 service placement] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:34.089210 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e809309-559a-42bb-aee8-ba10c78c6288 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:34.091050 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5e809309-559a-42bb-aee8-ba10c78c6288 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:17:34.106403 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e809309-559a-42bb-aee8-ba10c78c6288 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:34.106403 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e809309-559a-42bb-aee8-ba10c78c6288 service placement] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:34.116057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1474/2907] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:17:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:17:34.186714 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2063246-afc9-4290-a5dc-bcf1f28e8d49 service placement] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:34.188183 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-a2063246-afc9-4290-a5dc-bcf1f28e8d49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:17:34.257243 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2063246-afc9-4290-a5dc-bcf1f28e8d49 service placement] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:34.261827 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0949b-c3cf-42c0-80b7-a872420d69c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:34.262736 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0949b-c3cf-42c0-80b7-a872420d69c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:34.263030 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0949b-c3cf-42c0-80b7-a872420d69c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:34.263665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0949b-c3cf-42c0-80b7-a872420d69c5 admin admin] PATH_INFO: `/v3/users/80fa321f3ac1448681e4191ff04b47a2` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:34.264715 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0949b-c3cf-42c0-80b7-a872420d69c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80fa321f3ac1448681e4191ff04b47a2)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:34.266673 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0949b-c3cf-42c0-80b7-a872420d69c5 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:34.437467 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-a8e0949b-c3cf-42c0-80b7-a872420d69c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80fa321f3ac1448681e4191ff04b47a2'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:34.438128 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-a8e0949b-c3cf-42c0-80b7-a872420d69c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80fa321f3ac1448681e4191ff04b47a2'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:34.438804 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-a8e0949b-c3cf-42c0-80b7-a872420d69c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80fa321f3ac1448681e4191ff04b47a2'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:34.515932 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-a8e0949b-c3cf-42c0-80b7-a872420d69c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80fa321f3ac1448681e4191ff04b47a2'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:34.528935 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-a8e0949b-c3cf-42c0-80b7-a872420d69c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80fa321f3ac1448681e4191ff04b47a2'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:34.542016 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1434/2908] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:17:34 2022] DELETE /identity/v3/users/80fa321f3ac1448681e4191ff04b47a2 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:17:34.774004 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e809309-559a-42bb-aee8-ba10c78c6288 service placement] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:34.786123 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e809309-559a-42bb-aee8-ba10c78c6288 service placement] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:34.860836 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60f142-1041-4843-af9d-e6046f99ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:34.861701 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60f142-1041-4843-af9d-e6046f99ada5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:34.861981 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60f142-1041-4843-af9d-e6046f99ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:34.862256 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60f142-1041-4843-af9d-e6046f99ada5 admin admin] PATH_INFO: `/v3/projects/b3bbc230c5914635ba995b16e43059f7` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:34.863599 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60f142-1041-4843-af9d-e6046f99ada5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3bbc230c5914635ba995b16e43059f7)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:34.865555 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60f142-1041-4843-af9d-e6046f99ada5 admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:34.992109 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8e60f142-1041-4843-af9d-e6046f99ada5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3bbc230c5914635ba995b16e43059f7', 'request_id': 'req-8e60f142-1041-4843-af9d-e6046f99ada5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:35.111900 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8e60f142-1041-4843-af9d-e6046f99ada5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3bbc230c5914635ba995b16e43059f7', 'request_id': 'req-8e60f142-1041-4843-af9d-e6046f99ada5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:35.118464 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8e60f142-1041-4843-af9d-e6046f99ada5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3bbc230c5914635ba995b16e43059f7', 'request_id': 'req-8e60f142-1041-4843-af9d-e6046f99ada5'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:35.128937 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8e60f142-1041-4843-af9d-e6046f99ada5 admin admin] The token cache is being invalidate because project b3bbc230c5914635ba995b16e43059f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:17:35.129224 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8e60f142-1041-4843-af9d-e6046f99ada5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:35.129859 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-8e60f142-1041-4843-af9d-e6046f99ada5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:35.131443 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1475/2909] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:17:34 2022] DELETE /identity/v3/projects/b3bbc230c5914635ba995b16e43059f7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:17:35.136564 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090f51b-11ca-46e1-8116-b3b0cffcd3ae None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:35.136860 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090f51b-11ca-46e1-8116-b3b0cffcd3ae None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:35.137155 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090f51b-11ca-46e1-8116-b3b0cffcd3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:35.155992 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-1090f51b-11ca-46e1-8116-b3b0cffcd3ae None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:17:35.157185 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-1090f51b-11ca-46e1-8116-b3b0cffcd3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:17:35.217884 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1435/2910] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:17:35.225827 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d790e4e-8d0e-48c7-b1c4-2c0af930dc60 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:35.226122 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d790e4e-8d0e-48c7-b1c4-2c0af930dc60 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:35.226431 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d790e4e-8d0e-48c7-b1c4-2c0af930dc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:35.246215 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-5d790e4e-8d0e-48c7-b1c4-2c0af930dc60 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:17:35.247515 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-5d790e4e-8d0e-48c7-b1c4-2c0af930dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:17:35.255638 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1476/2911] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:17:35.259894 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090f51b-11ca-46e1-8116-b3b0cffcd3ae None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:35.270127 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090f51b-11ca-46e1-8116-b3b0cffcd3ae None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:35.274716 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59316bf6-eb11-44d4-b777-7a9d0441d10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:35.275375 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59316bf6-eb11-44d4-b777-7a9d0441d10e admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:35.275663 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59316bf6-eb11-44d4-b777-7a9d0441d10e admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:35.275945 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59316bf6-eb11-44d4-b777-7a9d0441d10e admin admin] PATH_INFO: `/v3/domains` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:35.276672 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59316bf6-eb11-44d4-b777-7a9d0441d10e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87034) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:17:35.276983 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59316bf6-eb11-44d4-b777-7a9d0441d10e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:35.278624 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59316bf6-eb11-44d4-b777-7a9d0441d10e admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:35.290754 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1436/2912] 10.222.0.112 () {58 vars in 1157 bytes} [Thu May 26 17:17:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:17:35.295162 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d790e4e-8d0e-48c7-b1c4-2c0af930dc60 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:35.304330 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d790e4e-8d0e-48c7-b1c4-2c0af930dc60 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:35.309065 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de0d85-b5a2-4612-ba97-0387432692ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:35.309714 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de0d85-b5a2-4612-ba97-0387432692ac admin admin] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:35.310026 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de0d85-b5a2-4612-ba97-0387432692ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:35.310474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de0d85-b5a2-4612-ba97-0387432692ac admin admin] PATH_INFO: `/v3/projects` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:35.311159 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de0d85-b5a2-4612-ba97-0387432692ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:35.313057 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de0d85-b5a2-4612-ba97-0387432692ac admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:35.422131 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1477/2913] 10.222.0.112 () {60 vars in 1157 bytes} [Thu May 26 17:17:35 2022] POST /identity/v3/projects => generated 392 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:17:35.426419 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59316bf6-eb11-44d4-b777-7a9d0441d10e admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:35.436687 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59316bf6-eb11-44d4-b777-7a9d0441d10e admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:35.440254 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:17:35.493602 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a4259-dd1d-4b9d-8d41-5f47e7847a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:35.494276 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a4259-dd1d-4b9d-8d41-5f47e7847a79 admin admin] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:35.495203 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a4259-dd1d-4b9d-8d41-5f47e7847a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:35.495493 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a4259-dd1d-4b9d-8d41-5f47e7847a79 admin admin] PATH_INFO: `/v3/users` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:35.496196 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a4259-dd1d-4b9d-8d41-5f47e7847a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:35.498740 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a4259-dd1d-4b9d-8d41-5f47e7847a79 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:35.609846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1437/2914] 10.222.0.112 () {60 vars in 1148 bytes} [Thu May 26 17:17:35 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:17:35.614170 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de0d85-b5a2-4612-ba97-0387432692ac admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:35.625403 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de0d85-b5a2-4612-ba97-0387432692ac admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:35.630130 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf983a9-6894-4d08-8007-9d6acd8823be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:35.630834 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf983a9-6894-4d08-8007-9d6acd8823be admin admin] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:35.631124 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf983a9-6894-4d08-8007-9d6acd8823be admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:35.631406 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf983a9-6894-4d08-8007-9d6acd8823be admin admin] PATH_INFO: `/v3/roles` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:35.632159 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf983a9-6894-4d08-8007-9d6acd8823be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:35.633777 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf983a9-6894-4d08-8007-9d6acd8823be admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:35.644076 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1478/2915] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:17:35 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:17:35.650915 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a4259-dd1d-4b9d-8d41-5f47e7847a79 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:35.661940 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a4259-dd1d-4b9d-8d41-5f47e7847a79 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:35.667173 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dab29-e297-42af-a6d2-866ffe07736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:35.667834 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dab29-e297-42af-a6d2-866ffe07736a admin admin] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:35.668121 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dab29-e297-42af-a6d2-866ffe07736a admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:35.668402 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dab29-e297-42af-a6d2-866ffe07736a admin admin] PATH_INFO: `/v3/roles` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:35.669123 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dab29-e297-42af-a6d2-866ffe07736a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:35.671713 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dab29-e297-42af-a6d2-866ffe07736a admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:35.681774 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1438/2916] 10.222.0.112 () {58 vars in 1126 bytes} [Thu May 26 17:17:35 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:17:35.685684 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf983a9-6894-4d08-8007-9d6acd8823be admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:35.695545 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf983a9-6894-4d08-8007-9d6acd8823be admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:35.700169 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ac0e9-12e1-428d-be88-b1e49dbc4a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:35.701033 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ac0e9-12e1-428d-be88-b1e49dbc4a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:35.701319 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ac0e9-12e1-428d-be88-b1e49dbc4a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:35.701597 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ac0e9-12e1-428d-be88-b1e49dbc4a1f admin admin] PATH_INFO: `/v3/projects/6c8ee408cbb94e40869de0f886fab6d3/users/724dd69928224e0f93e168c995cdcdb8/roles/5a16a034a01e45b89530e8dd35d56588` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:35.716047 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ac0e9-12e1-428d-be88-b1e49dbc4a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8ee408cbb94e40869de0f886fab6d3, user_id=724dd69928224e0f93e168c995cdcdb8, role_id=5a16a034a01e45b89530e8dd35d56588)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:35.719234 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ac0e9-12e1-428d-be88-b1e49dbc4a1f admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:35.808941 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1479/2917] 10.222.0.112 () {60 vars in 1487 bytes} [Thu May 26 17:17:35 2022] PUT /identity/v3/projects/6c8ee408cbb94e40869de0f886fab6d3/users/724dd69928224e0f93e168c995cdcdb8/roles/5a16a034a01e45b89530e8dd35d56588 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:17:35.819574 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ee3da-cc6e-4d23-89b0-0670034e386f None None] REQUEST_METHOD: `POST` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:35.819869 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ee3da-cc6e-4d23-89b0-0670034e386f None None] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:35.820157 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ee3da-cc6e-4d23-89b0-0670034e386f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:35.847475 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.auth.core [None req-d81ee3da-cc6e-4d23-89b0-0670034e386f None None] MFA Rules not processed for user `724dd69928224e0f93e168c995cdcdb8`. Rule list: `[]` (Enabled: `True`). {{(pid=87034) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:17:35.848687 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-d81ee3da-cc6e-4d23-89b0-0670034e386f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:17:35.916096 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1439/2918] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:17:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:17:35.928143 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ac0e9-12e1-428d-be88-b1e49dbc4a1f admin admin] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:35.930727 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-e65ac0e9-12e1-428d-be88-b1e49dbc4a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:17:35.939069 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:17:35.989264 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ac0e9-12e1-428d-be88-b1e49dbc4a1f admin admin] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:35.992974 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259a525-5741-418d-b27a-0d113b8c3695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53822ebd38c94a729591cb270e0459ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:35.993618 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259a525-5741-418d-b27a-0d113b8c3695 service cinder] REQUEST_METHOD: `GET` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:35.993906 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259a525-5741-418d-b27a-0d113b8c3695 service cinder] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:35.994186 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259a525-5741-418d-b27a-0d113b8c3695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:36.003108 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259a525-5741-418d-b27a-0d113b8c3695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:36.007202 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259a525-5741-418d-b27a-0d113b8c3695 service cinder] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:36.013694 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1480/2919] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:17:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:17:45.912809 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:17:46.025675 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=24 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:18:01.762639 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ee3da-cc6e-4d23-89b0-0670034e386f None None] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:18:01.826480 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ee3da-cc6e-4d23-89b0-0670034e386f None None] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:18:01.831291 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8e1d4-7246-4a00-a596-40e905807648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:18:01.832850 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8e1d4-7246-4a00-a596-40e905807648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:18:01.833138 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8e1d4-7246-4a00-a596-40e905807648 admin admin] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:18:01.833418 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8e1d4-7246-4a00-a596-40e905807648 admin admin] PATH_INFO: `/v3/users/724dd69928224e0f93e168c995cdcdb8` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:18:01.834899 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8e1d4-7246-4a00-a596-40e905807648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=724dd69928224e0f93e168c995cdcdb8)` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:18:01.836841 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8e1d4-7246-4a00-a596-40e905807648 admin admin] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:18:02.039417 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-20b8e1d4-7246-4a00-a596-40e905807648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724dd69928224e0f93e168c995cdcdb8'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:18:02.039987 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-20b8e1d4-7246-4a00-a596-40e905807648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724dd69928224e0f93e168c995cdcdb8'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:18:02.040619 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-20b8e1d4-7246-4a00-a596-40e905807648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724dd69928224e0f93e168c995cdcdb8'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:18:02.111858 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-20b8e1d4-7246-4a00-a596-40e905807648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724dd69928224e0f93e168c995cdcdb8'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:18:02.125815 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.notifications [None req-20b8e1d4-7246-4a00-a596-40e905807648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724dd69928224e0f93e168c995cdcdb8'} {{(pid=87034) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:18:02.138700 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1440/2920] 10.222.0.112 () {58 vars in 1228 bytes} [Thu May 26 17:18:01 2022] DELETE /identity/v3/users/724dd69928224e0f93e168c995cdcdb8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:18:02.143306 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9a325-3ea8-46ce-918c-ad17a1630073 None None] REQUEST_METHOD: `POST` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:18:02.143775 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9a325-3ea8-46ce-918c-ad17a1630073 None None] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:18:02.143878 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9a325-3ea8-46ce-918c-ad17a1630073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:18:02.162026 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.auth.core [None req-bfe9a325-3ea8-46ce-918c-ad17a1630073 None None] MFA Rules not processed for user `d22ba20f962d4757847ba75ce1eef95a`. Rule list: `[]` (Enabled: `True`). {{(pid=87033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:18:02.163334 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-bfe9a325-3ea8-46ce-918c-ad17a1630073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:18:02.221918 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1481/2921] 10.222.0.112 () {58 vars in 962 bytes} [Thu May 26 17:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:18:02.232370 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8e1d4-7246-4a00-a596-40e905807648 admin admin] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:18:02.233784 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-20b8e1d4-7246-4a00-a596-40e905807648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:18:02.291498 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8e1d4-7246-4a00-a596-40e905807648 admin admin] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:18:02.295018 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e69a9-10f6-4b87-8c91-58f17ff50ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0288901db0244eab9a737af460ce1bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:18:02.295665 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e69a9-10f6-4b87-8c91-58f17ff50ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:18:02.295951 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e69a9-10f6-4b87-8c91-58f17ff50ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:18:02.296231 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e69a9-10f6-4b87-8c91-58f17ff50ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:18:02.305283 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e69a9-10f6-4b87-8c91-58f17ff50ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:18:02.306753 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e69a9-10f6-4b87-8c91-58f17ff50ed0 service neutron] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:18:02.316105 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1441/2922] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:18:02.730339 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9a325-3ea8-46ce-918c-ad17a1630073 None None] Authenticating user token {{(pid=87033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:18:02.731865 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.fernet_utils [None req-bfe9a325-3ea8-46ce-918c-ad17a1630073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:18:02.746710 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9a325-3ea8-46ce-918c-ad17a1630073 None None] Validating token access rules against request {{(pid=87033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:18:02.751488 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e478969-2473-484d-9d03-2d6833636e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22ba20f962d4757847ba75ce1eef95a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dda95f8437548158ad5e83593c71483', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:18:02.752354 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e478969-2473-484d-9d03-2d6833636e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:18:02.752636 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e478969-2473-484d-9d03-2d6833636e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:18:02.752908 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e478969-2473-484d-9d03-2d6833636e7a admin admin] PATH_INFO: `/v3/projects/6c8ee408cbb94e40869de0f886fab6d3` {{(pid=87033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:18:02.762993 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e478969-2473-484d-9d03-2d6833636e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c8ee408cbb94e40869de0f886fab6d3)` {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:18:02.762993 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e478969-2473-484d-9d03-2d6833636e7a admin admin] RBAC: Authorization granted {{(pid=87033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:18:02.875682 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9e478969-2473-484d-9d03-2d6833636e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8ee408cbb94e40869de0f886fab6d3', 'request_id': 'req-9e478969-2473-484d-9d03-2d6833636e7a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:18:02.957104 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9e478969-2473-484d-9d03-2d6833636e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8ee408cbb94e40869de0f886fab6d3', 'request_id': 'req-9e478969-2473-484d-9d03-2d6833636e7a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:18:02.964181 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9e478969-2473-484d-9d03-2d6833636e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8ee408cbb94e40869de0f886fab6d3', 'request_id': 'req-9e478969-2473-484d-9d03-2d6833636e7a'} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:18:02.974811 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9e478969-2473-484d-9d03-2d6833636e7a admin admin] The token cache is being invalidate because project 6c8ee408cbb94e40869de0f886fab6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:18:02.975093 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9e478969-2473-484d-9d03-2d6833636e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:18:02.975720 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG keystone.notifications [None req-9e478969-2473-484d-9d03-2d6833636e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:18:02.977254 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: [pid: 87033|app: 0|req: 1482/2923] 10.222.0.112 () {58 vars in 1237 bytes} [Thu May 26 17:18:02 2022] DELETE /identity/v3/projects/6c8ee408cbb94e40869de0f886fab6d3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:18:12.311926 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:18:12.971474 dv-cinder-836072-5-iscsi devstack@keystone.service[87033]: DEBUG dbcounter [-] [87033] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:21:56.091506 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e69a9-10f6-4b87-8c91-58f17ff50ed0 service neutron] Authenticating user token {{(pid=87034) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:21:56.092913 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-535e69a9-10f6-4b87-8c91-58f17ff50ed0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:21:56.234943 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e69a9-10f6-4b87-8c91-58f17ff50ed0 service neutron] Validating token access rules against request {{(pid=87034) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:21:56.298164 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afef8a-7270-4033-8967-06003119e057 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b415e7fca03e4602b3d711436d47f46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be90db8d7ee4bd0b01444d1eab83ad8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87034) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:21:56.298863 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afef8a-7270-4033-8967-06003119e057 service placement] REQUEST_METHOD: `GET` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:21:56.299152 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afef8a-7270-4033-8967-06003119e057 service placement] SCRIPT_NAME: `/identity` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:21:56.299434 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afef8a-7270-4033-8967-06003119e057 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87034) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:21:56.301211 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.fernet_utils [None req-76afef8a-7270-4033-8967-06003119e057 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87034) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:21:56.312636 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afef8a-7270-4033-8967-06003119e057 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:21:56.314242 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afef8a-7270-4033-8967-06003119e057 service placement] RBAC: Authorization granted {{(pid=87034) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:21:56.324470 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: [pid: 87034|app: 0|req: 1442/2924] 10.222.0.112 () {60 vars in 1370 bytes} [Thu May 26 17:21:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:22:06.319846 dv-cinder-836072-5-iscsi devstack@keystone.service[87034]: DEBUG dbcounter [-] [87034] Writing DB stats keystone:SELECT=89 {{(pid=87034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}